[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:47:01 dist-test-slave-gjrz krb5kdc[15245](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:47:01 dist-test-slave-gjrz krb5kdc[15245](info): set up 2 sockets
Aug 05 22:47:01 dist-test-slave-gjrz krb5kdc[15245](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260805 22:47:02.455422 15234 mini_kdc.cc:121] Time spent starting KDC: real 1.135s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Aug 05 22:47:02 dist-test-slave-gjrz krb5kdc[15245](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970022, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:47:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:47:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.224.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab.
Entry for principal kudu/127.14.224.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab.
I20260805 22:47:02.582926 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:44369
--webserver_interface=127.14.224.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:44559
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.224.190:44369
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:47:02.667337 15263 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:02.667579 15263 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:02.667616 15263 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:02.668862 15263 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:47:02.668922 15263 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:02.668942 15263 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:02.668959 15263 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:47:02.668974 15263 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:47:02.670583 15263 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:44559
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.224.190:44369
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:44369
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.224.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15263
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:02.670869 15263 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:02.671103 15263 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:02.676388 15272 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:02.676416 15268 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:02.676607 15263 server_base.cc:1034] running on GCE node
W20260805 22:47:02.676386 15269 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:02.676895 15263 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:02.677220 15263 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:02.678372 15263 hybrid_clock.cc:648] HybridClock initialized: now 1785970022678327 us; error 123 us; skew 500 ppm
Aug 05 22:47:02 dist-test-slave-gjrz krb5kdc[15245](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970022, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:02.681104 15263 init.cc:377] Logged in from keytab as kudu/127.14.224.190@KRBTEST.COM (short username kudu)
I20260805 22:47:02.681612 15263 webserver.cc:460] Webserver started at http://127.14.224.190:40753/ using document root <none> and password file <none>
I20260805 22:47:02.681857 15263 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:02.681923 15263 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:02.682055 15263 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:02.683313 15263 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/minicluster-data/master-0/data/instance:
uuid: "98385a3f96e74b188bea8cebf7747494"
format_stamp: "Formatted at 2026-08-05 22:47:02 on dist-test-slave-gjrz"
server_key: "e3be5e3279910f053fd48a7ecc4c0eeb"
server_key_iv: "c8948cee8463f0b3e2bd71acd55be817"
server_key_version: "encryptionkey@0"
I20260805 22:47:02.683702 15263 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/minicluster-data/master-0/wal/instance:
uuid: "98385a3f96e74b188bea8cebf7747494"
format_stamp: "Formatted at 2026-08-05 22:47:02 on dist-test-slave-gjrz"
server_key: "e3be5e3279910f053fd48a7ecc4c0eeb"
server_key_iv: "c8948cee8463f0b3e2bd71acd55be817"
server_key_version: "encryptionkey@0"
I20260805 22:47:02.685259 15263 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260805 22:47:02.686172 15284 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:02.686360 15263 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:47:02.686460 15263 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/minicluster-data/master-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/minicluster-data/master-0/wal
uuid: "98385a3f96e74b188bea8cebf7747494"
format_stamp: "Formatted at 2026-08-05 22:47:02 on dist-test-slave-gjrz"
server_key: "e3be5e3279910f053fd48a7ecc4c0eeb"
server_key_iv: "c8948cee8463f0b3e2bd71acd55be817"
server_key_version: "encryptionkey@0"
I20260805 22:47:02.686532 15263 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:02.697690 15263 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:02.700143 15263 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:02.700304 15263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:02.704478 15263 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.190:44369
I20260805 22:47:02.704514 15352 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.190:44369 every 8 connection(s)
I20260805 22:47:02.704963 15263 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
I20260805 22:47:02.705911 15354 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:02.708464 15354 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 98385a3f96e74b188bea8cebf7747494: Bootstrap starting.
I20260805 22:47:02.709033 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 15263
I20260805 22:47:02.709151 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/minicluster-data/master-0/wal/instance
I20260805 22:47:02.709195 15354 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 98385a3f96e74b188bea8cebf7747494: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:02.709515 15354 log.cc:824] T 00000000000000000000000000000000 P 98385a3f96e74b188bea8cebf7747494: Log is configured to *not* fsync() on all Append() calls
I20260805 22:47:02.709939 15234 external_mini_cluster.cc:1428] Setting key c994741853bb252f15fea054e66624c1
I20260805 22:47:02.710336 15354 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 98385a3f96e74b188bea8cebf7747494: No bootstrap required, opened a new log
I20260805 22:47:02.712241 15354 raft_consensus.cc:348] T 00000000000000000000000000000000 P 98385a3f96e74b188bea8cebf7747494 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98385a3f96e74b188bea8cebf7747494" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 44369 } }
I20260805 22:47:02.712386 15354 raft_consensus.cc:374] T 00000000000000000000000000000000 P 98385a3f96e74b188bea8cebf7747494 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:02.712410 15354 raft_consensus.cc:729] T 00000000000000000000000000000000 P 98385a3f96e74b188bea8cebf7747494 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98385a3f96e74b188bea8cebf7747494, State: Initialized, Role: FOLLOWER
I20260805 22:47:02.712515 15354 consensus_queue.cc:260] T 00000000000000000000000000000000 P 98385a3f96e74b188bea8cebf7747494 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98385a3f96e74b188bea8cebf7747494" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 44369 } }
I20260805 22:47:02.712590 15354 raft_consensus.cc:388] T 00000000000000000000000000000000 P 98385a3f96e74b188bea8cebf7747494 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:47:02.712615 15354 raft_consensus.cc:482] T 00000000000000000000000000000000 P 98385a3f96e74b188bea8cebf7747494 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:47:02.712663 15354 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 98385a3f96e74b188bea8cebf7747494 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:02.713552 15354 raft_consensus.cc:504] T 00000000000000000000000000000000 P 98385a3f96e74b188bea8cebf7747494 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98385a3f96e74b188bea8cebf7747494" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 44369 } }
I20260805 22:47:02.713652 15354 leader_election.cc:302] T 00000000000000000000000000000000 P 98385a3f96e74b188bea8cebf7747494 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 98385a3f96e74b188bea8cebf7747494; no voters:
I20260805 22:47:02.713825 15354 leader_election.cc:288] T 00000000000000000000000000000000 P 98385a3f96e74b188bea8cebf7747494 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:47:02.713871 15359 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 98385a3f96e74b188bea8cebf7747494 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:47:02.714092 15359 raft_consensus.cc:686] T 00000000000000000000000000000000 P 98385a3f96e74b188bea8cebf7747494 [term 1 LEADER]: Becoming Leader. State: Replica: 98385a3f96e74b188bea8cebf7747494, State: Running, Role: LEADER
I20260805 22:47:02.714090 15354 sys_catalog.cc:564] T 00000000000000000000000000000000 P 98385a3f96e74b188bea8cebf7747494 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:47:02.714257 15359 consensus_queue.cc:237] T 00000000000000000000000000000000 P 98385a3f96e74b188bea8cebf7747494 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98385a3f96e74b188bea8cebf7747494" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 44369 } }
I20260805 22:47:02.714717 15360 sys_catalog.cc:455] T 00000000000000000000000000000000 P 98385a3f96e74b188bea8cebf7747494 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "98385a3f96e74b188bea8cebf7747494" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98385a3f96e74b188bea8cebf7747494" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 44369 } } }
I20260805 22:47:02.714809 15360 sys_catalog.cc:458] T 00000000000000000000000000000000 P 98385a3f96e74b188bea8cebf7747494 [sys.catalog]: This master's current role is: LEADER
I20260805 22:47:02.714888 15363 sys_catalog.cc:455] T 00000000000000000000000000000000 P 98385a3f96e74b188bea8cebf7747494 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 98385a3f96e74b188bea8cebf7747494. Latest consensus state: current_term: 1 leader_uuid: "98385a3f96e74b188bea8cebf7747494" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98385a3f96e74b188bea8cebf7747494" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 44369 } } }
I20260805 22:47:02.714936 15363 sys_catalog.cc:458] T 00000000000000000000000000000000 P 98385a3f96e74b188bea8cebf7747494 [sys.catalog]: This master's current role is: LEADER
I20260805 22:47:02.715376 15368 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:47:02.715927 15368 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:47:02.717797 15368 catalog_manager.cc:1347] Generated new cluster ID: 5a230a65996c4041bf6f48b42d34de66
I20260805 22:47:02.717857 15368 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 05 22:47:02 dist-test-slave-gjrz krb5kdc[15245](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970022, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:47:02.725874 15357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:02.710951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60560 (local address 127.14.224.190:44369)
0805 22:47:02.711159 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:02.711171 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:02.711411 (+ 240us) server_negotiation.cc:407] Connection header received
0805 22:47:02.713249 (+ 1838us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:02.713254 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:02.713298 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:02.713412 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:02.715700 (+ 2288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:02.716826 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:02.718264 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:02.718782 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:02.718895 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:02.722281 (+ 3386us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:02.722286 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:02.722286 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:02.722297 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:02.723921 (+ 1624us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:02.724370 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:02.724373 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:02.724373 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:02.724491 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:02.724760 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:02.724761 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:02.724761 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:02.725041 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:02.725202 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:02.725484 (+ 282us) server_negotiation.cc:299] Negotiation successful
0805 22:47:02.725624 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":75,"threads_started":1}
I20260805 22:47:02.739413 15368 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:47:02.740011 15368 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:47:02.743579 15368 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 98385a3f96e74b188bea8cebf7747494: Generated new TSK 0
I20260805 22:47:02.743772 15368 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.224.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab.
Entry for principal kudu/127.14.224.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab.
I20260805 22:47:02.779109 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.129:0
--local_ip_for_outbound_sockets=127.14.224.129
--webserver_interface=127.14.224.129
--webserver_port=0
--tserver_master_addrs=127.14.224.190:44369
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab
--principal=kudu/127.14.224.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:44559
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:47:02.877988 15395 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:02.878242 15395 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:02.878268 15395 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:02.879542 15395 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:02.879594 15395 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:02.879624 15395 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.129
I20260805 22:47:02.881193 15395 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:44559
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab
--principal=kudu/127.14.224.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.224.129
--webserver_port=0
--tserver_master_addrs=127.14.224.190:44369
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15395
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.129
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:02.881456 15395 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:02.881700 15395 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:02.887056 15405 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:02.887068 15403 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:02.887094 15395 server_base.cc:1034] running on GCE node
W20260805 22:47:02.887056 15402 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:02.887562 15395 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:02.887917 15395 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:02.889093 15395 hybrid_clock.cc:648] HybridClock initialized: now 1785970022889075 us; error 34 us; skew 500 ppm
Aug 05 22:47:02 dist-test-slave-gjrz krb5kdc[15245](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970022, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:02.891734 15395 init.cc:377] Logged in from keytab as kudu/127.14.224.129@KRBTEST.COM (short username kudu)
I20260805 22:47:02.892194 15395 webserver.cc:460] Webserver started at http://127.14.224.129:46795/ using document root <none> and password file <none>
I20260805 22:47:02.892414 15395 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:02.892467 15395 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:02.892611 15395 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:02.893708 15395 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/minicluster-data/ts-0/data/instance:
uuid: "c79d70205e084b39a803de177aec81f7"
format_stamp: "Formatted at 2026-08-05 22:47:02 on dist-test-slave-gjrz"
server_key: "5c93b2c0159a1e4c2431b03c13cba09f"
server_key_iv: "d5d8cb5c7c94c3ad036697efd8753c0c"
server_key_version: "encryptionkey@0"
I20260805 22:47:02.894057 15395 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/minicluster-data/ts-0/wal/instance:
uuid: "c79d70205e084b39a803de177aec81f7"
format_stamp: "Formatted at 2026-08-05 22:47:02 on dist-test-slave-gjrz"
server_key: "5c93b2c0159a1e4c2431b03c13cba09f"
server_key_iv: "d5d8cb5c7c94c3ad036697efd8753c0c"
server_key_version: "encryptionkey@0"
I20260805 22:47:02.895442 15395 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260805 22:47:02.896312 15414 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:02.896528 15395 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:47:02.896631 15395 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/minicluster-data/ts-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/minicluster-data/ts-0/wal
uuid: "c79d70205e084b39a803de177aec81f7"
format_stamp: "Formatted at 2026-08-05 22:47:02 on dist-test-slave-gjrz"
server_key: "5c93b2c0159a1e4c2431b03c13cba09f"
server_key_iv: "d5d8cb5c7c94c3ad036697efd8753c0c"
server_key_version: "encryptionkey@0"
I20260805 22:47:02.896706 15395 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:02.903494 15395 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:02.906147 15395 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:02.906320 15395 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:02.906620 15395 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:47:02.907061 15395 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:47:02.907112 15395 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:02.907153 15395 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:47:02.907176 15395 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:02.913328 15395 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.129:41263
I20260805 22:47:02.913419 15575 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.129:41263 every 8 connection(s)
I20260805 22:47:02.913931 15395 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
I20260805 22:47:02.915987 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 15395
I20260805 22:47:02.916072 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/minicluster-data/ts-0/wal/instance
I20260805 22:47:02.916203 15234 external_mini_cluster.cc:1428] Setting key 76b998ea3fb034660e1b9a1639e18ab5
Aug 05 22:47:02 dist-test-slave-gjrz krb5kdc[15245](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970022, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.129@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:47:02.925065 15357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:02.914903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.129:42101 (local address 127.14.224.190:44369)
0805 22:47:02.914967 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:02.914969 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:02.915212 (+ 243us) server_negotiation.cc:407] Connection header received
0805 22:47:02.915862 (+ 650us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:02.915864 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:02.915881 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:02.915933 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:02.917300 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:02.917796 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:02.919060 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:02.919394 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:02.919462 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:02.921922 (+ 2460us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:02.921924 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:02.921924 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:02.921934 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:02.923506 (+ 1572us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:02.923953 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:02.923954 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:02.923954 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:02.924018 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:02.924318 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:02.924319 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:02.924319 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:02.924473 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:02.924546 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:02.924854 (+ 308us) server_negotiation.cc:299] Negotiation successful
0805 22:47:02.924948 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260805 22:47:02.925164 15579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:02.914902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:44369 (local address 127.14.224.129:42101)
0805 22:47:02.915078 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:02.915120 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:02.915685 (+ 565us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:02.916009 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:02.916013 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:02.916974 (+ 961us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:02.917195 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:02.917201 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:02.917885 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:02.917886 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:02.918859 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:02.918864 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:02.919477 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:02.919479 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:02.919645 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:02.920183 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:02.920193 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:02.921804 (+ 1611us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:02.923612 (+ 1808us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:02.923620 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:02.923622 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:02.923872 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:02.924124 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:02.924125 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:02.924125 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:02.924247 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:02.924564 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:02.924571 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:02.924706 (+ 135us) client_negotiation.cc:769] Sending connection context
0805 22:47:02.924814 (+ 108us) client_negotiation.cc:240] Negotiation successful
0805 22:47:02.924961 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":87,"threads_started":1}
WARNING: no policy specified for kudu/127.14.224.130@KRBTEST.COM; defaulting to no policy
I20260805 22:47:02.925693 15577 heartbeater.cc:347] Connected to a master server at 127.14.224.190:44369
I20260805 22:47:02.925800 15577 heartbeater.cc:464] Registering TS with master...
I20260805 22:47:02.926000 15577 heartbeater.cc:511] Master 127.14.224.190:44369 requested a full tablet report, sending...
I20260805 22:47:02.926578 15307 ts_manager.cc:194] Registered new tserver with Master: c79d70205e084b39a803de177aec81f7 (127.14.224.129:41263)
I20260805 22:47:02.927356 15307 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.224.129@KRBTEST.COM'} at 127.14.224.129:42101
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab.
Entry for principal kudu/127.14.224.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab.
I20260805 22:47:02.945993 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.130:0
--local_ip_for_outbound_sockets=127.14.224.130
--webserver_interface=127.14.224.130
--webserver_port=0
--tserver_master_addrs=127.14.224.190:44369
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab
--principal=kudu/127.14.224.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:44559
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:47:03.030184 15583 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:03.030427 15583 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:03.030463 15583 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:03.031734 15583 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:03.031786 15583 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:03.031823 15583 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.130
I20260805 22:47:03.033390 15583 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:44559
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab
--principal=kudu/127.14.224.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.224.130
--webserver_port=0
--tserver_master_addrs=127.14.224.190:44369
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15583
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.130
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:03.033658 15583 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:03.033887 15583 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:03.039131 15594 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:03.039144 15592 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:03.039183 15583 server_base.cc:1034] running on GCE node
W20260805 22:47:03.039152 15591 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:03.039669 15583 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:03.039921 15583 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:03.041060 15583 hybrid_clock.cc:648] HybridClock initialized: now 1785970023041049 us; error 31 us; skew 500 ppm
Aug 05 22:47:03 dist-test-slave-gjrz krb5kdc[15245](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970023, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:03.043725 15583 init.cc:377] Logged in from keytab as kudu/127.14.224.130@KRBTEST.COM (short username kudu)
I20260805 22:47:03.044188 15583 webserver.cc:460] Webserver started at http://127.14.224.130:41567/ using document root <none> and password file <none>
I20260805 22:47:03.044405 15583 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:03.044450 15583 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:03.044591 15583 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:03.045699 15583 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/minicluster-data/ts-1/data/instance:
uuid: "8a391d3be0e44f45bc4217fa5cc79804"
format_stamp: "Formatted at 2026-08-05 22:47:03 on dist-test-slave-gjrz"
server_key: "e4a03c47fa15d6cef21c4c39337ed013"
server_key_iv: "a6ab8ed94392076369c6f1034f6c5c14"
server_key_version: "encryptionkey@0"
I20260805 22:47:03.046056 15583 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/minicluster-data/ts-1/wal/instance:
uuid: "8a391d3be0e44f45bc4217fa5cc79804"
format_stamp: "Formatted at 2026-08-05 22:47:03 on dist-test-slave-gjrz"
server_key: "e4a03c47fa15d6cef21c4c39337ed013"
server_key_iv: "a6ab8ed94392076369c6f1034f6c5c14"
server_key_version: "encryptionkey@0"
I20260805 22:47:03.047398 15583 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260805 22:47:03.048126 15605 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:03.048272 15583 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260805 22:47:03.048354 15583 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/minicluster-data/ts-1/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/minicluster-data/ts-1/wal
uuid: "8a391d3be0e44f45bc4217fa5cc79804"
format_stamp: "Formatted at 2026-08-05 22:47:03 on dist-test-slave-gjrz"
server_key: "e4a03c47fa15d6cef21c4c39337ed013"
server_key_iv: "a6ab8ed94392076369c6f1034f6c5c14"
server_key_version: "encryptionkey@0"
I20260805 22:47:03.048425 15583 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:03.067497 15583 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:03.069587 15583 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:03.069717 15583 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:03.069981 15583 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:47:03.070307 15583 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:47:03.070343 15583 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:03.070364 15583 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:47:03.070387 15583 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:03.076297 15583 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.130:45869
I20260805 22:47:03.076342 15758 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.130:45869 every 8 connection(s)
I20260805 22:47:03.076676 15583 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
I20260805 22:47:03.082103 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 15583
I20260805 22:47:03.082212 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/minicluster-data/ts-1/wal/instance
I20260805 22:47:03.082384 15234 external_mini_cluster.cc:1428] Setting key ce8a166dd03ffce4d83666131954fa39
Aug 05 22:47:03 dist-test-slave-gjrz krb5kdc[15245](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970023, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.130@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:47:03.087177 15357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:03.077457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:49811 (local address 127.14.224.190:44369)
0805 22:47:03.077512 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:03.077514 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:03.077706 (+ 192us) server_negotiation.cc:407] Connection header received
0805 22:47:03.078241 (+ 535us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:03.078242 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:03.078256 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:03.078309 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:03.079327 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:03.079827 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:03.080809 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:03.081004 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:03.081060 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:03.083785 (+ 2725us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:03.083788 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:03.083788 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:03.083798 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:03.085370 (+ 1572us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:03.085987 (+ 617us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:03.085988 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:03.085988 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:03.086066 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:03.086429 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:03.086430 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:03.086430 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:03.086587 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:03.086657 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:03.087005 (+ 348us) server_negotiation.cc:299] Negotiation successful
0805 22:47:03.087101 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260805 22:47:03.087430 15764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:03.077412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:44369 (local address 127.14.224.130:49811)
0805 22:47:03.077582 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:03.077622 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:03.078142 (+ 520us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:03.078393 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:03.078396 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:03.078992 (+ 596us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:03.079203 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:03.079208 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:03.079914 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:03.079915 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:03.080721 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:03.080723 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:03.081077 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:03.081078 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:03.081206 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:03.081759 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:03.081769 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:03.083680 (+ 1911us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:03.085482 (+ 1802us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:03.085494 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:03.085498 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:03.085869 (+ 371us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:03.086157 (+ 288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:03.086158 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:03.086158 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:03.086326 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:03.086664 (+ 338us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:03.086672 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:03.086854 (+ 182us) client_negotiation.cc:769] Sending connection context
0805 22:47:03.086975 (+ 121us) client_negotiation.cc:240] Negotiation successful
0805 22:47:03.087162 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":83,"threads_started":1}
I20260805 22:47:03.087952 15760 heartbeater.cc:347] Connected to a master server at 127.14.224.190:44369
I20260805 22:47:03.088061 15760 heartbeater.cc:464] Registering TS with master...
I20260805 22:47:03.088246 15760 heartbeater.cc:511] Master 127.14.224.190:44369 requested a full tablet report, sending...
I20260805 22:47:03.088654 15307 ts_manager.cc:194] Registered new tserver with Master: 8a391d3be0e44f45bc4217fa5cc79804 (127.14.224.130:45869)
I20260805 22:47:03.089164 15307 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.224.130@KRBTEST.COM'} at 127.14.224.130:49811
WARNING: no policy specified for kudu/127.14.224.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab.
Entry for principal kudu/127.14.224.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab.
I20260805 22:47:03.112386 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.131:0
--local_ip_for_outbound_sockets=127.14.224.131
--webserver_interface=127.14.224.131
--webserver_port=0
--tserver_master_addrs=127.14.224.190:44369
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab
--principal=kudu/127.14.224.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:44559
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:47:03.197837 15767 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:03.198084 15767 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:03.198118 15767 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:03.199456 15767 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:03.199512 15767 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:03.199553 15767 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.131
I20260805 22:47:03.201642 15767 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:44559
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab
--principal=kudu/127.14.224.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.224.131
--webserver_port=0
--tserver_master_addrs=127.14.224.190:44369
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15767
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.131
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:03.202772 15767 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:03.203135 15767 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:03.208622 15773 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:03.208642 15767 server_base.cc:1034] running on GCE node
W20260805 22:47:03.208634 15775 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:03.208622 15772 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:03.209033 15767 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:03.209293 15767 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:03.210434 15767 hybrid_clock.cc:648] HybridClock initialized: now 1785970023210417 us; error 35 us; skew 500 ppm
Aug 05 22:47:03 dist-test-slave-gjrz krb5kdc[15245](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970023, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:03.213023 15767 init.cc:377] Logged in from keytab as kudu/127.14.224.131@KRBTEST.COM (short username kudu)
I20260805 22:47:03.213508 15767 webserver.cc:460] Webserver started at http://127.14.224.131:42511/ using document root <none> and password file <none>
I20260805 22:47:03.213723 15767 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:03.213776 15767 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:03.213910 15767 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:03.215055 15767 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/minicluster-data/ts-2/data/instance:
uuid: "99933dd13e314ceb83f6c4bb56100290"
format_stamp: "Formatted at 2026-08-05 22:47:03 on dist-test-slave-gjrz"
server_key: "7af42983fe92ac186212b1c7e4436408"
server_key_iv: "0de8352349fb99833aecb4b6cb7e8636"
server_key_version: "encryptionkey@0"
I20260805 22:47:03.215444 15767 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/minicluster-data/ts-2/wal/instance:
uuid: "99933dd13e314ceb83f6c4bb56100290"
format_stamp: "Formatted at 2026-08-05 22:47:03 on dist-test-slave-gjrz"
server_key: "7af42983fe92ac186212b1c7e4436408"
server_key_iv: "0de8352349fb99833aecb4b6cb7e8636"
server_key_version: "encryptionkey@0"
I20260805 22:47:03.216801 15767 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:47:03.217532 15785 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:03.217727 15767 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:47:03.217825 15767 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/minicluster-data/ts-2/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/minicluster-data/ts-2/wal
uuid: "99933dd13e314ceb83f6c4bb56100290"
format_stamp: "Formatted at 2026-08-05 22:47:03 on dist-test-slave-gjrz"
server_key: "7af42983fe92ac186212b1c7e4436408"
server_key_iv: "0de8352349fb99833aecb4b6cb7e8636"
server_key_version: "encryptionkey@0"
I20260805 22:47:03.217898 15767 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:03.236083 15767 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:03.237932 15767 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:03.238049 15767 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:03.238268 15767 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:47:03.238564 15767 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:47:03.238596 15767 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:03.238617 15767 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:47:03.238633 15767 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:03.244872 15767 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.131:46233
I20260805 22:47:03.244925 15938 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.131:46233 every 8 connection(s)
I20260805 22:47:03.245263 15767 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
I20260805 22:47:03.248534 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 15767
I20260805 22:47:03.248637 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970021300824-15234-0/minicluster-data/ts-2/wal/instance
I20260805 22:47:03.248799 15234 external_mini_cluster.cc:1428] Setting key 50de03a9d4b8863248389bedce694e22
Aug 05 22:47:03 dist-test-slave-gjrz krb5kdc[15245](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970023, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.131@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:47:03.254748 15357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:03.246059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:53743 (local address 127.14.224.190:44369)
0805 22:47:03.246144 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:03.246147 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:03.246318 (+ 171us) server_negotiation.cc:407] Connection header received
0805 22:47:03.246802 (+ 484us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:03.246803 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:03.246815 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:03.246865 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:03.247899 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:03.248454 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:03.249776 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:03.250033 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:03.250085 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:03.252326 (+ 2241us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:03.252328 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:03.252329 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:03.252337 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:03.253488 (+ 1151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:03.253868 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:03.253869 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:03.253869 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:03.253918 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:03.254161 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:03.254163 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:03.254163 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:03.254304 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:03.254379 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:03.254604 (+ 225us) server_negotiation.cc:299] Negotiation successful
0805 22:47:03.254677 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260805 22:47:03.254935 15942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:03.246037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:44369 (local address 127.14.224.131:53743)
0805 22:47:03.246198 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:03.246236 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:03.246718 (+ 482us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:03.246931 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:03.246934 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:03.247585 (+ 651us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:03.247796 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:03.247802 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:03.248562 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:03.248564 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:03.249689 (+ 1125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:03.249694 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:03.250117 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:03.250118 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:03.250232 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:03.250707 (+ 475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:03.250716 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:03.252231 (+ 1515us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:03.253561 (+ 1330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:03.253568 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:03.253570 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:03.253808 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:03.253965 (+ 157us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:03.253965 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:03.253965 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:03.254062 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:03.254371 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:03.254375 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:03.254503 (+ 128us) client_negotiation.cc:769] Sending connection context
0805 22:47:03.254582 (+ 79us) client_negotiation.cc:240] Negotiation successful
0805 22:47:03.254713 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":91,"threads_started":1}
I20260805 22:47:03.255470 15940 heartbeater.cc:347] Connected to a master server at 127.14.224.190:44369
I20260805 22:47:03.255595 15940 heartbeater.cc:464] Registering TS with master...
I20260805 22:47:03.255795 15940 heartbeater.cc:511] Master 127.14.224.190:44369 requested a full tablet report, sending...
I20260805 22:47:03.256206 15307 ts_manager.cc:194] Registered new tserver with Master: 99933dd13e314ceb83f6c4bb56100290 (127.14.224.131:46233)
I20260805 22:47:03.256567 15307 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.224.131@KRBTEST.COM'} at 127.14.224.131:53743
I20260805 22:47:03.260843 15234 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 05 22:47:03 dist-test-slave-gjrz krb5kdc[15245](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970023, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 05 22:47:03 dist-test-slave-gjrz krb5kdc[15245](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970023, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.14.224.129@KRBTEST.COM
I20260805 22:47:03.285683 15948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:03.277934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33610 (local address 127.14.224.129:41263)
0805 22:47:03.278119 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:03.278125 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:03.278137 (+ 12us) server_negotiation.cc:407] Connection header received
0805 22:47:03.278165 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:03.278167 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:03.278182 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:03.278252 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:03.278800 (+ 548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:03.279593 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:03.280336 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:03.280689 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:03.280749 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:03.282983 (+ 2234us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:03.283011 (+ 28us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:03.283011 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:03.283024 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:03.284471 (+ 1447us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:03.284847 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:03.284850 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:03.284850 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:03.284923 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:03.285104 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:03.285105 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:03.285105 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:03.285255 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:03.285408 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:03.285479 (+ 71us) server_negotiation.cc:299] Negotiation successful
0805 22:47:03.285572 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":78,"threads_started":1}
W20260805 22:47:03.286366 15449 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33610
Aug 05 22:47:03 dist-test-slave-gjrz krb5kdc[15245](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970023, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 05 22:47:03 dist-test-slave-gjrz krb5kdc[15245](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970023, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.224.129@KRBTEST.COM
I20260805 22:47:03.310865 15948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:03.304416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33612 (local address 127.14.224.129:41263)
0805 22:47:03.304516 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:03.304519 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:03.304570 (+ 51us) server_negotiation.cc:407] Connection header received
0805 22:47:03.304662 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:03.304663 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:03.304673 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:03.304723 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:03.305353 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:03.305858 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:03.306558 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:03.306757 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:03.306810 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:03.308926 (+ 2116us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:03.308928 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:03.308928 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:03.308935 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:03.310025 (+ 1090us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:03.310312 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:03.310313 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:03.310313 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:03.310359 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:03.310483 (+ 124us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:03.310483 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:03.310484 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:03.310582 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:03.310667 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:03.310725 (+ 58us) server_negotiation.cc:299] Negotiation successful
0805 22:47:03.310790 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260805 22:47:03.311429 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 15395
I20260805 22:47:03.323086 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 15583
I20260805 22:47:03.332839 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 15767
I20260805 22:47:03.346292 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 15263
2026-08-05T22:47:03Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2056 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:47:03 dist-test-slave-gjrz krb5kdc[15957](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:47:03 dist-test-slave-gjrz krb5kdc[15957](info): set up 2 sockets
Aug 05 22:47:03 dist-test-slave-gjrz krb5kdc[15957](info): commencing operation
krb5kdc: starting...
W20260805 22:47:04.483978 15234 mini_kdc.cc:121] Time spent starting KDC: real 1.113s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Aug 05 22:47:04 dist-test-slave-gjrz krb5kdc[15957](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970024, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:47:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:47:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.224.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab.
Entry for principal kudu/127.14.224.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab.
I20260805 22:47:04.630825 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:41695
--webserver_interface=127.14.224.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:38625
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.224.190:41695
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:47:04.715236 15973 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:04.715546 15973 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:04.715579 15973 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:04.716835 15973 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:47:04.716889 15973 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:04.716908 15973 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:04.716924 15973 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:47:04.716941 15973 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:47:04.718560 15973 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:38625
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.224.190:41695
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:41695
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.224.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15973
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:04.718832 15973 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:04.719069 15973 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:04.724227 15986 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:04.724238 15980 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:04.724231 15983 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:04.724251 15973 server_base.cc:1034] running on GCE node
I20260805 22:47:04.724735 15973 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:04.725013 15973 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:04.726163 15973 hybrid_clock.cc:648] HybridClock initialized: now 1785970024726148 us; error 31 us; skew 500 ppm
Aug 05 22:47:04 dist-test-slave-gjrz krb5kdc[15957](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970024, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:04.728826 15973 init.cc:377] Logged in from keytab as kudu/127.14.224.190@KRBTEST.COM (short username kudu)
I20260805 22:47:04.729282 15973 webserver.cc:460] Webserver started at http://127.14.224.190:33791/ using document root <none> and password file <none>
I20260805 22:47:04.729516 15973 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:04.729573 15973 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:04.729703 15973 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:04.730792 15973 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/minicluster-data/master-0/data/instance:
uuid: "ca4f7904f3dd4dcaaa0675a967be89d1"
format_stamp: "Formatted at 2026-08-05 22:47:04 on dist-test-slave-gjrz"
server_key: "4a967f733edac53820be7d11d2b3c47d"
server_key_iv: "26e69bdb6b894069d72aab3b0ba80d46"
server_key_version: "encryptionkey@0"
I20260805 22:47:04.731132 15973 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/minicluster-data/master-0/wal/instance:
uuid: "ca4f7904f3dd4dcaaa0675a967be89d1"
format_stamp: "Formatted at 2026-08-05 22:47:04 on dist-test-slave-gjrz"
server_key: "4a967f733edac53820be7d11d2b3c47d"
server_key_iv: "26e69bdb6b894069d72aab3b0ba80d46"
server_key_version: "encryptionkey@0"
I20260805 22:47:04.732513 15973 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:47:04.733290 15997 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:04.733464 15973 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260805 22:47:04.733567 15973 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/minicluster-data/master-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/minicluster-data/master-0/wal
uuid: "ca4f7904f3dd4dcaaa0675a967be89d1"
format_stamp: "Formatted at 2026-08-05 22:47:04 on dist-test-slave-gjrz"
server_key: "4a967f733edac53820be7d11d2b3c47d"
server_key_iv: "26e69bdb6b894069d72aab3b0ba80d46"
server_key_version: "encryptionkey@0"
I20260805 22:47:04.733636 15973 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:04.742573 15973 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:04.744519 15973 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:04.744673 15973 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:04.748605 15973 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.190:41695
I20260805 22:47:04.748643 16065 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.190:41695 every 8 connection(s)
I20260805 22:47:04.748987 15973 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
I20260805 22:47:04.749881 16066 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:04.752364 16066 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca4f7904f3dd4dcaaa0675a967be89d1: Bootstrap starting.
I20260805 22:47:04.752964 16066 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ca4f7904f3dd4dcaaa0675a967be89d1: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:04.753239 16066 log.cc:824] T 00000000000000000000000000000000 P ca4f7904f3dd4dcaaa0675a967be89d1: Log is configured to *not* fsync() on all Append() calls
I20260805 22:47:04.753949 16066 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca4f7904f3dd4dcaaa0675a967be89d1: No bootstrap required, opened a new log
I20260805 22:47:04.755666 16066 raft_consensus.cc:348] T 00000000000000000000000000000000 P ca4f7904f3dd4dcaaa0675a967be89d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca4f7904f3dd4dcaaa0675a967be89d1" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 41695 } }
I20260805 22:47:04.755828 16066 raft_consensus.cc:374] T 00000000000000000000000000000000 P ca4f7904f3dd4dcaaa0675a967be89d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:04.755851 16066 raft_consensus.cc:729] T 00000000000000000000000000000000 P ca4f7904f3dd4dcaaa0675a967be89d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca4f7904f3dd4dcaaa0675a967be89d1, State: Initialized, Role: FOLLOWER
I20260805 22:47:04.755999 16066 consensus_queue.cc:260] T 00000000000000000000000000000000 P ca4f7904f3dd4dcaaa0675a967be89d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca4f7904f3dd4dcaaa0675a967be89d1" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 41695 } }
I20260805 22:47:04.756072 16066 raft_consensus.cc:388] T 00000000000000000000000000000000 P ca4f7904f3dd4dcaaa0675a967be89d1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:47:04.756098 16066 raft_consensus.cc:482] T 00000000000000000000000000000000 P ca4f7904f3dd4dcaaa0675a967be89d1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:47:04.756146 16066 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ca4f7904f3dd4dcaaa0675a967be89d1 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:04.756719 16066 raft_consensus.cc:504] T 00000000000000000000000000000000 P ca4f7904f3dd4dcaaa0675a967be89d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca4f7904f3dd4dcaaa0675a967be89d1" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 41695 } }
I20260805 22:47:04.756742 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 15973
I20260805 22:47:04.756820 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/minicluster-data/master-0/wal/instance
I20260805 22:47:04.756817 16066 leader_election.cc:302] T 00000000000000000000000000000000 P ca4f7904f3dd4dcaaa0675a967be89d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ca4f7904f3dd4dcaaa0675a967be89d1; no voters:
I20260805 22:47:04.756970 15234 external_mini_cluster.cc:1428] Setting key 60bc555914f0ef120a94573bf899ee57
I20260805 22:47:04.757001 16066 leader_election.cc:288] T 00000000000000000000000000000000 P ca4f7904f3dd4dcaaa0675a967be89d1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:47:04.757028 16071 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ca4f7904f3dd4dcaaa0675a967be89d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:47:04.757153 16071 raft_consensus.cc:686] T 00000000000000000000000000000000 P ca4f7904f3dd4dcaaa0675a967be89d1 [term 1 LEADER]: Becoming Leader. State: Replica: ca4f7904f3dd4dcaaa0675a967be89d1, State: Running, Role: LEADER
I20260805 22:47:04.757244 16071 consensus_queue.cc:237] T 00000000000000000000000000000000 P ca4f7904f3dd4dcaaa0675a967be89d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca4f7904f3dd4dcaaa0675a967be89d1" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 41695 } }
I20260805 22:47:04.757303 16066 sys_catalog.cc:564] T 00000000000000000000000000000000 P ca4f7904f3dd4dcaaa0675a967be89d1 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:47:04.758023 16073 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca4f7904f3dd4dcaaa0675a967be89d1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ca4f7904f3dd4dcaaa0675a967be89d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca4f7904f3dd4dcaaa0675a967be89d1" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 41695 } } }
I20260805 22:47:04.758116 16073 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca4f7904f3dd4dcaaa0675a967be89d1 [sys.catalog]: This master's current role is: LEADER
I20260805 22:47:04.758628 16088 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:47:04.758585 16072 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca4f7904f3dd4dcaaa0675a967be89d1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ca4f7904f3dd4dcaaa0675a967be89d1. Latest consensus state: current_term: 1 leader_uuid: "ca4f7904f3dd4dcaaa0675a967be89d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca4f7904f3dd4dcaaa0675a967be89d1" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 41695 } } }
I20260805 22:47:04.758919 16072 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca4f7904f3dd4dcaaa0675a967be89d1 [sys.catalog]: This master's current role is: LEADER
I20260805 22:47:04.759363 16088 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:47:04.761070 16088 catalog_manager.cc:1347] Generated new cluster ID: 25c3b8669eba4c8c9bbc5154fe112144
I20260805 22:47:04.761132 16088 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 05 22:47:04 dist-test-slave-gjrz krb5kdc[15957](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970024, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:47:04.767952 16079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:04.757672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50196 (local address 127.14.224.190:41695)
0805 22:47:04.757857 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:04.757867 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:04.757909 (+ 42us) server_negotiation.cc:407] Connection header received
0805 22:47:04.758047 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:04.758055 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:04.758129 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:04.758830 (+ 701us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:04.759078 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:04.760496 (+ 1418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:04.761313 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:04.761760 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:04.761861 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:04.764200 (+ 2339us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:04.764206 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:04.764206 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:04.764219 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:04.766401 (+ 2182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:04.766762 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:04.766765 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:04.766765 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:04.766872 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:04.767061 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:04.767062 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:04.767062 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:04.767365 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:04.767544 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:04.767620 (+ 76us) server_negotiation.cc:299] Negotiation successful
0805 22:47:04.767766 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":101,"threads_started":1}
I20260805 22:47:04.772055 16088 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:47:04.772579 16088 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:47:04.778412 16088 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ca4f7904f3dd4dcaaa0675a967be89d1: Generated new TSK 0
I20260805 22:47:04.778616 16088 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.224.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab.
Entry for principal kudu/127.14.224.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab.
I20260805 22:47:04.811848 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.129:0
--local_ip_for_outbound_sockets=127.14.224.129
--webserver_interface=127.14.224.129
--webserver_port=0
--tserver_master_addrs=127.14.224.190:41695
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab
--principal=kudu/127.14.224.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:38625
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:47:04.921625 16103 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:04.921839 16103 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:04.921865 16103 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:04.923048 16103 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:04.923087 16103 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:04.923115 16103 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.129
I20260805 22:47:04.924747 16103 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:38625
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab
--principal=kudu/127.14.224.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.224.129
--webserver_port=0
--tserver_master_addrs=127.14.224.190:41695
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16103
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.129
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:04.924974 16103 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:04.925187 16103 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260805 22:47:04.930226 16103 server_base.cc:1034] running on GCE node
W20260805 22:47:04.930226 16111 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:04.930276 16113 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:04.930245 16117 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:04.930670 16103 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:04.930920 16103 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:04.932078 16103 hybrid_clock.cc:648] HybridClock initialized: now 1785970024932059 us; error 34 us; skew 500 ppm
Aug 05 22:47:04 dist-test-slave-gjrz krb5kdc[15957](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970024, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:04.934556 16103 init.cc:377] Logged in from keytab as kudu/127.14.224.129@KRBTEST.COM (short username kudu)
I20260805 22:47:04.935050 16103 webserver.cc:460] Webserver started at http://127.14.224.129:41455/ using document root <none> and password file <none>
I20260805 22:47:04.935289 16103 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:04.935353 16103 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:04.935494 16103 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:04.936816 16103 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/minicluster-data/ts-0/data/instance:
uuid: "67a56301a3994b23999b8e0670aa0a4a"
format_stamp: "Formatted at 2026-08-05 22:47:04 on dist-test-slave-gjrz"
server_key: "7e97b73775372b3a3ddbc7207d6e5daa"
server_key_iv: "f5d401994261100bca3989260ed240d4"
server_key_version: "encryptionkey@0"
I20260805 22:47:04.937184 16103 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/minicluster-data/ts-0/wal/instance:
uuid: "67a56301a3994b23999b8e0670aa0a4a"
format_stamp: "Formatted at 2026-08-05 22:47:04 on dist-test-slave-gjrz"
server_key: "7e97b73775372b3a3ddbc7207d6e5daa"
server_key_iv: "f5d401994261100bca3989260ed240d4"
server_key_version: "encryptionkey@0"
I20260805 22:47:04.938584 16103 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260805 22:47:04.939390 16128 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:04.939544 16103 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:47:04.939647 16103 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/minicluster-data/ts-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/minicluster-data/ts-0/wal
uuid: "67a56301a3994b23999b8e0670aa0a4a"
format_stamp: "Formatted at 2026-08-05 22:47:04 on dist-test-slave-gjrz"
server_key: "7e97b73775372b3a3ddbc7207d6e5daa"
server_key_iv: "f5d401994261100bca3989260ed240d4"
server_key_version: "encryptionkey@0"
I20260805 22:47:04.939720 16103 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:04.961189 16103 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:04.963210 16103 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:04.963457 16103 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:04.963692 16103 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:47:04.964032 16103 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:47:04.964069 16103 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:04.964098 16103 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:47:04.964121 16103 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:04.970573 16103 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.129:33807
I20260805 22:47:04.970647 16283 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.129:33807 every 8 connection(s)
I20260805 22:47:04.970969 16103 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
Aug 05 22:47:04 dist-test-slave-gjrz krb5kdc[15957](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970024, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.129@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:47:04.979171 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 16103
I20260805 22:47:04.979296 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/minicluster-data/ts-0/wal/instance
I20260805 22:47:04.979489 15234 external_mini_cluster.cc:1428] Setting key 54bd9d1d5f1d011017f1ed0a57447780
I20260805 22:47:04.980755 16079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:04.971761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.129:38493 (local address 127.14.224.190:41695)
0805 22:47:04.971825 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:04.971827 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:04.972017 (+ 190us) server_negotiation.cc:407] Connection header received
0805 22:47:04.973119 (+ 1102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:04.973121 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:04.973138 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:04.973191 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:04.973844 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:04.974359 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:04.975446 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:04.975665 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:04.975725 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:04.977969 (+ 2244us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:04.977971 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:04.977971 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:04.977979 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:04.979149 (+ 1170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:04.979779 (+ 630us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:04.979780 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:04.979780 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:04.979841 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:04.980106 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:04.980107 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:04.980107 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:04.980228 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:04.980287 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:04.980566 (+ 279us) server_negotiation.cc:299] Negotiation successful
0805 22:47:04.980663 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260805 22:47:04.980935 16287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:04.971717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:41695 (local address 127.14.224.129:38493)
0805 22:47:04.971896 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:04.971934 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:04.972996 (+ 1062us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:04.973263 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:04.973267 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:04.973546 (+ 279us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:04.973743 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:04.973748 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:04.974465 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:04.974466 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:04.975360 (+ 894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:04.975364 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:04.975743 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:04.975744 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:04.975869 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:04.976360 (+ 491us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:04.976368 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:04.977864 (+ 1496us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:04.979238 (+ 1374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:04.979248 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:04.979251 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:04.979622 (+ 371us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:04.979913 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:04.979914 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:04.979914 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:04.980042 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:04.980287 (+ 245us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:04.980295 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:04.980437 (+ 142us) client_negotiation.cc:769] Sending connection context
0805 22:47:04.980538 (+ 101us) client_negotiation.cc:240] Negotiation successful
0805 22:47:04.980705 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":92,"threads_started":1}
I20260805 22:47:04.981398 16284 heartbeater.cc:347] Connected to a master server at 127.14.224.190:41695
I20260805 22:47:04.981498 16284 heartbeater.cc:464] Registering TS with master...
I20260805 22:47:04.981683 16284 heartbeater.cc:511] Master 127.14.224.190:41695 requested a full tablet report, sending...
I20260805 22:47:04.982244 16016 ts_manager.cc:194] Registered new tserver with Master: 67a56301a3994b23999b8e0670aa0a4a (127.14.224.129:33807)
I20260805 22:47:04.982852 16016 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.224.129@KRBTEST.COM'} at 127.14.224.129:38493
WARNING: no policy specified for kudu/127.14.224.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab.
Entry for principal kudu/127.14.224.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab.
I20260805 22:47:05.006847 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.130:0
--local_ip_for_outbound_sockets=127.14.224.130
--webserver_interface=127.14.224.130
--webserver_port=0
--tserver_master_addrs=127.14.224.190:41695
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab
--principal=kudu/127.14.224.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:38625
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:47:05.090400 16290 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:05.090646 16290 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:05.090673 16290 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:05.092092 16290 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:05.092151 16290 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:05.092182 16290 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.130
I20260805 22:47:05.093832 16290 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:38625
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab
--principal=kudu/127.14.224.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.224.130
--webserver_port=0
--tserver_master_addrs=127.14.224.190:41695
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16290
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.130
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:05.094103 16290 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:05.094349 16290 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:05.099550 16301 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:05.099601 16303 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:05.099555 16300 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:05.099656 16290 server_base.cc:1034] running on GCE node
I20260805 22:47:05.100024 16290 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:05.100312 16290 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:05.101470 16290 hybrid_clock.cc:648] HybridClock initialized: now 1785970025101461 us; error 32 us; skew 500 ppm
Aug 05 22:47:05 dist-test-slave-gjrz krb5kdc[15957](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970025, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:05.104193 16290 init.cc:377] Logged in from keytab as kudu/127.14.224.130@KRBTEST.COM (short username kudu)
I20260805 22:47:05.104699 16290 webserver.cc:460] Webserver started at http://127.14.224.130:35919/ using document root <none> and password file <none>
I20260805 22:47:05.104947 16290 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:05.105000 16290 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:05.105144 16290 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:05.106274 16290 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/minicluster-data/ts-1/data/instance:
uuid: "8a2d353f16324561a281e0bb362971f0"
format_stamp: "Formatted at 2026-08-05 22:47:05 on dist-test-slave-gjrz"
server_key: "a7cd6eb3bccc4a85f0544733dff6e0e2"
server_key_iv: "c1786348ce35ee304323d58d702e93e0"
server_key_version: "encryptionkey@0"
I20260805 22:47:05.106606 16290 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/minicluster-data/ts-1/wal/instance:
uuid: "8a2d353f16324561a281e0bb362971f0"
format_stamp: "Formatted at 2026-08-05 22:47:05 on dist-test-slave-gjrz"
server_key: "a7cd6eb3bccc4a85f0544733dff6e0e2"
server_key_iv: "c1786348ce35ee304323d58d702e93e0"
server_key_version: "encryptionkey@0"
I20260805 22:47:05.108273 16290 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260805 22:47:05.109014 16310 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:05.109202 16290 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:47:05.109301 16290 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/minicluster-data/ts-1/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/minicluster-data/ts-1/wal
uuid: "8a2d353f16324561a281e0bb362971f0"
format_stamp: "Formatted at 2026-08-05 22:47:05 on dist-test-slave-gjrz"
server_key: "a7cd6eb3bccc4a85f0544733dff6e0e2"
server_key_iv: "c1786348ce35ee304323d58d702e93e0"
server_key_version: "encryptionkey@0"
I20260805 22:47:05.109366 16290 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:05.121603 16290 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:05.124316 16290 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:05.124495 16290 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:05.124739 16290 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:47:05.125099 16290 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:47:05.125137 16290 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:05.125168 16290 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:47:05.125193 16290 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:05.131763 16290 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.130:45109
I20260805 22:47:05.131817 16462 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.130:45109 every 8 connection(s)
I20260805 22:47:05.132177 16290 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
I20260805 22:47:05.132817 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 16290
I20260805 22:47:05.132897 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/minicluster-data/ts-1/wal/instance
I20260805 22:47:05.133083 15234 external_mini_cluster.cc:1428] Setting key 8de7449996e660afda7e6d19f5dccac8
Aug 05 22:47:05 dist-test-slave-gjrz krb5kdc[15957](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970025, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.130@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.14.224.131@KRBTEST.COM; defaulting to no policy
I20260805 22:47:05.143164 16079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:05.132997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:42517 (local address 127.14.224.190:41695)
0805 22:47:05.133067 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:05.133070 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:05.133302 (+ 232us) server_negotiation.cc:407] Connection header received
0805 22:47:05.134402 (+ 1100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:05.134403 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:05.134414 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:05.134449 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:05.135381 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:05.136151 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:05.137334 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:05.137531 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:05.137600 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:05.140093 (+ 2493us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:05.140095 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:05.140096 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:05.140106 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:05.141660 (+ 1554us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:05.142125 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:05.142126 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:05.142127 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:05.142185 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:05.142417 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:05.142418 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:05.142419 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:05.142595 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:05.142657 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:05.142957 (+ 300us) server_negotiation.cc:299] Negotiation successful
0805 22:47:05.143057 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260805 22:47:05.143356 16465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:05.132929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:41695 (local address 127.14.224.130:42517)
0805 22:47:05.133148 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:05.133203 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:05.134281 (+ 1078us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:05.134548 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:05.134552 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:05.134917 (+ 365us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:05.135218 (+ 301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:05.135225 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:05.136314 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:05.136315 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:05.137258 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:05.137262 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:05.137624 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:05.137626 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:05.137760 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:05.138294 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:05.138303 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:05.139965 (+ 1662us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:05.141770 (+ 1805us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:05.141780 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:05.141782 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:05.142043 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:05.142246 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:05.142247 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:05.142247 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:05.142356 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:05.142657 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:05.142665 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:05.142826 (+ 161us) client_negotiation.cc:769] Sending connection context
0805 22:47:05.142923 (+ 97us) client_negotiation.cc:240] Negotiation successful
0805 22:47:05.143096 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":92,"threads_started":1}
I20260805 22:47:05.143865 16463 heartbeater.cc:347] Connected to a master server at 127.14.224.190:41695
I20260805 22:47:05.144014 16463 heartbeater.cc:464] Registering TS with master...
I20260805 22:47:05.144243 16463 heartbeater.cc:511] Master 127.14.224.190:41695 requested a full tablet report, sending...
I20260805 22:47:05.144685 16016 ts_manager.cc:194] Registered new tserver with Master: 8a2d353f16324561a281e0bb362971f0 (127.14.224.130:45109)
I20260805 22:47:05.145061 16016 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.224.130@KRBTEST.COM'} at 127.14.224.130:42517
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab.
Entry for principal kudu/127.14.224.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab.
I20260805 22:47:05.161423 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.131:0
--local_ip_for_outbound_sockets=127.14.224.131
--webserver_interface=127.14.224.131
--webserver_port=0
--tserver_master_addrs=127.14.224.190:41695
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab
--principal=kudu/127.14.224.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:38625
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:47:05.246294 16468 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:05.246515 16468 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:05.246542 16468 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:05.247795 16468 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:05.247843 16468 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:05.247871 16468 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.131
I20260805 22:47:05.249462 16468 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:38625
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab
--principal=kudu/127.14.224.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.224.131
--webserver_port=0
--tserver_master_addrs=127.14.224.190:41695
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16468
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.131
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:05.249722 16468 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:05.249963 16468 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:05.254891 16473 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:05.254963 16468 server_base.cc:1034] running on GCE node
W20260805 22:47:05.254885 16474 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:05.254889 16482 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:05.255363 16468 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:05.255630 16468 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:05.256785 16468 hybrid_clock.cc:648] HybridClock initialized: now 1785970025256766 us; error 35 us; skew 500 ppm
Aug 05 22:47:05 dist-test-slave-gjrz krb5kdc[15957](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970025, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:05.259513 16468 init.cc:377] Logged in from keytab as kudu/127.14.224.131@KRBTEST.COM (short username kudu)
I20260805 22:47:05.259951 16468 webserver.cc:460] Webserver started at http://127.14.224.131:34309/ using document root <none> and password file <none>
I20260805 22:47:05.260169 16468 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:05.260213 16468 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:05.260337 16468 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:05.261380 16468 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/minicluster-data/ts-2/data/instance:
uuid: "1545b6397c6e4cdd9e1b5f9a0c664f79"
format_stamp: "Formatted at 2026-08-05 22:47:05 on dist-test-slave-gjrz"
server_key: "57c8dfe5db9ec4b092ba49af35983bcd"
server_key_iv: "44de3b841e6a100c522818d88cb48b2f"
server_key_version: "encryptionkey@0"
I20260805 22:47:05.261718 16468 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/minicluster-data/ts-2/wal/instance:
uuid: "1545b6397c6e4cdd9e1b5f9a0c664f79"
format_stamp: "Formatted at 2026-08-05 22:47:05 on dist-test-slave-gjrz"
server_key: "57c8dfe5db9ec4b092ba49af35983bcd"
server_key_iv: "44de3b841e6a100c522818d88cb48b2f"
server_key_version: "encryptionkey@0"
I20260805 22:47:05.263029 16468 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260805 22:47:05.263772 16493 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:05.263963 16468 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:05.264055 16468 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/minicluster-data/ts-2/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/minicluster-data/ts-2/wal
uuid: "1545b6397c6e4cdd9e1b5f9a0c664f79"
format_stamp: "Formatted at 2026-08-05 22:47:05 on dist-test-slave-gjrz"
server_key: "57c8dfe5db9ec4b092ba49af35983bcd"
server_key_iv: "44de3b841e6a100c522818d88cb48b2f"
server_key_version: "encryptionkey@0"
I20260805 22:47:05.264115 16468 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:05.282016 16468 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:05.284075 16468 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:05.284193 16468 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:05.284395 16468 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:47:05.284680 16468 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:47:05.284721 16468 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:05.284744 16468 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:47:05.284755 16468 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:05.290510 16468 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.131:44317
I20260805 22:47:05.290556 16652 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.131:44317 every 8 connection(s)
I20260805 22:47:05.290889 16468 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
Aug 05 22:47:05 dist-test-slave-gjrz krb5kdc[15957](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970025, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.131@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:47:05.297596 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 16468
I20260805 22:47:05.297684 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970021300824-15234-0/minicluster-data/ts-2/wal/instance
I20260805 22:47:05.297832 15234 external_mini_cluster.cc:1428] Setting key 7de2f5cff1b4ee9ab89063851fb211e7
I20260805 22:47:05.300514 16079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:05.291669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:36033 (local address 127.14.224.190:41695)
0805 22:47:05.291764 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:05.291767 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:05.291982 (+ 215us) server_negotiation.cc:407] Connection header received
0805 22:47:05.292935 (+ 953us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:05.292937 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:05.292950 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:05.293006 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:05.293657 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:05.294162 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:05.295172 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:05.295436 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:05.295492 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:05.297662 (+ 2170us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:05.297665 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:05.297665 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:05.297674 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:05.299192 (+ 1518us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:05.299598 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:05.299600 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:05.299600 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:05.299661 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:05.299882 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:05.299883 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:05.299883 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:05.300008 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:05.300066 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:05.300327 (+ 261us) server_negotiation.cc:299] Negotiation successful
0805 22:47:05.300422 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260805 22:47:05.300684 16656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:05.291633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:41695 (local address 127.14.224.131:36033)
0805 22:47:05.291834 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:05.291898 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:05.292820 (+ 922us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:05.293078 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:05.293082 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:05.293355 (+ 273us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:05.293560 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:05.293564 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:05.294255 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:05.294256 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:05.295083 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:05.295086 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:05.295521 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:05.295522 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:05.295642 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:05.296150 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:05.296159 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:05.297564 (+ 1405us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:05.299291 (+ 1727us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:05.299299 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:05.299301 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:05.299527 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:05.299716 (+ 189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:05.299717 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:05.299717 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:05.299823 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:05.300063 (+ 240us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:05.300070 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:05.300203 (+ 133us) client_negotiation.cc:769] Sending connection context
0805 22:47:05.300296 (+ 93us) client_negotiation.cc:240] Negotiation successful
0805 22:47:05.300462 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":85,"threads_started":1}
I20260805 22:47:05.301100 16653 heartbeater.cc:347] Connected to a master server at 127.14.224.190:41695
I20260805 22:47:05.301190 16653 heartbeater.cc:464] Registering TS with master...
I20260805 22:47:05.301343 16653 heartbeater.cc:511] Master 127.14.224.190:41695 requested a full tablet report, sending...
I20260805 22:47:05.301687 16016 ts_manager.cc:194] Registered new tserver with Master: 1545b6397c6e4cdd9e1b5f9a0c664f79 (127.14.224.131:44317)
I20260805 22:47:05.302037 16016 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.224.131@KRBTEST.COM'} at 127.14.224.131:36033
I20260805 22:47:05.309566 15234 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 22:47:05.317247 16079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:05.311151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50206 (local address 127.14.224.190:41695)
0805 22:47:05.311211 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:05.311212 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:05.311287 (+ 75us) server_negotiation.cc:407] Connection header received
0805 22:47:05.311347 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:05.311348 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:05.311357 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:05.311404 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:05.311931 (+ 527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:05.312465 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:05.313223 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:05.313453 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:05.313518 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:05.314735 (+ 1217us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:05.314737 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:05.314737 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:05.314744 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:05.316126 (+ 1382us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:05.316452 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:05.316452 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:05.316453 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:05.316506 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:05.316710 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:05.316712 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:05.316712 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:05.316893 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:05.316982 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:05.317105 (+ 123us) server_negotiation.cc:299] Negotiation successful
0805 22:47:05.317175 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260805 22:47:05.319885 16016 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50206:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:47:05.321576 16016 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:47:05.328696 16677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:05.324628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33050 (local address 127.14.224.130:45109)
0805 22:47:05.324838 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:05.324843 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:05.324853 (+ 10us) server_negotiation.cc:407] Connection header received
0805 22:47:05.324888 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:05.324890 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:05.324903 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:05.324984 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:47:05.325128 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:05.326251 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:05.327505 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:05.328287 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:05.328369 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:05.328432 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:05.328592 (+ 160us) server_negotiation.cc:299] Negotiation successful
0805 22:47:05.328629 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":179,"thread_start_us":97,"threads_started":1}
I20260805 22:47:05.328716 16674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:05.324222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.130:45109 (local address 127.0.0.1:33050)
0805 22:47:05.324398 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:05.324409 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:05.324458 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:05.324994 (+ 536us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:05.324995 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:05.324997 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:47:05.325050 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:05.325052 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:05.326355 (+ 1303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:05.326356 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:05.327418 (+ 1062us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:05.327420 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:05.328371 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:05.328372 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:05.328472 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:05.328489 (+ 17us) client_negotiation.cc:769] Sending connection context
0805 22:47:05.328559 (+ 70us) client_negotiation.cc:240] Negotiation successful
0805 22:47:05.328611 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":93,"threads_started":1}
I20260805 22:47:05.329147 16676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:05.324407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.131:44317 (local address 127.0.0.1:59804)
0805 22:47:05.324712 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:05.324722 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:05.324765 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:05.325077 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:05.325078 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:05.325080 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:47:05.325120 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:05.325121 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:05.326074 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:05.326075 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:05.327398 (+ 1323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:05.327402 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:05.328928 (+ 1526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:05.328929 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:05.328990 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:05.328995 (+ 5us) client_negotiation.cc:769] Sending connection context
0805 22:47:05.329038 (+ 43us) client_negotiation.cc:240] Negotiation successful
0805 22:47:05.329081 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":64,"threads_started":1}
I20260805 22:47:05.329277 16669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:05.324006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.129:33807 (local address 127.0.0.1:33652)
0805 22:47:05.324228 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:05.324274 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:05.324400 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:05.324883 (+ 483us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:05.324886 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:05.324889 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:47:05.324984 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:05.324986 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:05.327324 (+ 2338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:05.327326 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:05.328119 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:05.328123 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:05.329076 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:05.329077 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:05.329133 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:05.329136 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:47:05.329187 (+ 51us) client_negotiation.cc:240] Negotiation successful
0805 22:47:05.329223 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":50,"threads_started":1}
I20260805 22:47:05.329470 16678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:05.324701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59804 (local address 127.14.224.131:44317)
0805 22:47:05.324876 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:05.324880 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:05.324888 (+ 8us) server_negotiation.cc:407] Connection header received
0805 22:47:05.324918 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:05.324919 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:05.324931 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:05.324995 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:47:05.325172 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:05.325976 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:05.327505 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:05.328287 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:05.328369 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:05.328432 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:05.329296 (+ 864us) server_negotiation.cc:299] Negotiation successful
0805 22:47:05.329401 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":98,"threads_started":1}
I20260805 22:47:05.329489 16675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:05.324245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33652 (local address 127.14.224.129:33807)
0805 22:47:05.324454 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:05.324460 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:05.324471 (+ 11us) server_negotiation.cc:407] Connection header received
0805 22:47:05.324520 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:05.324522 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:05.324538 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:05.324644 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:47:05.325086 (+ 442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:05.326251 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:05.328210 (+ 1959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:05.328924 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:05.328991 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:05.329045 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:05.329220 (+ 175us) server_negotiation.cc:299] Negotiation successful
0805 22:47:05.329413 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":85,"threads_started":1}
I20260805 22:47:05.329550 16375 tablet_service.cc:1467] Processing CreateTablet for tablet ba1dc9d85ef8467f9de93f97518a0299 (DEFAULT_TABLE table=test-table [id=a9e3ecd3e9a1430c9617b0ea42c3f1ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:47:05.329926 16375 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba1dc9d85ef8467f9de93f97518a0299. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:05.330127 16566 tablet_service.cc:1467] Processing CreateTablet for tablet ba1dc9d85ef8467f9de93f97518a0299 (DEFAULT_TABLE table=test-table [id=a9e3ecd3e9a1430c9617b0ea42c3f1ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:47:05.330427 16566 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba1dc9d85ef8467f9de93f97518a0299. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:05.332018 16200 tablet_service.cc:1467] Processing CreateTablet for tablet ba1dc9d85ef8467f9de93f97518a0299 (DEFAULT_TABLE table=test-table [id=a9e3ecd3e9a1430c9617b0ea42c3f1ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:47:05.332377 16200 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba1dc9d85ef8467f9de93f97518a0299. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:05.333175 16679 tablet_bootstrap.cc:492] T ba1dc9d85ef8467f9de93f97518a0299 P 8a2d353f16324561a281e0bb362971f0: Bootstrap starting.
I20260805 22:47:05.333828 16679 tablet_bootstrap.cc:654] T ba1dc9d85ef8467f9de93f97518a0299 P 8a2d353f16324561a281e0bb362971f0: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:05.334434 16679 log.cc:824] T ba1dc9d85ef8467f9de93f97518a0299 P 8a2d353f16324561a281e0bb362971f0: Log is configured to *not* fsync() on all Append() calls
I20260805 22:47:05.335172 16679 tablet_bootstrap.cc:492] T ba1dc9d85ef8467f9de93f97518a0299 P 8a2d353f16324561a281e0bb362971f0: No bootstrap required, opened a new log
I20260805 22:47:05.335178 16682 tablet_bootstrap.cc:492] T ba1dc9d85ef8467f9de93f97518a0299 P 67a56301a3994b23999b8e0670aa0a4a: Bootstrap starting.
I20260805 22:47:05.335246 16679 ts_tablet_manager.cc:1397] T ba1dc9d85ef8467f9de93f97518a0299 P 8a2d353f16324561a281e0bb362971f0: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260805 22:47:05.335556 16680 tablet_bootstrap.cc:492] T ba1dc9d85ef8467f9de93f97518a0299 P 1545b6397c6e4cdd9e1b5f9a0c664f79: Bootstrap starting.
I20260805 22:47:05.335889 16682 tablet_bootstrap.cc:654] T ba1dc9d85ef8467f9de93f97518a0299 P 67a56301a3994b23999b8e0670aa0a4a: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:05.336400 16680 tablet_bootstrap.cc:654] T ba1dc9d85ef8467f9de93f97518a0299 P 1545b6397c6e4cdd9e1b5f9a0c664f79: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:05.336587 16682 log.cc:824] T ba1dc9d85ef8467f9de93f97518a0299 P 67a56301a3994b23999b8e0670aa0a4a: Log is configured to *not* fsync() on all Append() calls
I20260805 22:47:05.336944 16680 log.cc:824] T ba1dc9d85ef8467f9de93f97518a0299 P 1545b6397c6e4cdd9e1b5f9a0c664f79: Log is configured to *not* fsync() on all Append() calls
I20260805 22:47:05.337216 16679 raft_consensus.cc:348] T ba1dc9d85ef8467f9de93f97518a0299 P 8a2d353f16324561a281e0bb362971f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67a56301a3994b23999b8e0670aa0a4a" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 33807 } } peers { permanent_uuid: "8a2d353f16324561a281e0bb362971f0" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 45109 } } peers { permanent_uuid: "1545b6397c6e4cdd9e1b5f9a0c664f79" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 44317 } }
I20260805 22:47:05.337387 16682 tablet_bootstrap.cc:492] T ba1dc9d85ef8467f9de93f97518a0299 P 67a56301a3994b23999b8e0670aa0a4a: No bootstrap required, opened a new log
I20260805 22:47:05.337420 16679 raft_consensus.cc:374] T ba1dc9d85ef8467f9de93f97518a0299 P 8a2d353f16324561a281e0bb362971f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:05.337441 16682 ts_tablet_manager.cc:1397] T ba1dc9d85ef8467f9de93f97518a0299 P 67a56301a3994b23999b8e0670aa0a4a: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260805 22:47:05.337467 16679 raft_consensus.cc:729] T ba1dc9d85ef8467f9de93f97518a0299 P 8a2d353f16324561a281e0bb362971f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a2d353f16324561a281e0bb362971f0, State: Initialized, Role: FOLLOWER
I20260805 22:47:05.337612 16679 consensus_queue.cc:260] T ba1dc9d85ef8467f9de93f97518a0299 P 8a2d353f16324561a281e0bb362971f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67a56301a3994b23999b8e0670aa0a4a" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 33807 } } peers { permanent_uuid: "8a2d353f16324561a281e0bb362971f0" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 45109 } } peers { permanent_uuid: "1545b6397c6e4cdd9e1b5f9a0c664f79" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 44317 } }
I20260805 22:47:05.337857 16680 tablet_bootstrap.cc:492] T ba1dc9d85ef8467f9de93f97518a0299 P 1545b6397c6e4cdd9e1b5f9a0c664f79: No bootstrap required, opened a new log
I20260805 22:47:05.337921 16679 ts_tablet_manager.cc:1428] T ba1dc9d85ef8467f9de93f97518a0299 P 8a2d353f16324561a281e0bb362971f0: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260805 22:47:05.337929 16680 ts_tablet_manager.cc:1397] T ba1dc9d85ef8467f9de93f97518a0299 P 1545b6397c6e4cdd9e1b5f9a0c664f79: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260805 22:47:05.338073 16463 heartbeater.cc:503] Master 127.14.224.190:41695 was elected leader, sending a full tablet report...
I20260805 22:47:05.339290 16682 raft_consensus.cc:348] T ba1dc9d85ef8467f9de93f97518a0299 P 67a56301a3994b23999b8e0670aa0a4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67a56301a3994b23999b8e0670aa0a4a" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 33807 } } peers { permanent_uuid: "8a2d353f16324561a281e0bb362971f0" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 45109 } } peers { permanent_uuid: "1545b6397c6e4cdd9e1b5f9a0c664f79" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 44317 } }
I20260805 22:47:05.339468 16682 raft_consensus.cc:374] T ba1dc9d85ef8467f9de93f97518a0299 P 67a56301a3994b23999b8e0670aa0a4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:05.339506 16682 raft_consensus.cc:729] T ba1dc9d85ef8467f9de93f97518a0299 P 67a56301a3994b23999b8e0670aa0a4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67a56301a3994b23999b8e0670aa0a4a, State: Initialized, Role: FOLLOWER
I20260805 22:47:05.339674 16682 consensus_queue.cc:260] T ba1dc9d85ef8467f9de93f97518a0299 P 67a56301a3994b23999b8e0670aa0a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67a56301a3994b23999b8e0670aa0a4a" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 33807 } } peers { permanent_uuid: "8a2d353f16324561a281e0bb362971f0" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 45109 } } peers { permanent_uuid: "1545b6397c6e4cdd9e1b5f9a0c664f79" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 44317 } }
I20260805 22:47:05.339826 16680 raft_consensus.cc:348] T ba1dc9d85ef8467f9de93f97518a0299 P 1545b6397c6e4cdd9e1b5f9a0c664f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67a56301a3994b23999b8e0670aa0a4a" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 33807 } } peers { permanent_uuid: "8a2d353f16324561a281e0bb362971f0" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 45109 } } peers { permanent_uuid: "1545b6397c6e4cdd9e1b5f9a0c664f79" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 44317 } }
I20260805 22:47:05.339948 16284 heartbeater.cc:503] Master 127.14.224.190:41695 was elected leader, sending a full tablet report...
I20260805 22:47:05.339972 16680 raft_consensus.cc:374] T ba1dc9d85ef8467f9de93f97518a0299 P 1545b6397c6e4cdd9e1b5f9a0c664f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:05.339958 16682 ts_tablet_manager.cc:1428] T ba1dc9d85ef8467f9de93f97518a0299 P 67a56301a3994b23999b8e0670aa0a4a: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260805 22:47:05.339994 16680 raft_consensus.cc:729] T ba1dc9d85ef8467f9de93f97518a0299 P 1545b6397c6e4cdd9e1b5f9a0c664f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1545b6397c6e4cdd9e1b5f9a0c664f79, State: Initialized, Role: FOLLOWER
I20260805 22:47:05.340077 16680 consensus_queue.cc:260] T ba1dc9d85ef8467f9de93f97518a0299 P 1545b6397c6e4cdd9e1b5f9a0c664f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67a56301a3994b23999b8e0670aa0a4a" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 33807 } } peers { permanent_uuid: "8a2d353f16324561a281e0bb362971f0" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 45109 } } peers { permanent_uuid: "1545b6397c6e4cdd9e1b5f9a0c664f79" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 44317 } }
I20260805 22:47:05.340297 16680 ts_tablet_manager.cc:1428] T ba1dc9d85ef8467f9de93f97518a0299 P 1545b6397c6e4cdd9e1b5f9a0c664f79: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260805 22:47:05.340409 16653 heartbeater.cc:503] Master 127.14.224.190:41695 was elected leader, sending a full tablet report...
W20260805 22:47:05.382742 16464 tablet.cc:2369] T ba1dc9d85ef8467f9de93f97518a0299 P 8a2d353f16324561a281e0bb362971f0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:47:05.426040 16689 raft_consensus.cc:482] T ba1dc9d85ef8467f9de93f97518a0299 P 1545b6397c6e4cdd9e1b5f9a0c664f79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:47:05.426206 16689 raft_consensus.cc:504] T ba1dc9d85ef8467f9de93f97518a0299 P 1545b6397c6e4cdd9e1b5f9a0c664f79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67a56301a3994b23999b8e0670aa0a4a" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 33807 } } peers { permanent_uuid: "8a2d353f16324561a281e0bb362971f0" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 45109 } } peers { permanent_uuid: "1545b6397c6e4cdd9e1b5f9a0c664f79" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 44317 } }
I20260805 22:47:05.426529 16689 leader_election.cc:288] T ba1dc9d85ef8467f9de93f97518a0299 P 1545b6397c6e4cdd9e1b5f9a0c664f79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67a56301a3994b23999b8e0670aa0a4a (127.14.224.129:33807), 8a2d353f16324561a281e0bb362971f0 (127.14.224.130:45109)
I20260805 22:47:05.429375 16675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:05.426880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:45581 (local address 127.14.224.129:33807)
0805 22:47:05.426934 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:05.426936 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:05.426947 (+ 11us) server_negotiation.cc:407] Connection header received
0805 22:47:05.426981 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:05.426982 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:05.426991 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:05.427056 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:47:05.427246 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:05.427752 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:05.428675 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:05.429058 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:05.429121 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:05.429132 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:05.429269 (+ 137us) server_negotiation.cc:299] Negotiation successful
0805 22:47:05.429306 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260805 22:47:05.429375 16656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:05.426802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.129:33807 (local address 127.14.224.131:45581)
0805 22:47:05.426860 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:05.426872 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:05.426920 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:05.427077 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:05.427078 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:05.427080 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:47:05.427161 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:05.427164 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:05.427834 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:05.427835 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:05.428584 (+ 749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:05.428586 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:05.429135 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:05.429135 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:05.429205 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:05.429208 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:47:05.429253 (+ 45us) client_negotiation.cc:240] Negotiation successful
0805 22:47:05.429295 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260805 22:47:05.429620 16677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:05.427138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:44865 (local address 127.14.224.130:45109)
0805 22:47:05.427206 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:05.427208 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:05.427216 (+ 8us) server_negotiation.cc:407] Connection header received
0805 22:47:05.427289 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:05.427290 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:05.427299 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:05.427345 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:47:05.427493 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:05.427965 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:05.428896 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:05.429263 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:05.429326 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:05.429334 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:05.429511 (+ 177us) server_negotiation.cc:299] Negotiation successful
0805 22:47:05.429552 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260805 22:47:05.429759 16224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba1dc9d85ef8467f9de93f97518a0299" candidate_uuid: "1545b6397c6e4cdd9e1b5f9a0c664f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67a56301a3994b23999b8e0670aa0a4a" is_pre_election: true
I20260805 22:47:05.429827 16691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:05.426947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.130:45109 (local address 127.14.224.131:44865)
0805 22:47:05.427141 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:05.427151 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:05.427205 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:05.427355 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:05.427356 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:05.427358 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:47:05.427432 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:05.427433 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:05.428046 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:05.428047 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:05.428805 (+ 758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:05.428807 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:05.429342 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:05.429343 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:05.429420 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:05.429423 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:47:05.429705 (+ 282us) client_negotiation.cc:240] Negotiation successful
0805 22:47:05.429749 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":118,"threads_started":1}
I20260805 22:47:05.429936 16224 raft_consensus.cc:2454] T ba1dc9d85ef8467f9de93f97518a0299 P 67a56301a3994b23999b8e0670aa0a4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1545b6397c6e4cdd9e1b5f9a0c664f79 in term 0.
I20260805 22:47:05.430187 16497 leader_election.cc:302] T ba1dc9d85ef8467f9de93f97518a0299 P 1545b6397c6e4cdd9e1b5f9a0c664f79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1545b6397c6e4cdd9e1b5f9a0c664f79, 67a56301a3994b23999b8e0670aa0a4a; no voters:
I20260805 22:47:05.430181 16405 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba1dc9d85ef8467f9de93f97518a0299" candidate_uuid: "1545b6397c6e4cdd9e1b5f9a0c664f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a2d353f16324561a281e0bb362971f0" is_pre_election: true
I20260805 22:47:05.430308 16405 raft_consensus.cc:2454] T ba1dc9d85ef8467f9de93f97518a0299 P 8a2d353f16324561a281e0bb362971f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1545b6397c6e4cdd9e1b5f9a0c664f79 in term 0.
I20260805 22:47:05.430335 16689 raft_consensus.cc:2781] T ba1dc9d85ef8467f9de93f97518a0299 P 1545b6397c6e4cdd9e1b5f9a0c664f79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:47:05.430387 16689 raft_consensus.cc:482] T ba1dc9d85ef8467f9de93f97518a0299 P 1545b6397c6e4cdd9e1b5f9a0c664f79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:47:05.430425 16689 raft_consensus.cc:3037] T ba1dc9d85ef8467f9de93f97518a0299 P 1545b6397c6e4cdd9e1b5f9a0c664f79 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:05.431214 16689 raft_consensus.cc:504] T ba1dc9d85ef8467f9de93f97518a0299 P 1545b6397c6e4cdd9e1b5f9a0c664f79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67a56301a3994b23999b8e0670aa0a4a" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 33807 } } peers { permanent_uuid: "8a2d353f16324561a281e0bb362971f0" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 45109 } } peers { permanent_uuid: "1545b6397c6e4cdd9e1b5f9a0c664f79" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 44317 } }
I20260805 22:47:05.431378 16689 leader_election.cc:288] T ba1dc9d85ef8467f9de93f97518a0299 P 1545b6397c6e4cdd9e1b5f9a0c664f79 [CANDIDATE]: Term 1 election: Requested vote from peers 67a56301a3994b23999b8e0670aa0a4a (127.14.224.129:33807), 8a2d353f16324561a281e0bb362971f0 (127.14.224.130:45109)
I20260805 22:47:05.431562 16405 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba1dc9d85ef8467f9de93f97518a0299" candidate_uuid: "1545b6397c6e4cdd9e1b5f9a0c664f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a2d353f16324561a281e0bb362971f0"
I20260805 22:47:05.431550 16224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba1dc9d85ef8467f9de93f97518a0299" candidate_uuid: "1545b6397c6e4cdd9e1b5f9a0c664f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67a56301a3994b23999b8e0670aa0a4a"
I20260805 22:47:05.431650 16224 raft_consensus.cc:3037] T ba1dc9d85ef8467f9de93f97518a0299 P 67a56301a3994b23999b8e0670aa0a4a [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:05.431650 16405 raft_consensus.cc:3037] T ba1dc9d85ef8467f9de93f97518a0299 P 8a2d353f16324561a281e0bb362971f0 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:05.432579 16224 raft_consensus.cc:2454] T ba1dc9d85ef8467f9de93f97518a0299 P 67a56301a3994b23999b8e0670aa0a4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1545b6397c6e4cdd9e1b5f9a0c664f79 in term 1.
I20260805 22:47:05.432572 16405 raft_consensus.cc:2454] T ba1dc9d85ef8467f9de93f97518a0299 P 8a2d353f16324561a281e0bb362971f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1545b6397c6e4cdd9e1b5f9a0c664f79 in term 1.
I20260805 22:47:05.432747 16497 leader_election.cc:302] T ba1dc9d85ef8467f9de93f97518a0299 P 1545b6397c6e4cdd9e1b5f9a0c664f79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1545b6397c6e4cdd9e1b5f9a0c664f79, 67a56301a3994b23999b8e0670aa0a4a; no voters:
I20260805 22:47:05.432843 16689 raft_consensus.cc:2781] T ba1dc9d85ef8467f9de93f97518a0299 P 1545b6397c6e4cdd9e1b5f9a0c664f79 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:47:05.433001 16689 raft_consensus.cc:686] T ba1dc9d85ef8467f9de93f97518a0299 P 1545b6397c6e4cdd9e1b5f9a0c664f79 [term 1 LEADER]: Becoming Leader. State: Replica: 1545b6397c6e4cdd9e1b5f9a0c664f79, State: Running, Role: LEADER
I20260805 22:47:05.433108 16689 consensus_queue.cc:237] T ba1dc9d85ef8467f9de93f97518a0299 P 1545b6397c6e4cdd9e1b5f9a0c664f79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67a56301a3994b23999b8e0670aa0a4a" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 33807 } } peers { permanent_uuid: "8a2d353f16324561a281e0bb362971f0" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 45109 } } peers { permanent_uuid: "1545b6397c6e4cdd9e1b5f9a0c664f79" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 44317 } }
I20260805 22:47:05.434141 16015 catalog_manager.cc:5495] T ba1dc9d85ef8467f9de93f97518a0299 P 1545b6397c6e4cdd9e1b5f9a0c664f79 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1545b6397c6e4cdd9e1b5f9a0c664f79 (127.14.224.131). New cstate: current_term: 1 leader_uuid: "1545b6397c6e4cdd9e1b5f9a0c664f79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67a56301a3994b23999b8e0670aa0a4a" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 33807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a2d353f16324561a281e0bb362971f0" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 45109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1545b6397c6e4cdd9e1b5f9a0c664f79" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 44317 } health_report { overall_health: HEALTHY } } }
Aug 05 22:47:05 dist-test-slave-gjrz krb5kdc[15957](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970024, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.224.129@KRBTEST.COM
I20260805 22:47:05.451351 16675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:05.444304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33662 (local address 127.14.224.129:33807)
0805 22:47:05.444375 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:05.444377 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:05.444443 (+ 66us) server_negotiation.cc:407] Connection header received
0805 22:47:05.444519 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:05.444520 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:05.444531 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:05.444580 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:05.445135 (+ 555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:05.445617 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:05.446304 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:05.446495 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:05.446551 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:05.448918 (+ 2367us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:05.448932 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:05.448932 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:05.448940 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:05.450370 (+ 1430us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:05.450697 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:05.450700 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:05.450700 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:05.450755 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:05.450886 (+ 131us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:05.450886 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:05.450887 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:05.451017 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:05.451140 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:05.451168 (+ 28us) server_negotiation.cc:299] Negotiation successful
0805 22:47:05.451235 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
Aug 05 22:47:05 dist-test-slave-gjrz krb5kdc[15957](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970025, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
W20260805 22:47:05.471776 16285 tablet.cc:2369] T ba1dc9d85ef8467f9de93f97518a0299 P 67a56301a3994b23999b8e0670aa0a4a: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 05 22:47:05 dist-test-slave-gjrz krb5kdc[15957](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970025, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.14.224.129@KRBTEST.COM
I20260805 22:47:05.475835 16675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:05.468756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33666 (local address 127.14.224.129:33807)
0805 22:47:05.468819 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:05.468821 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:05.468862 (+ 41us) server_negotiation.cc:407] Connection header received
0805 22:47:05.468977 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:05.468978 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:05.468988 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:05.469034 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:05.469636 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:05.470154 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:05.470852 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:05.471070 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:05.471126 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:05.473413 (+ 2287us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:05.473415 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:05.473415 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:05.473424 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:05.474607 (+ 1183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:05.474970 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:05.474971 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:05.474971 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:05.475051 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:05.475225 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:05.475226 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:05.475226 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:05.475372 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:05.475469 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:05.475654 (+ 185us) server_negotiation.cc:299] Negotiation successful
0805 22:47:05.475741 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
Aug 05 22:47:05 dist-test-slave-gjrz krb5kdc[15957](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970025, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 05 22:47:05 dist-test-slave-gjrz krb5kdc[15957](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970025, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.224.129@KRBTEST.COM
I20260805 22:47:05.501343 16675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:05.493291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33680 (local address 127.14.224.129:33807)
0805 22:47:05.493342 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:05.493344 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:05.493499 (+ 155us) server_negotiation.cc:407] Connection header received
0805 22:47:05.493587 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:05.493588 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:05.493597 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:05.493668 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:05.494453 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:05.495088 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:05.496091 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:05.496412 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:05.496478 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:05.498884 (+ 2406us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:05.498887 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:05.498887 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:05.498898 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:05.500272 (+ 1374us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:05.500606 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:05.500607 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:05.500608 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:05.500669 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:05.500840 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:05.500841 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:05.500841 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:05.500951 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:05.501040 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:05.501165 (+ 125us) server_negotiation.cc:299] Negotiation successful
0805 22:47:05.501246 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
W20260805 22:47:05.501854 16164 tablet_service.cc:2908] Rejecting scan request for tablet ba1dc9d85ef8467f9de93f97518a0299: Uninitialized: clean time has not yet been initialized
I20260805 22:47:05.502717 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 16103
I20260805 22:47:05.516528 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 16290
I20260805 22:47:05.530681 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 16468
I20260805 22:47:05.545432 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 15973
2026-08-05T22:47:05Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2201 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:47:05 dist-test-slave-gjrz krb5kdc[16715](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:47:05 dist-test-slave-gjrz krb5kdc[16715](info): set up 2 sockets
Aug 05 22:47:05 dist-test-slave-gjrz krb5kdc[16715](info): commencing operation
krb5kdc: starting...
W20260805 22:47:06.692090 15234 mini_kdc.cc:121] Time spent starting KDC: real 1.119s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Aug 05 22:47:06 dist-test-slave-gjrz krb5kdc[16715](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970026, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:47:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:47:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.224.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab.
Entry for principal kudu/127.14.224.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab.
I20260805 22:47:06.820323 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:41369
--webserver_interface=127.14.224.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:44083
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.224.190:41369
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:47:06.904392 16734 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:06.904639 16734 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:06.904664 16734 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:06.905854 16734 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:47:06.905903 16734 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260805 22:47:06.905915 16734 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:06.905926 16734 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:06.905937 16734 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:47:06.905948 16734 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:47:06.907537 16734 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:44083
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.224.190:41369
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:41369
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.224.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16734
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:06.907804 16734 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:06.908032 16734 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:06.913041 16745 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:06.913156 16734 server_base.cc:1034] running on GCE node
W20260805 22:47:06.913036 16741 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:06.913023 16742 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:06.913533 16734 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:06.913851 16734 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:06.915023 16734 hybrid_clock.cc:648] HybridClock initialized: now 1785970026915002 us; error 37 us; skew 500 ppm
Aug 05 22:47:06 dist-test-slave-gjrz krb5kdc[16715](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970026, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:06.921790 16734 init.cc:377] Logged in from keytab as kudu/127.14.224.190@KRBTEST.COM (short username kudu)
I20260805 22:47:06.922408 16734 webserver.cc:460] Webserver started at http://127.14.224.190:41899/ using document root <none> and password file <none>
I20260805 22:47:06.922673 16734 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:06.922729 16734 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:06.922868 16734 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:06.924036 16734 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/master-0/data/instance:
uuid: "3787ee696aba431796bfff99173b09ef"
format_stamp: "Formatted at 2026-08-05 22:47:06 on dist-test-slave-gjrz"
server_key: "028c6775360e53f33db7ddcd61e46964"
server_key_iv: "a7d3609288095744e0c4db73e6334f93"
server_key_version: "encryptionkey@0"
I20260805 22:47:06.924399 16734 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/master-0/wal/instance:
uuid: "3787ee696aba431796bfff99173b09ef"
format_stamp: "Formatted at 2026-08-05 22:47:06 on dist-test-slave-gjrz"
server_key: "028c6775360e53f33db7ddcd61e46964"
server_key_iv: "a7d3609288095744e0c4db73e6334f93"
server_key_version: "encryptionkey@0"
I20260805 22:47:06.925776 16734 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260805 22:47:06.926589 16759 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:06.926755 16734 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:47:06.926848 16734 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/master-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/master-0/wal
uuid: "3787ee696aba431796bfff99173b09ef"
format_stamp: "Formatted at 2026-08-05 22:47:06 on dist-test-slave-gjrz"
server_key: "028c6775360e53f33db7ddcd61e46964"
server_key_iv: "a7d3609288095744e0c4db73e6334f93"
server_key_version: "encryptionkey@0"
I20260805 22:47:06.926910 16734 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:06.939860 16734 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:06.941864 16734 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:06.942008 16734 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:06.946905 16734 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.190:41369
I20260805 22:47:06.946990 16849 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.190:41369 every 8 connection(s)
I20260805 22:47:06.947343 16734 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
I20260805 22:47:06.948050 16851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:06.950398 16851 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3787ee696aba431796bfff99173b09ef: Bootstrap starting.
I20260805 22:47:06.950996 16851 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3787ee696aba431796bfff99173b09ef: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:06.951294 16851 log.cc:824] T 00000000000000000000000000000000 P 3787ee696aba431796bfff99173b09ef: Log is configured to *not* fsync() on all Append() calls
I20260805 22:47:06.952050 16851 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3787ee696aba431796bfff99173b09ef: No bootstrap required, opened a new log
I20260805 22:47:06.954330 16851 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3787ee696aba431796bfff99173b09ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3787ee696aba431796bfff99173b09ef" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 41369 } }
I20260805 22:47:06.954490 16851 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3787ee696aba431796bfff99173b09ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:06.954512 16851 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3787ee696aba431796bfff99173b09ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3787ee696aba431796bfff99173b09ef, State: Initialized, Role: FOLLOWER
I20260805 22:47:06.954661 16851 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3787ee696aba431796bfff99173b09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3787ee696aba431796bfff99173b09ef" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 41369 } }
I20260805 22:47:06.954736 16851 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3787ee696aba431796bfff99173b09ef [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:47:06.954761 16851 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3787ee696aba431796bfff99173b09ef [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:47:06.954809 16851 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3787ee696aba431796bfff99173b09ef [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:06.955456 16851 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3787ee696aba431796bfff99173b09ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3787ee696aba431796bfff99173b09ef" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 41369 } }
I20260805 22:47:06.955555 16851 leader_election.cc:302] T 00000000000000000000000000000000 P 3787ee696aba431796bfff99173b09ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3787ee696aba431796bfff99173b09ef; no voters:
I20260805 22:47:06.955746 16851 leader_election.cc:288] T 00000000000000000000000000000000 P 3787ee696aba431796bfff99173b09ef [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:47:06.955797 16857 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3787ee696aba431796bfff99173b09ef [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:47:06.955991 16857 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3787ee696aba431796bfff99173b09ef [term 1 LEADER]: Becoming Leader. State: Replica: 3787ee696aba431796bfff99173b09ef, State: Running, Role: LEADER
I20260805 22:47:06.956017 16851 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3787ee696aba431796bfff99173b09ef [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:47:06.956095 16857 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3787ee696aba431796bfff99173b09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3787ee696aba431796bfff99173b09ef" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 41369 } }
I20260805 22:47:06.956445 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 16734
I20260805 22:47:06.956550 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/master-0/wal/instance
I20260805 22:47:06.956521 16858 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3787ee696aba431796bfff99173b09ef [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3787ee696aba431796bfff99173b09ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3787ee696aba431796bfff99173b09ef" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 41369 } } }
I20260805 22:47:06.956606 16858 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3787ee696aba431796bfff99173b09ef [sys.catalog]: This master's current role is: LEADER
I20260805 22:47:06.956717 15234 external_mini_cluster.cc:1428] Setting key 28a64d5f1c2479d9179df7e74bce434e
I20260805 22:47:06.956777 16860 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3787ee696aba431796bfff99173b09ef [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3787ee696aba431796bfff99173b09ef. Latest consensus state: current_term: 1 leader_uuid: "3787ee696aba431796bfff99173b09ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3787ee696aba431796bfff99173b09ef" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 41369 } } }
I20260805 22:47:06.956846 16860 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3787ee696aba431796bfff99173b09ef [sys.catalog]: This master's current role is: LEADER
I20260805 22:47:06.957013 16868 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:47:06.957754 16868 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:47:06.959425 16868 catalog_manager.cc:1347] Generated new cluster ID: 4636bc3a2d354a76b8b0198c94461a60
I20260805 22:47:06.959476 16868 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 05 22:47:06 dist-test-slave-gjrz krb5kdc[16715](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970026, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:47:06.968942 16883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:06.957360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54344 (local address 127.14.224.190:41369)
0805 22:47:06.957698 (+ 338us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:06.957709 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:06.957744 (+ 35us) server_negotiation.cc:407] Connection header received
0805 22:47:06.957879 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:06.957938 (+ 59us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:06.958004 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:06.958149 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:06.958856 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:06.960201 (+ 1345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:06.961310 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:06.961930 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:06.962037 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:06.964952 (+ 2915us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:06.964957 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:06.964957 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:06.964980 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:06.967149 (+ 2169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:06.967584 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:06.967587 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:06.967588 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:06.967733 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:06.967917 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:06.967918 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:06.967918 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:06.968271 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:06.968424 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:06.968525 (+ 101us) server_negotiation.cc:299] Negotiation successful
0805 22:47:06.968685 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":286,"thread_start_us":68,"threads_started":1}
I20260805 22:47:06.975826 16868 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:47:06.976352 16868 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:47:06.979517 16868 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3787ee696aba431796bfff99173b09ef: Generated new TSK 0
I20260805 22:47:06.979687 16868 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.224.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab.
Entry for principal kudu/127.14.224.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab.
I20260805 22:47:07.011022 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.129:0
--local_ip_for_outbound_sockets=127.14.224.129
--webserver_interface=127.14.224.129
--webserver_port=0
--tserver_master_addrs=127.14.224.190:41369
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab
--principal=kudu/127.14.224.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:44083
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:47:07.096454 16894 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:07.096685 16894 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:07.096725 16894 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:07.098042 16894 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:07.098104 16894 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:07.098126 16894 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260805 22:47:07.098143 16894 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.129
I20260805 22:47:07.099812 16894 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:44083
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab
--principal=kudu/127.14.224.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.224.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.14.224.190:41369
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16894
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.129
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:07.100095 16894 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:07.100353 16894 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:07.105743 16903 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:07.105747 16902 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:07.105738 16905 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:07.106060 16894 server_base.cc:1034] running on GCE node
I20260805 22:47:07.106341 16894 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:07.106570 16894 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:07.107757 16894 hybrid_clock.cc:648] HybridClock initialized: now 1785970027107742 us; error 29 us; skew 500 ppm
Aug 05 22:47:07 dist-test-slave-gjrz krb5kdc[16715](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970027, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:07.110488 16894 init.cc:377] Logged in from keytab as kudu/127.14.224.129@KRBTEST.COM (short username kudu)
I20260805 22:47:07.110908 16894 webserver.cc:460] Webserver started at http://127.14.224.129:43187/ using document root <none> and password file <none>
I20260805 22:47:07.111132 16894 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:07.111191 16894 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:07.111336 16894 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:07.112409 16894 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/ts-0/data/instance:
uuid: "11a494b057764c20ab99f45811b3f066"
format_stamp: "Formatted at 2026-08-05 22:47:07 on dist-test-slave-gjrz"
server_key: "7d0fdce52408c63a8ea11ae125fe3892"
server_key_iv: "268ef42603c45f8a05aa05dc3e38e9d8"
server_key_version: "encryptionkey@0"
I20260805 22:47:07.112896 16894 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/ts-0/wal/instance:
uuid: "11a494b057764c20ab99f45811b3f066"
format_stamp: "Formatted at 2026-08-05 22:47:07 on dist-test-slave-gjrz"
server_key: "7d0fdce52408c63a8ea11ae125fe3892"
server_key_iv: "268ef42603c45f8a05aa05dc3e38e9d8"
server_key_version: "encryptionkey@0"
I20260805 22:47:07.114241 16894 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260805 22:47:07.114984 16916 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:07.115139 16894 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260805 22:47:07.115232 16894 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/ts-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/ts-0/wal
uuid: "11a494b057764c20ab99f45811b3f066"
format_stamp: "Formatted at 2026-08-05 22:47:07 on dist-test-slave-gjrz"
server_key: "7d0fdce52408c63a8ea11ae125fe3892"
server_key_iv: "268ef42603c45f8a05aa05dc3e38e9d8"
server_key_version: "encryptionkey@0"
I20260805 22:47:07.115334 16894 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:07.125187 16894 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:07.127490 16894 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:07.127640 16894 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:07.128157 16894 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:47:07.128196 16894 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:07.128227 16894 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:47:07.128253 16894 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 05 22:47:07 dist-test-slave-gjrz krb5kdc[16715](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970027, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.129@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:47:07.135257 16894 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.129:32835
I20260805 22:47:07.135358 17069 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.129:32835 every 8 connection(s)
I20260805 22:47:07.135705 16894 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
I20260805 22:47:07.136938 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 16894
I20260805 22:47:07.137032 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/ts-0/wal/instance
I20260805 22:47:07.137204 15234 external_mini_cluster.cc:1428] Setting key 5725f6cf0e22ec10a48b30cb0fd412b8
I20260805 22:47:07.138810 16883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:07.128822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.129:50063 (local address 127.14.224.190:41369)
0805 22:47:07.128872 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:07.128874 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:07.129126 (+ 252us) server_negotiation.cc:407] Connection header received
0805 22:47:07.129651 (+ 525us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:07.129653 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:07.129670 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:07.129741 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:07.130507 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:07.131012 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:07.132153 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:07.132359 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:07.132417 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:07.135526 (+ 3109us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:07.135528 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:07.135528 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:07.135540 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:07.137001 (+ 1461us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:07.137518 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:07.137520 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:07.137520 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:07.137613 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:07.138128 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:07.138129 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:07.138129 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:07.138261 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:07.138320 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:07.138604 (+ 284us) server_negotiation.cc:299] Negotiation successful
0805 22:47:07.138718 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260805 22:47:07.138968 16927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:07.128814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:41369 (local address 127.14.224.129:50063)
0805 22:47:07.128981 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:07.129022 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:07.129533 (+ 511us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:07.129822 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:07.129827 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:07.130175 (+ 348us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:07.130417 (+ 242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:07.130422 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:07.131101 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:07.131102 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:07.132070 (+ 968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:07.132073 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:07.132434 (+ 361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:07.132435 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:07.132569 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:07.133072 (+ 503us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:07.133080 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:07.135400 (+ 2320us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:07.137156 (+ 1756us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:07.137163 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:07.137165 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:07.137429 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:07.137884 (+ 455us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:07.137885 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:07.137886 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:07.138054 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:07.138322 (+ 268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:07.138330 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:07.138477 (+ 147us) client_negotiation.cc:769] Sending connection context
0805 22:47:07.138568 (+ 91us) client_negotiation.cc:240] Negotiation successful
0805 22:47:07.138746 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":80,"threads_started":1}
I20260805 22:47:07.139499 17070 heartbeater.cc:347] Connected to a master server at 127.14.224.190:41369
I20260805 22:47:07.139604 17070 heartbeater.cc:464] Registering TS with master...
I20260805 22:47:07.139818 17070 heartbeater.cc:511] Master 127.14.224.190:41369 requested a full tablet report, sending...
I20260805 22:47:07.140765 16781 ts_manager.cc:194] Registered new tserver with Master: 11a494b057764c20ab99f45811b3f066 (127.14.224.129:32835)
I20260805 22:47:07.141582 16781 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.224.129@KRBTEST.COM'} at 127.14.224.129:50063
I20260805 22:47:07.146803 16883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:07.140763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.129:37609 (local address 127.14.224.190:41369)
0805 22:47:07.140798 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:07.140800 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:07.140809 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:47:07.140888 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:07.140888 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:07.140898 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:07.140955 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:07.141237 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:07.141921 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:07.142798 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:07.143084 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:07.143168 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:07.144144 (+ 976us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:07.144146 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:07.144147 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:07.144155 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:07.145580 (+ 1425us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:07.145997 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:07.145999 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:07.145999 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:07.146068 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:07.146239 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:07.146240 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:07.146240 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:07.146369 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:07.146427 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:07.146600 (+ 173us) server_negotiation.cc:299] Negotiation successful
0805 22:47:07.146703 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260805 22:47:07.147364 17078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:07.140607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:41369 (local address 127.14.224.129:37609)
0805 22:47:07.140755 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:07.140768 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:07.140823 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:07.140958 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:07.140959 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:07.141114 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:07.141176 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:07.141177 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:07.142004 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:07.142005 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:07.142711 (+ 706us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:07.142713 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:07.143175 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:07.143176 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:07.143237 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:07.143731 (+ 494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:07.143737 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:07.144055 (+ 318us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:07.145660 (+ 1605us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:07.145661 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:07.145661 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:07.145886 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:07.146121 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:07.146122 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:07.146122 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:07.146179 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:07.146428 (+ 249us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:07.146429 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:07.146489 (+ 60us) client_negotiation.cc:769] Sending connection context
0805 22:47:07.147056 (+ 567us) client_negotiation.cc:240] Negotiation successful
0805 22:47:07.147214 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":67,"threads_started":1}
WARNING: no policy specified for kudu/127.14.224.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab.
Entry for principal kudu/127.14.224.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab.
I20260805 22:47:07.170917 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.130:0
--local_ip_for_outbound_sockets=127.14.224.130
--webserver_interface=127.14.224.130
--webserver_port=0
--tserver_master_addrs=127.14.224.190:41369
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab
--principal=kudu/127.14.224.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:44083
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:47:07.256497 17080 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:07.256704 17080 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:07.256727 17080 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:07.257936 17080 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:07.257979 17080 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:07.257999 17080 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260805 22:47:07.258021 17080 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.130
I20260805 22:47:07.259495 17080 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:44083
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab
--principal=kudu/127.14.224.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.224.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.14.224.190:41369
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17080
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.130
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:07.259698 17080 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:07.259886 17080 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:07.264837 17089 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:07.264863 17092 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:07.264838 17090 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:07.265061 17080 server_base.cc:1034] running on GCE node
I20260805 22:47:07.265348 17080 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:07.265614 17080 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:07.266782 17080 hybrid_clock.cc:648] HybridClock initialized: now 1785970027266765 us; error 28 us; skew 500 ppm
Aug 05 22:47:07 dist-test-slave-gjrz krb5kdc[16715](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970027, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:07.269462 17080 init.cc:377] Logged in from keytab as kudu/127.14.224.130@KRBTEST.COM (short username kudu)
I20260805 22:47:07.269937 17080 webserver.cc:460] Webserver started at http://127.14.224.130:37029/ using document root <none> and password file <none>
I20260805 22:47:07.270161 17080 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:07.270211 17080 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:07.270339 17080 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:07.271487 17080 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/ts-1/data/instance:
uuid: "8f8619d8fa12443691806fbf7707b160"
format_stamp: "Formatted at 2026-08-05 22:47:07 on dist-test-slave-gjrz"
server_key: "3c198a6eb3881b8f1717bc6089ba47dc"
server_key_iv: "b21c641716d6077cba0790d055f5f207"
server_key_version: "encryptionkey@0"
I20260805 22:47:07.271847 17080 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/ts-1/wal/instance:
uuid: "8f8619d8fa12443691806fbf7707b160"
format_stamp: "Formatted at 2026-08-05 22:47:07 on dist-test-slave-gjrz"
server_key: "3c198a6eb3881b8f1717bc6089ba47dc"
server_key_iv: "b21c641716d6077cba0790d055f5f207"
server_key_version: "encryptionkey@0"
I20260805 22:47:07.273154 17080 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260805 22:47:07.273838 17101 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:07.273998 17080 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260805 22:47:07.274089 17080 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/ts-1/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/ts-1/wal
uuid: "8f8619d8fa12443691806fbf7707b160"
format_stamp: "Formatted at 2026-08-05 22:47:07 on dist-test-slave-gjrz"
server_key: "3c198a6eb3881b8f1717bc6089ba47dc"
server_key_iv: "b21c641716d6077cba0790d055f5f207"
server_key_version: "encryptionkey@0"
I20260805 22:47:07.274154 17080 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:07.289335 17080 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:07.291702 17080 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:07.291852 17080 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:07.292385 17080 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:47:07.292439 17080 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:07.292470 17080 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:47:07.292488 17080 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 05 22:47:07 dist-test-slave-gjrz krb5kdc[16715](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970027, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.130@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:47:07.299278 17080 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.130:40061
I20260805 22:47:07.299352 17259 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.130:40061 every 8 connection(s)
I20260805 22:47:07.299674 17080 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
I20260805 22:47:07.302234 16883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:07.292883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:41805 (local address 127.14.224.190:41369)
0805 22:47:07.292934 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:07.292936 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:07.293206 (+ 270us) server_negotiation.cc:407] Connection header received
0805 22:47:07.293755 (+ 549us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:07.293757 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:07.293772 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:07.293849 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:07.294711 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:07.295529 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:07.296654 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:07.296970 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:07.297044 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:07.299831 (+ 2787us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:07.299834 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:07.299834 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:07.299844 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:07.301024 (+ 1180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:07.301392 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:07.301393 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:07.301393 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:07.301444 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:07.301641 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:07.301641 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:07.301642 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:07.301745 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:07.301792 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:07.302076 (+ 284us) server_negotiation.cc:299] Negotiation successful
0805 22:47:07.302164 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260805 22:47:07.302361 17113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:07.292874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:41369 (local address 127.14.224.130:41805)
0805 22:47:07.293057 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:07.293116 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:07.293628 (+ 512us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:07.293921 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:07.293925 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:07.294292 (+ 367us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:07.294592 (+ 300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:07.294600 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:07.295630 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:07.295632 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:07.296543 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:07.296546 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:07.297073 (+ 527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:07.297074 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:07.297228 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:07.297835 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:07.297845 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:07.299726 (+ 1881us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:07.301098 (+ 1372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:07.301104 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:07.301106 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:07.301328 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:07.301489 (+ 161us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:07.301489 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:07.301489 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:07.301597 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:07.301810 (+ 213us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:07.301815 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:07.301948 (+ 133us) client_negotiation.cc:769] Sending connection context
0805 22:47:07.302033 (+ 85us) client_negotiation.cc:240] Negotiation successful
0805 22:47:07.302170 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":99,"threads_started":1}
I20260805 22:47:07.302883 17260 heartbeater.cc:347] Connected to a master server at 127.14.224.190:41369
I20260805 22:47:07.302975 17260 heartbeater.cc:464] Registering TS with master...
I20260805 22:47:07.303217 17260 heartbeater.cc:511] Master 127.14.224.190:41369 requested a full tablet report, sending...
I20260805 22:47:07.303673 16781 ts_manager.cc:194] Registered new tserver with Master: 8f8619d8fa12443691806fbf7707b160 (127.14.224.130:40061)
I20260805 22:47:07.304101 16781 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.224.130@KRBTEST.COM'} at 127.14.224.130:41805
I20260805 22:47:07.307224 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 17080
I20260805 22:47:07.307360 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/ts-1/wal/instance
I20260805 22:47:07.307574 15234 external_mini_cluster.cc:1428] Setting key 1633a04499a231a53d3d964aa3906df6
I20260805 22:47:07.309983 17267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:07.304105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:41369 (local address 127.14.224.130:53493)
0805 22:47:07.304278 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:07.304289 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:07.304343 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:07.304465 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:07.304466 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:07.304686 (+ 220us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:07.304762 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:07.304765 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:07.305524 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:07.305525 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:07.306038 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:07.306040 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:07.306340 (+ 300us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:07.306341 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:07.306396 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:07.306792 (+ 396us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:07.306796 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:07.307092 (+ 296us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:07.308903 (+ 1811us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:07.308904 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:07.308905 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:07.309093 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:07.309295 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:07.309295 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:07.309295 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:07.309347 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:07.309678 (+ 331us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:07.309679 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:07.309725 (+ 46us) client_negotiation.cc:769] Sending connection context
0805 22:47:07.309784 (+ 59us) client_negotiation.cc:240] Negotiation successful
0805 22:47:07.309877 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":102,"threads_started":1}
I20260805 22:47:07.309986 16883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:07.304059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:53493 (local address 127.14.224.190:41369)
0805 22:47:07.304096 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:07.304098 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:07.304330 (+ 232us) server_negotiation.cc:407] Connection header received
0805 22:47:07.304397 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:07.304397 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:07.304407 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:07.304454 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:07.304845 (+ 391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:07.305440 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:07.306108 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:07.306292 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:07.306334 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:07.307195 (+ 861us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:07.307198 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:07.307198 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:07.307206 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:07.308784 (+ 1578us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:07.309168 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:07.309169 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:07.309169 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:07.309238 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:07.309394 (+ 156us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:07.309395 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:07.309395 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:07.309623 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:07.309688 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:07.309818 (+ 130us) server_negotiation.cc:299] Negotiation successful
0805 22:47:07.309904 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
WARNING: no policy specified for kudu/127.14.224.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab.
Entry for principal kudu/127.14.224.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab.
I20260805 22:47:07.336169 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.131:0
--local_ip_for_outbound_sockets=127.14.224.131
--webserver_interface=127.14.224.131
--webserver_port=0
--tserver_master_addrs=127.14.224.190:41369
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab
--principal=kudu/127.14.224.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:44083
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:47:07.421212 17274 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:07.421444 17274 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:07.421480 17274 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:07.422740 17274 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:07.422796 17274 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:07.422827 17274 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260805 22:47:07.422852 17274 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.131
I20260805 22:47:07.424484 17274 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:44083
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab
--principal=kudu/127.14.224.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.224.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.14.224.190:41369
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17274
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.131
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:07.424758 17274 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:07.425010 17274 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:07.430171 17280 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:07.430193 17283 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:07.430186 17281 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:07.430267 17274 server_base.cc:1034] running on GCE node
I20260805 22:47:07.430577 17274 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:07.430826 17274 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:07.431989 17274 hybrid_clock.cc:648] HybridClock initialized: now 1785970027431973 us; error 30 us; skew 500 ppm
Aug 05 22:47:07 dist-test-slave-gjrz krb5kdc[16715](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970027, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:07.434612 17274 init.cc:377] Logged in from keytab as kudu/127.14.224.131@KRBTEST.COM (short username kudu)
I20260805 22:47:07.435300 17274 webserver.cc:460] Webserver started at http://127.14.224.131:34243/ using document root <none> and password file <none>
I20260805 22:47:07.435583 17274 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:07.435652 17274 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:07.435799 17274 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:07.436916 17274 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/ts-2/data/instance:
uuid: "8ac59e7fd4154b20a35f2d22fb730d16"
format_stamp: "Formatted at 2026-08-05 22:47:07 on dist-test-slave-gjrz"
server_key: "80df6b6ea6241317aadf2dcb8b11d0d2"
server_key_iv: "bd64466b4c8268e38dce4e1d29925b5b"
server_key_version: "encryptionkey@0"
I20260805 22:47:07.437286 17274 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/ts-2/wal/instance:
uuid: "8ac59e7fd4154b20a35f2d22fb730d16"
format_stamp: "Formatted at 2026-08-05 22:47:07 on dist-test-slave-gjrz"
server_key: "80df6b6ea6241317aadf2dcb8b11d0d2"
server_key_iv: "bd64466b4c8268e38dce4e1d29925b5b"
server_key_version: "encryptionkey@0"
I20260805 22:47:07.438760 17274 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260805 22:47:07.439553 17290 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:07.439704 17274 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:47:07.439797 17274 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/ts-2/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/ts-2/wal
uuid: "8ac59e7fd4154b20a35f2d22fb730d16"
format_stamp: "Formatted at 2026-08-05 22:47:07 on dist-test-slave-gjrz"
server_key: "80df6b6ea6241317aadf2dcb8b11d0d2"
server_key_iv: "bd64466b4c8268e38dce4e1d29925b5b"
server_key_version: "encryptionkey@0"
I20260805 22:47:07.439878 17274 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:07.461547 17274 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:07.463586 17274 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:07.463732 17274 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:07.464362 17274 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:47:07.464413 17274 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:07.464443 17274 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:47:07.464460 17274 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 05 22:47:07 dist-test-slave-gjrz krb5kdc[16715](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970027, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.131@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:47:07.471311 17274 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.131:36753
I20260805 22:47:07.471359 17438 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.131:36753 every 8 connection(s)
I20260805 22:47:07.471731 17274 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
I20260805 22:47:07.472421 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 17274
I20260805 22:47:07.472513 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/ts-2/wal/instance
I20260805 22:47:07.472685 15234 external_mini_cluster.cc:1428] Setting key aaf541448c0e393d80f507e1a13bfaf8
I20260805 22:47:07.474462 16883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:07.464766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:55989 (local address 127.14.224.190:41369)
0805 22:47:07.464829 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:07.464831 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:07.465047 (+ 216us) server_negotiation.cc:407] Connection header received
0805 22:47:07.465531 (+ 484us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:07.465533 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:07.465546 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:07.465629 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:07.466289 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:07.467047 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:07.468603 (+ 1556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:07.468834 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:07.468907 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:07.471356 (+ 2449us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:07.471357 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:07.471358 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:07.471367 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:07.472979 (+ 1612us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:07.473457 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:07.473458 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:07.473458 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:07.473523 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:07.473795 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:07.473796 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:07.473796 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:07.473929 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:07.473989 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:07.474282 (+ 293us) server_negotiation.cc:299] Negotiation successful
0805 22:47:07.474374 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260805 22:47:07.474639 17301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:07.464733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:41369 (local address 127.14.224.131:55989)
0805 22:47:07.464897 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:07.464966 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:07.465441 (+ 475us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:07.465702 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:07.465705 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:07.465992 (+ 287us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:07.466190 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:07.466195 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:07.467166 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:07.467168 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:07.468506 (+ 1338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:07.468511 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:07.469005 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:07.469006 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:07.469155 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:07.469683 (+ 528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:07.469691 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:07.471229 (+ 1538us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:07.473096 (+ 1867us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:07.473104 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:07.473106 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:07.473378 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:07.473614 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:07.473615 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:07.473615 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:07.473728 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:07.473991 (+ 263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:07.473998 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:07.474153 (+ 155us) client_negotiation.cc:769] Sending connection context
0805 22:47:07.474247 (+ 94us) client_negotiation.cc:240] Negotiation successful
0805 22:47:07.474415 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":93,"threads_started":1}
I20260805 22:47:07.475095 17439 heartbeater.cc:347] Connected to a master server at 127.14.224.190:41369
I20260805 22:47:07.475180 17439 heartbeater.cc:464] Registering TS with master...
I20260805 22:47:07.475387 17439 heartbeater.cc:511] Master 127.14.224.190:41369 requested a full tablet report, sending...
I20260805 22:47:07.475786 16780 ts_manager.cc:194] Registered new tserver with Master: 8ac59e7fd4154b20a35f2d22fb730d16 (127.14.224.131:36753)
I20260805 22:47:07.476177 16780 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.224.131@KRBTEST.COM'} at 127.14.224.131:55989
I20260805 22:47:07.481371 16883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:07.476192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:39681 (local address 127.14.224.190:41369)
0805 22:47:07.476235 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:07.476237 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:07.476363 (+ 126us) server_negotiation.cc:407] Connection header received
0805 22:47:07.476417 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:07.476418 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:07.476428 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:07.476480 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:07.476801 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:07.477304 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:07.478027 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:07.478235 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:07.478289 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:07.479089 (+ 800us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:07.479090 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:07.479090 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:07.479097 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:07.480344 (+ 1247us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:07.480660 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:07.480662 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:07.480662 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:07.480721 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:07.480886 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:07.480887 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:07.480887 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:07.480997 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:07.481053 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:07.481193 (+ 140us) server_negotiation.cc:299] Negotiation successful
0805 22:47:07.481272 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260805 22:47:07.481382 17447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:07.476132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:41369 (local address 127.14.224.131:39681)
0805 22:47:07.476295 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:07.476305 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:07.476362 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:07.476485 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:07.476486 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:07.476667 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:07.476733 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:07.476734 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:07.477395 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:07.477396 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:07.477929 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:07.477931 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:07.478295 (+ 364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:07.478296 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:07.478370 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:07.478735 (+ 365us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:07.478739 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:07.479005 (+ 266us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:07.480427 (+ 1422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:07.480428 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:07.480428 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:07.480591 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:07.480776 (+ 185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:07.480777 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:07.480777 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:07.480836 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:07.481052 (+ 216us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:07.481053 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:07.481103 (+ 50us) client_negotiation.cc:769] Sending connection context
0805 22:47:07.481164 (+ 61us) client_negotiation.cc:240] Negotiation successful
0805 22:47:07.481273 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":78,"threads_started":1}
I20260805 22:47:07.484334 15234 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 05 22:47:07 dist-test-slave-gjrz krb5kdc[16715](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970027, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 05 22:47:07 dist-test-slave-gjrz krb5kdc[16715](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970027, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:47:07.510059 16883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:07.503240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54346 (local address 127.14.224.190:41369)
0805 22:47:07.503346 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:07.503347 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:07.503358 (+ 11us) server_negotiation.cc:407] Connection header received
0805 22:47:07.503387 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:07.503388 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:07.503398 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:07.503450 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:07.504026 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:07.504556 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:07.505281 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:07.505483 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:07.505539 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:07.507858 (+ 2319us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:07.507859 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:07.507860 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:07.507869 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:07.508973 (+ 1104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:07.509320 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:07.509321 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:07.509321 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:07.509378 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:07.509545 (+ 167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:07.509546 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:07.509547 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:07.509669 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:07.509762 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:07.509878 (+ 116us) server_negotiation.cc:299] Negotiation successful
0805 22:47:07.509964 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260805 22:47:07.511745 16780 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54346:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:47:07.513396 16780 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:47:07.519809 17462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:07.515594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.131:36753 (local address 127.0.0.1:51916)
0805 22:47:07.515912 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:07.515954 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:07.516043 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:07.516349 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:07.516352 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:07.516355 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:47:07.516429 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:07.516431 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:07.517320 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:07.517321 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:07.518525 (+ 1204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:07.518528 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:07.519460 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:07.519461 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:07.519569 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:07.519586 (+ 17us) client_negotiation.cc:769] Sending connection context
0805 22:47:07.519655 (+ 69us) client_negotiation.cc:240] Negotiation successful
0805 22:47:07.519720 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":288,"thread_start_us":57,"threads_started":1}
I20260805 22:47:07.519913 17466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:07.515798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.129:32835 (local address 127.0.0.1:55424)
0805 22:47:07.516086 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:07.516094 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:07.516132 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:07.516529 (+ 397us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:07.516529 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:07.516531 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:47:07.516561 (+ 30us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:07.516562 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:07.517878 (+ 1316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:07.517879 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:07.518795 (+ 916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:07.518798 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:07.519664 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:07.519665 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:07.519722 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:07.519725 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:47:07.519784 (+ 59us) client_negotiation.cc:240] Negotiation successful
0805 22:47:07.519818 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":69,"threads_started":1}
I20260805 22:47:07.520170 17467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:07.515925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55424 (local address 127.14.224.129:32835)
0805 22:47:07.516306 (+ 381us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:07.516309 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:07.516318 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:47:07.516357 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:07.516359 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:07.516372 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:07.516623 (+ 251us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:47:07.516689 (+ 66us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:07.517796 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:07.518883 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:07.519574 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:07.519659 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:07.519712 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:07.519802 (+ 90us) server_negotiation.cc:299] Negotiation successful
0805 22:47:07.519843 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":348,"thread_start_us":91,"threads_started":1}
I20260805 22:47:07.520205 17464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:07.515716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51916 (local address 127.14.224.131:36753)
0805 22:47:07.515903 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:07.515909 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:07.516133 (+ 224us) server_negotiation.cc:407] Connection header received
0805 22:47:07.516180 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:07.516182 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:07.516198 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:07.516265 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:47:07.516490 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:07.517237 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:07.518628 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:07.519385 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:07.519454 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:07.519526 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:07.520082 (+ 556us) server_negotiation.cc:299] Negotiation successful
0805 22:47:07.520119 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":97,"threads_started":1}
I20260805 22:47:07.520432 17468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:07.515958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.130:40061 (local address 127.0.0.1:39786)
0805 22:47:07.516112 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:07.516136 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:07.516196 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:07.516475 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:07.516476 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:07.516478 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:47:07.516536 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:07.516537 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:07.517832 (+ 1295us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:07.517833 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:07.518998 (+ 1165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:07.519001 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:07.520205 (+ 1204us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:07.520206 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:07.520274 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:07.520279 (+ 5us) client_negotiation.cc:769] Sending connection context
0805 22:47:07.520325 (+ 46us) client_negotiation.cc:240] Negotiation successful
0805 22:47:07.520366 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"mutex_wait_us":21,"thread_start_us":80,"threads_started":1}
I20260805 22:47:07.520704 17469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:07.516064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39786 (local address 127.14.224.130:40061)
0805 22:47:07.516261 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:07.516265 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:07.516274 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:47:07.516312 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:07.516314 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:07.516330 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:07.516406 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:47:07.516636 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:07.517750 (+ 1114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:07.519089 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:07.520112 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:07.520194 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:07.520371 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:07.520398 (+ 27us) server_negotiation.cc:299] Negotiation successful
0805 22:47:07.520443 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":92,"threads_started":1}
I20260805 22:47:07.520889 16982 tablet_service.cc:1467] Processing CreateTablet for tablet 4d1fddc3f3374addbc4fccbaa97a579f (DEFAULT_TABLE table=test-table [id=cc63f60742f94204b7dac9671bba7c77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:47:07.520901 17350 tablet_service.cc:1467] Processing CreateTablet for tablet 4d1fddc3f3374addbc4fccbaa97a579f (DEFAULT_TABLE table=test-table [id=cc63f60742f94204b7dac9671bba7c77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:47:07.521302 16982 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d1fddc3f3374addbc4fccbaa97a579f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:07.521302 17350 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d1fddc3f3374addbc4fccbaa97a579f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:07.521432 17169 tablet_service.cc:1467] Processing CreateTablet for tablet 4d1fddc3f3374addbc4fccbaa97a579f (DEFAULT_TABLE table=test-table [id=cc63f60742f94204b7dac9671bba7c77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:47:07.521804 17169 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d1fddc3f3374addbc4fccbaa97a579f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:07.524492 17470 tablet_bootstrap.cc:492] T 4d1fddc3f3374addbc4fccbaa97a579f P 11a494b057764c20ab99f45811b3f066: Bootstrap starting.
I20260805 22:47:07.524973 17471 tablet_bootstrap.cc:492] T 4d1fddc3f3374addbc4fccbaa97a579f P 8ac59e7fd4154b20a35f2d22fb730d16: Bootstrap starting.
I20260805 22:47:07.525399 17470 tablet_bootstrap.cc:654] T 4d1fddc3f3374addbc4fccbaa97a579f P 11a494b057764c20ab99f45811b3f066: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:07.525552 17473 tablet_bootstrap.cc:492] T 4d1fddc3f3374addbc4fccbaa97a579f P 8f8619d8fa12443691806fbf7707b160: Bootstrap starting.
I20260805 22:47:07.525977 17471 tablet_bootstrap.cc:654] T 4d1fddc3f3374addbc4fccbaa97a579f P 8ac59e7fd4154b20a35f2d22fb730d16: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:07.526186 17473 tablet_bootstrap.cc:654] T 4d1fddc3f3374addbc4fccbaa97a579f P 8f8619d8fa12443691806fbf7707b160: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:07.526283 17470 log.cc:824] T 4d1fddc3f3374addbc4fccbaa97a579f P 11a494b057764c20ab99f45811b3f066: Log is configured to *not* fsync() on all Append() calls
I20260805 22:47:07.526315 17471 log.cc:824] T 4d1fddc3f3374addbc4fccbaa97a579f P 8ac59e7fd4154b20a35f2d22fb730d16: Log is configured to *not* fsync() on all Append() calls
I20260805 22:47:07.526497 17473 log.cc:824] T 4d1fddc3f3374addbc4fccbaa97a579f P 8f8619d8fa12443691806fbf7707b160: Log is configured to *not* fsync() on all Append() calls
I20260805 22:47:07.527192 17471 tablet_bootstrap.cc:492] T 4d1fddc3f3374addbc4fccbaa97a579f P 8ac59e7fd4154b20a35f2d22fb730d16: No bootstrap required, opened a new log
I20260805 22:47:07.527259 17471 ts_tablet_manager.cc:1397] T 4d1fddc3f3374addbc4fccbaa97a579f P 8ac59e7fd4154b20a35f2d22fb730d16: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260805 22:47:07.527379 17473 tablet_bootstrap.cc:492] T 4d1fddc3f3374addbc4fccbaa97a579f P 8f8619d8fa12443691806fbf7707b160: No bootstrap required, opened a new log
I20260805 22:47:07.527407 17470 tablet_bootstrap.cc:492] T 4d1fddc3f3374addbc4fccbaa97a579f P 11a494b057764c20ab99f45811b3f066: No bootstrap required, opened a new log
I20260805 22:47:07.527457 17473 ts_tablet_manager.cc:1397] T 4d1fddc3f3374addbc4fccbaa97a579f P 8f8619d8fa12443691806fbf7707b160: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260805 22:47:07.527464 17470 ts_tablet_manager.cc:1397] T 4d1fddc3f3374addbc4fccbaa97a579f P 11a494b057764c20ab99f45811b3f066: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260805 22:47:07.528788 17471 raft_consensus.cc:348] T 4d1fddc3f3374addbc4fccbaa97a579f P 8ac59e7fd4154b20a35f2d22fb730d16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ac59e7fd4154b20a35f2d22fb730d16" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 36753 } } peers { permanent_uuid: "11a494b057764c20ab99f45811b3f066" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 32835 } } peers { permanent_uuid: "8f8619d8fa12443691806fbf7707b160" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40061 } }
I20260805 22:47:07.528940 17471 raft_consensus.cc:374] T 4d1fddc3f3374addbc4fccbaa97a579f P 8ac59e7fd4154b20a35f2d22fb730d16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:07.528973 17471 raft_consensus.cc:729] T 4d1fddc3f3374addbc4fccbaa97a579f P 8ac59e7fd4154b20a35f2d22fb730d16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ac59e7fd4154b20a35f2d22fb730d16, State: Initialized, Role: FOLLOWER
I20260805 22:47:07.529114 17471 consensus_queue.cc:260] T 4d1fddc3f3374addbc4fccbaa97a579f P 8ac59e7fd4154b20a35f2d22fb730d16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ac59e7fd4154b20a35f2d22fb730d16" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 36753 } } peers { permanent_uuid: "11a494b057764c20ab99f45811b3f066" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 32835 } } peers { permanent_uuid: "8f8619d8fa12443691806fbf7707b160" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40061 } }
I20260805 22:47:07.529398 17471 ts_tablet_manager.cc:1428] T 4d1fddc3f3374addbc4fccbaa97a579f P 8ac59e7fd4154b20a35f2d22fb730d16: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260805 22:47:07.529548 17439 heartbeater.cc:503] Master 127.14.224.190:41369 was elected leader, sending a full tablet report...
I20260805 22:47:07.529507 17470 raft_consensus.cc:348] T 4d1fddc3f3374addbc4fccbaa97a579f P 11a494b057764c20ab99f45811b3f066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ac59e7fd4154b20a35f2d22fb730d16" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 36753 } } peers { permanent_uuid: "11a494b057764c20ab99f45811b3f066" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 32835 } } peers { permanent_uuid: "8f8619d8fa12443691806fbf7707b160" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40061 } }
I20260805 22:47:07.529507 17473 raft_consensus.cc:348] T 4d1fddc3f3374addbc4fccbaa97a579f P 8f8619d8fa12443691806fbf7707b160 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ac59e7fd4154b20a35f2d22fb730d16" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 36753 } } peers { permanent_uuid: "11a494b057764c20ab99f45811b3f066" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 32835 } } peers { permanent_uuid: "8f8619d8fa12443691806fbf7707b160" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40061 } }
I20260805 22:47:07.529667 17473 raft_consensus.cc:374] T 4d1fddc3f3374addbc4fccbaa97a579f P 8f8619d8fa12443691806fbf7707b160 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:07.529667 17470 raft_consensus.cc:374] T 4d1fddc3f3374addbc4fccbaa97a579f P 11a494b057764c20ab99f45811b3f066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:07.529702 17470 raft_consensus.cc:729] T 4d1fddc3f3374addbc4fccbaa97a579f P 11a494b057764c20ab99f45811b3f066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11a494b057764c20ab99f45811b3f066, State: Initialized, Role: FOLLOWER
I20260805 22:47:07.529702 17473 raft_consensus.cc:729] T 4d1fddc3f3374addbc4fccbaa97a579f P 8f8619d8fa12443691806fbf7707b160 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f8619d8fa12443691806fbf7707b160, State: Initialized, Role: FOLLOWER
I20260805 22:47:07.529840 17470 consensus_queue.cc:260] T 4d1fddc3f3374addbc4fccbaa97a579f P 11a494b057764c20ab99f45811b3f066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ac59e7fd4154b20a35f2d22fb730d16" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 36753 } } peers { permanent_uuid: "11a494b057764c20ab99f45811b3f066" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 32835 } } peers { permanent_uuid: "8f8619d8fa12443691806fbf7707b160" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40061 } }
I20260805 22:47:07.529848 17473 consensus_queue.cc:260] T 4d1fddc3f3374addbc4fccbaa97a579f P 8f8619d8fa12443691806fbf7707b160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ac59e7fd4154b20a35f2d22fb730d16" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 36753 } } peers { permanent_uuid: "11a494b057764c20ab99f45811b3f066" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 32835 } } peers { permanent_uuid: "8f8619d8fa12443691806fbf7707b160" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40061 } }
I20260805 22:47:07.530123 17470 ts_tablet_manager.cc:1428] T 4d1fddc3f3374addbc4fccbaa97a579f P 11a494b057764c20ab99f45811b3f066: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260805 22:47:07.530181 17070 heartbeater.cc:503] Master 127.14.224.190:41369 was elected leader, sending a full tablet report...
I20260805 22:47:07.530123 17473 ts_tablet_manager.cc:1428] T 4d1fddc3f3374addbc4fccbaa97a579f P 8f8619d8fa12443691806fbf7707b160: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260805 22:47:07.530319 17260 heartbeater.cc:503] Master 127.14.224.190:41369 was elected leader, sending a full tablet report...
W20260805 22:47:07.550264 17261 tablet.cc:2369] T 4d1fddc3f3374addbc4fccbaa97a579f P 8f8619d8fa12443691806fbf7707b160: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260805 22:47:07.636606 17071 tablet.cc:2369] T 4d1fddc3f3374addbc4fccbaa97a579f P 11a494b057764c20ab99f45811b3f066: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260805 22:47:07.722333 17440 tablet.cc:2369] T 4d1fddc3f3374addbc4fccbaa97a579f P 8ac59e7fd4154b20a35f2d22fb730d16: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:47:07.744060 17477 raft_consensus.cc:482] T 4d1fddc3f3374addbc4fccbaa97a579f P 8ac59e7fd4154b20a35f2d22fb730d16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:47:07.744197 17477 raft_consensus.cc:504] T 4d1fddc3f3374addbc4fccbaa97a579f P 8ac59e7fd4154b20a35f2d22fb730d16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ac59e7fd4154b20a35f2d22fb730d16" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 36753 } } peers { permanent_uuid: "11a494b057764c20ab99f45811b3f066" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 32835 } } peers { permanent_uuid: "8f8619d8fa12443691806fbf7707b160" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40061 } }
I20260805 22:47:07.744625 17477 leader_election.cc:288] T 4d1fddc3f3374addbc4fccbaa97a579f P 8ac59e7fd4154b20a35f2d22fb730d16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11a494b057764c20ab99f45811b3f066 (127.14.224.129:32835), 8f8619d8fa12443691806fbf7707b160 (127.14.224.130:40061)
I20260805 22:47:07.747411 17478 raft_consensus.cc:482] T 4d1fddc3f3374addbc4fccbaa97a579f P 8f8619d8fa12443691806fbf7707b160 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:47:07.747537 17478 raft_consensus.cc:504] T 4d1fddc3f3374addbc4fccbaa97a579f P 8f8619d8fa12443691806fbf7707b160 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ac59e7fd4154b20a35f2d22fb730d16" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 36753 } } peers { permanent_uuid: "11a494b057764c20ab99f45811b3f066" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 32835 } } peers { permanent_uuid: "8f8619d8fa12443691806fbf7707b160" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40061 } }
I20260805 22:47:07.747915 17478 leader_election.cc:288] T 4d1fddc3f3374addbc4fccbaa97a579f P 8f8619d8fa12443691806fbf7707b160 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ac59e7fd4154b20a35f2d22fb730d16 (127.14.224.131:36753), 11a494b057764c20ab99f45811b3f066 (127.14.224.129:32835)
I20260805 22:47:07.747990 17467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:07.744882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:57973 (local address 127.14.224.129:32835)
0805 22:47:07.744943 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:07.744946 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:07.745046 (+ 100us) server_negotiation.cc:407] Connection header received
0805 22:47:07.745126 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:07.745127 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:07.745137 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:07.745188 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:47:07.745380 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:07.746145 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:07.747160 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:07.747660 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:07.747734 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:07.747744 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:07.747887 (+ 143us) server_negotiation.cc:299] Negotiation successful
0805 22:47:07.747927 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260805 22:47:07.747990 17301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:07.744819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.129:32835 (local address 127.14.224.131:57973)
0805 22:47:07.744979 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:07.744991 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:07.745043 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:07.745243 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:07.745244 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:07.745245 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:47:07.745316 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:07.745319 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:07.746264 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:07.746266 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:07.747046 (+ 780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:07.747049 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:07.747734 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:07.747735 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:07.747820 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:07.747823 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:47:07.747869 (+ 46us) client_negotiation.cc:240] Negotiation successful
0805 22:47:07.747912 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"mutex_wait_us":4}
I20260805 22:47:07.748037 17469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:07.745047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:60001 (local address 127.14.224.130:40061)
0805 22:47:07.745096 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:07.745098 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:07.745191 (+ 93us) server_negotiation.cc:407] Connection header received
0805 22:47:07.745224 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:07.745225 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:07.745234 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:07.745285 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:47:07.745418 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:07.746146 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:07.747155 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:07.747666 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:07.747736 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:07.747744 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:07.747939 (+ 195us) server_negotiation.cc:299] Negotiation successful
0805 22:47:07.747983 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260805 22:47:07.748257 17481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:07.744927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.130:40061 (local address 127.14.224.131:60001)
0805 22:47:07.745108 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:07.745117 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:07.745188 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:07.745297 (+ 109us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:07.745298 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:07.745299 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:47:07.745356 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:07.745357 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:07.746300 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:07.746300 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:07.747061 (+ 761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:07.747064 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:07.747781 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:07.747782 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:07.747856 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:07.747860 (+ 4us) client_negotiation.cc:769] Sending connection context
0805 22:47:07.748122 (+ 262us) client_negotiation.cc:240] Negotiation successful
0805 22:47:07.748167 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"mutex_wait_us":1,"thread_start_us":105,"threads_started":1}
I20260805 22:47:07.748395 17010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d1fddc3f3374addbc4fccbaa97a579f" candidate_uuid: "8ac59e7fd4154b20a35f2d22fb730d16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11a494b057764c20ab99f45811b3f066" is_pre_election: true
I20260805 22:47:07.748550 17010 raft_consensus.cc:2454] T 4d1fddc3f3374addbc4fccbaa97a579f P 11a494b057764c20ab99f45811b3f066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ac59e7fd4154b20a35f2d22fb730d16 in term 0.
I20260805 22:47:07.748584 17192 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d1fddc3f3374addbc4fccbaa97a579f" candidate_uuid: "8ac59e7fd4154b20a35f2d22fb730d16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f8619d8fa12443691806fbf7707b160" is_pre_election: true
I20260805 22:47:07.748672 17192 raft_consensus.cc:2454] T 4d1fddc3f3374addbc4fccbaa97a579f P 8f8619d8fa12443691806fbf7707b160 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ac59e7fd4154b20a35f2d22fb730d16 in term 0.
I20260805 22:47:07.748818 17292 leader_election.cc:302] T 4d1fddc3f3374addbc4fccbaa97a579f P 8ac59e7fd4154b20a35f2d22fb730d16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11a494b057764c20ab99f45811b3f066, 8ac59e7fd4154b20a35f2d22fb730d16; no voters:
I20260805 22:47:07.748950 17477 raft_consensus.cc:2781] T 4d1fddc3f3374addbc4fccbaa97a579f P 8ac59e7fd4154b20a35f2d22fb730d16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:47:07.749022 17477 raft_consensus.cc:482] T 4d1fddc3f3374addbc4fccbaa97a579f P 8ac59e7fd4154b20a35f2d22fb730d16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:47:07.749060 17477 raft_consensus.cc:3037] T 4d1fddc3f3374addbc4fccbaa97a579f P 8ac59e7fd4154b20a35f2d22fb730d16 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:07.750548 17477 raft_consensus.cc:504] T 4d1fddc3f3374addbc4fccbaa97a579f P 8ac59e7fd4154b20a35f2d22fb730d16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ac59e7fd4154b20a35f2d22fb730d16" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 36753 } } peers { permanent_uuid: "11a494b057764c20ab99f45811b3f066" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 32835 } } peers { permanent_uuid: "8f8619d8fa12443691806fbf7707b160" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40061 } }
I20260805 22:47:07.750687 17477 leader_election.cc:288] T 4d1fddc3f3374addbc4fccbaa97a579f P 8ac59e7fd4154b20a35f2d22fb730d16 [CANDIDATE]: Term 1 election: Requested vote from peers 11a494b057764c20ab99f45811b3f066 (127.14.224.129:32835), 8f8619d8fa12443691806fbf7707b160 (127.14.224.130:40061)
I20260805 22:47:07.750912 17192 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d1fddc3f3374addbc4fccbaa97a579f" candidate_uuid: "8ac59e7fd4154b20a35f2d22fb730d16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f8619d8fa12443691806fbf7707b160"
I20260805 22:47:07.751005 17192 raft_consensus.cc:3037] T 4d1fddc3f3374addbc4fccbaa97a579f P 8f8619d8fa12443691806fbf7707b160 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:07.751137 17113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:07.748114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.131:36753 (local address 127.14.224.130:53071)
0805 22:47:07.748354 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:07.748365 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:07.748410 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:07.748850 (+ 440us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:07.748851 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:07.748853 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:47:07.748906 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:07.748908 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:07.749605 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:07.749606 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:07.750328 (+ 722us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:07.750330 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:07.750901 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:07.750903 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:07.750982 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:07.750986 (+ 4us) client_negotiation.cc:769] Sending connection context
0805 22:47:07.751036 (+ 50us) client_negotiation.cc:240] Negotiation successful
0805 22:47:07.751075 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":223}
I20260805 22:47:07.751436 17464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:07.748170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:53071 (local address 127.14.224.131:36753)
0805 22:47:07.748209 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:07.748211 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:07.748725 (+ 514us) server_negotiation.cc:407] Connection header received
0805 22:47:07.748752 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:07.748753 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:07.748762 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:07.748808 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:47:07.748979 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:07.749519 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:07.750417 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:07.750805 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:07.750861 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:07.750870 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:07.751337 (+ 467us) server_negotiation.cc:299] Negotiation successful
0805 22:47:07.751380 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260805 22:47:07.751436 17010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d1fddc3f3374addbc4fccbaa97a579f" candidate_uuid: "8ac59e7fd4154b20a35f2d22fb730d16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11a494b057764c20ab99f45811b3f066"
I20260805 22:47:07.751519 17010 raft_consensus.cc:3037] T 4d1fddc3f3374addbc4fccbaa97a579f P 11a494b057764c20ab99f45811b3f066 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:07.751674 17374 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d1fddc3f3374addbc4fccbaa97a579f" candidate_uuid: "8f8619d8fa12443691806fbf7707b160" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ac59e7fd4154b20a35f2d22fb730d16" is_pre_election: true
I20260805 22:47:07.751780 17374 raft_consensus.cc:2379] T 4d1fddc3f3374addbc4fccbaa97a579f P 8ac59e7fd4154b20a35f2d22fb730d16 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8f8619d8fa12443691806fbf7707b160 in current term 1: Already voted for candidate 8ac59e7fd4154b20a35f2d22fb730d16 in this term.
I20260805 22:47:07.752002 17192 raft_consensus.cc:2454] T 4d1fddc3f3374addbc4fccbaa97a579f P 8f8619d8fa12443691806fbf7707b160 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ac59e7fd4154b20a35f2d22fb730d16 in term 1.
I20260805 22:47:07.752167 17292 leader_election.cc:302] T 4d1fddc3f3374addbc4fccbaa97a579f P 8ac59e7fd4154b20a35f2d22fb730d16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ac59e7fd4154b20a35f2d22fb730d16, 8f8619d8fa12443691806fbf7707b160; no voters:
I20260805 22:47:07.752255 17477 raft_consensus.cc:2781] T 4d1fddc3f3374addbc4fccbaa97a579f P 8ac59e7fd4154b20a35f2d22fb730d16 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:47:07.752250 17467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:07.748374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:56039 (local address 127.14.224.129:32835)
0805 22:47:07.748436 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:07.748438 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:07.748764 (+ 326us) server_negotiation.cc:407] Connection header received
0805 22:47:07.748838 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:07.748839 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:07.748847 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:07.748891 (+ 44us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:47:07.749078 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:07.749676 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:07.751392 (+ 1716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:07.751873 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:07.751938 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:07.751946 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:07.752159 (+ 213us) server_negotiation.cc:299] Negotiation successful
0805 22:47:07.752195 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260805 22:47:07.752395 17010 raft_consensus.cc:2454] T 4d1fddc3f3374addbc4fccbaa97a579f P 11a494b057764c20ab99f45811b3f066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ac59e7fd4154b20a35f2d22fb730d16 in term 1.
I20260805 22:47:07.752410 17477 raft_consensus.cc:686] T 4d1fddc3f3374addbc4fccbaa97a579f P 8ac59e7fd4154b20a35f2d22fb730d16 [term 1 LEADER]: Becoming Leader. State: Replica: 8ac59e7fd4154b20a35f2d22fb730d16, State: Running, Role: LEADER
I20260805 22:47:07.752476 17482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:07.748200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.129:32835 (local address 127.14.224.130:56039)
0805 22:47:07.748710 (+ 510us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:07.748719 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:07.748787 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:07.748911 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:07.748912 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:07.748913 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:47:07.748993 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:07.748994 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:07.749783 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:07.749784 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:07.751291 (+ 1507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:07.751293 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:07.751995 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:07.751996 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:07.752061 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:07.752065 (+ 4us) client_negotiation.cc:769] Sending connection context
0805 22:47:07.752358 (+ 293us) client_negotiation.cc:240] Negotiation successful
0805 22:47:07.752402 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":494,"thread_start_us":92,"threads_started":1}
I20260805 22:47:07.752517 17477 consensus_queue.cc:237] T 4d1fddc3f3374addbc4fccbaa97a579f P 8ac59e7fd4154b20a35f2d22fb730d16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ac59e7fd4154b20a35f2d22fb730d16" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 36753 } } peers { permanent_uuid: "11a494b057764c20ab99f45811b3f066" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 32835 } } peers { permanent_uuid: "8f8619d8fa12443691806fbf7707b160" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40061 } }
I20260805 22:47:07.752751 17010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d1fddc3f3374addbc4fccbaa97a579f" candidate_uuid: "8f8619d8fa12443691806fbf7707b160" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11a494b057764c20ab99f45811b3f066" is_pre_election: true
I20260805 22:47:07.752844 17010 raft_consensus.cc:2379] T 4d1fddc3f3374addbc4fccbaa97a579f P 11a494b057764c20ab99f45811b3f066 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8f8619d8fa12443691806fbf7707b160 in current term 1: Already voted for candidate 8ac59e7fd4154b20a35f2d22fb730d16 in this term.
I20260805 22:47:07.753059 17103 leader_election.cc:302] T 4d1fddc3f3374addbc4fccbaa97a579f P 8f8619d8fa12443691806fbf7707b160 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f8619d8fa12443691806fbf7707b160; no voters: 11a494b057764c20ab99f45811b3f066, 8ac59e7fd4154b20a35f2d22fb730d16
I20260805 22:47:07.753182 17478 raft_consensus.cc:2726] T 4d1fddc3f3374addbc4fccbaa97a579f P 8f8619d8fa12443691806fbf7707b160 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260805 22:47:07.753371 16781 catalog_manager.cc:5495] T 4d1fddc3f3374addbc4fccbaa97a579f P 8ac59e7fd4154b20a35f2d22fb730d16 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ac59e7fd4154b20a35f2d22fb730d16 (127.14.224.131). New cstate: current_term: 1 leader_uuid: "8ac59e7fd4154b20a35f2d22fb730d16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ac59e7fd4154b20a35f2d22fb730d16" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 36753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11a494b057764c20ab99f45811b3f066" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 32835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f8619d8fa12443691806fbf7707b160" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40061 } health_report { overall_health: UNKNOWN } } }
I20260805 22:47:07.806277 17464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:07.803947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51920 (local address 127.14.224.131:36753)
0805 22:47:07.804008 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:07.804010 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:07.804020 (+ 10us) server_negotiation.cc:407] Connection header received
0805 22:47:07.804057 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:07.804058 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:07.804074 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:07.804130 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:47:07.804297 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:07.804792 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:07.805527 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:07.805711 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:07.805768 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:07.805964 (+ 196us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:47:07.806073 (+ 109us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:47:07.806144 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:07.806176 (+ 32us) server_negotiation.cc:299] Negotiation successful
0805 22:47:07.806195 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260805 22:47:07.808079 17010 raft_consensus.cc:1261] T 4d1fddc3f3374addbc4fccbaa97a579f P 11a494b057764c20ab99f45811b3f066 [term 1 FOLLOWER]: Refusing update from remote peer 8ac59e7fd4154b20a35f2d22fb730d16: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:47:07.808105 17192 raft_consensus.cc:1261] T 4d1fddc3f3374addbc4fccbaa97a579f P 8f8619d8fa12443691806fbf7707b160 [term 1 FOLLOWER]: Refusing update from remote peer 8ac59e7fd4154b20a35f2d22fb730d16: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:47:07.808413 17477 consensus_queue.cc:1035] T 4d1fddc3f3374addbc4fccbaa97a579f P 8ac59e7fd4154b20a35f2d22fb730d16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11a494b057764c20ab99f45811b3f066" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:47:07.808565 17483 consensus_queue.cc:1035] T 4d1fddc3f3374addbc4fccbaa97a579f P 8ac59e7fd4154b20a35f2d22fb730d16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f8619d8fa12443691806fbf7707b160" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:47:07.811571 17489 mvcc.cc:205] Tried to move back new op lower bound from 7315333233899282432 to 7315333233674887168. Current Snapshot: MvccSnapshot[applied={T|T < 7315333233899282432}]
I20260805 22:47:07.815353 16781 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54346:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:47:07.815498 16781 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54346:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:47:07.816479 16781 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3787ee696aba431796bfff99173b09ef: Sending DeleteTablet for 3 replicas of tablet 4d1fddc3f3374addbc4fccbaa97a579f
I20260805 22:47:07.816957 17350 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d1fddc3f3374addbc4fccbaa97a579f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:47:07 UTC) from {username='kudu', principal='kudu/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:51916
I20260805 22:47:07.817245 17504 tablet_replica.cc:330] T 4d1fddc3f3374addbc4fccbaa97a579f P 8ac59e7fd4154b20a35f2d22fb730d16: stopping tablet replica
I20260805 22:47:07.817258 17169 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d1fddc3f3374addbc4fccbaa97a579f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:47:07 UTC) from {username='kudu', principal='kudu/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:39786
I20260805 22:47:07.817390 17504 raft_consensus.cc:2229] T 4d1fddc3f3374addbc4fccbaa97a579f P 8ac59e7fd4154b20a35f2d22fb730d16 [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:47:07.817507 17504 raft_consensus.cc:2258] T 4d1fddc3f3374addbc4fccbaa97a579f P 8ac59e7fd4154b20a35f2d22fb730d16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:47:07.817955 16781 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54346:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:47:07.818085 16781 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:47:07.818158 17504 ts_tablet_manager.cc:1905] T 4d1fddc3f3374addbc4fccbaa97a579f P 8ac59e7fd4154b20a35f2d22fb730d16: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:47:07.819094 16982 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d1fddc3f3374addbc4fccbaa97a579f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:47:07 UTC) from {username='kudu', principal='kudu/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:55424
I20260805 22:47:07.819411 17505 tablet_replica.cc:330] T 4d1fddc3f3374addbc4fccbaa97a579f P 8f8619d8fa12443691806fbf7707b160: stopping tablet replica
I20260805 22:47:07.819564 17505 raft_consensus.cc:2229] T 4d1fddc3f3374addbc4fccbaa97a579f P 8f8619d8fa12443691806fbf7707b160 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:47:07.819676 16982 tablet_service.cc:1467] Processing CreateTablet for tablet a07234021fb5480bb1c2eca23b192c64 (DEFAULT_TABLE table=test-table [id=a743f5105d6a42d088e36c2cbe4aef0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:47:07.819707 17505 raft_consensus.cc:2258] T 4d1fddc3f3374addbc4fccbaa97a579f P 8f8619d8fa12443691806fbf7707b160 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:47:07.819809 16982 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a07234021fb5480bb1c2eca23b192c64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:07.820088 17504 ts_tablet_manager.cc:1918] T 4d1fddc3f3374addbc4fccbaa97a579f P 8ac59e7fd4154b20a35f2d22fb730d16: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:47:07.820158 17504 log.cc:1196] T 4d1fddc3f3374addbc4fccbaa97a579f P 8ac59e7fd4154b20a35f2d22fb730d16: Deleting WAL directory at /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/ts-2/wal/wals/4d1fddc3f3374addbc4fccbaa97a579f
I20260805 22:47:07.820411 17504 ts_tablet_manager.cc:1939] T 4d1fddc3f3374addbc4fccbaa97a579f P 8ac59e7fd4154b20a35f2d22fb730d16: Deleting consensus metadata
I20260805 22:47:07.820863 17169 tablet_service.cc:1467] Processing CreateTablet for tablet a07234021fb5480bb1c2eca23b192c64 (DEFAULT_TABLE table=test-table [id=a743f5105d6a42d088e36c2cbe4aef0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:47:07.820869 16761 catalog_manager.cc:4841] TS 8ac59e7fd4154b20a35f2d22fb730d16 (127.14.224.131:36753): tablet 4d1fddc3f3374addbc4fccbaa97a579f (table test-table [id=cc63f60742f94204b7dac9671bba7c77]) successfully deleted
I20260805 22:47:07.820988 17169 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a07234021fb5480bb1c2eca23b192c64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:07.821981 17473 tablet_bootstrap.cc:492] T a07234021fb5480bb1c2eca23b192c64 P 8f8619d8fa12443691806fbf7707b160: Bootstrap starting.
I20260805 22:47:07.822031 17350 tablet_service.cc:1467] Processing CreateTablet for tablet a07234021fb5480bb1c2eca23b192c64 (DEFAULT_TABLE table=test-table [id=a743f5105d6a42d088e36c2cbe4aef0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:47:07.822127 17350 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a07234021fb5480bb1c2eca23b192c64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:07.822389 17473 tablet_bootstrap.cc:654] T a07234021fb5480bb1c2eca23b192c64 P 8f8619d8fa12443691806fbf7707b160: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:07.823128 17473 tablet_bootstrap.cc:492] T a07234021fb5480bb1c2eca23b192c64 P 8f8619d8fa12443691806fbf7707b160: No bootstrap required, opened a new log
I20260805 22:47:07.823171 17473 ts_tablet_manager.cc:1397] T a07234021fb5480bb1c2eca23b192c64 P 8f8619d8fa12443691806fbf7707b160: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260805 22:47:07.823328 17471 tablet_bootstrap.cc:492] T a07234021fb5480bb1c2eca23b192c64 P 8ac59e7fd4154b20a35f2d22fb730d16: Bootstrap starting.
I20260805 22:47:07.823408 17470 tablet_bootstrap.cc:492] T a07234021fb5480bb1c2eca23b192c64 P 11a494b057764c20ab99f45811b3f066: Bootstrap starting.
I20260805 22:47:07.823504 17473 raft_consensus.cc:348] T a07234021fb5480bb1c2eca23b192c64 P 8f8619d8fa12443691806fbf7707b160 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11a494b057764c20ab99f45811b3f066" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 32835 } } peers { permanent_uuid: "8f8619d8fa12443691806fbf7707b160" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40061 } } peers { permanent_uuid: "8ac59e7fd4154b20a35f2d22fb730d16" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 36753 } }
I20260805 22:47:07.823582 17473 raft_consensus.cc:374] T a07234021fb5480bb1c2eca23b192c64 P 8f8619d8fa12443691806fbf7707b160 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:07.823604 17473 raft_consensus.cc:729] T a07234021fb5480bb1c2eca23b192c64 P 8f8619d8fa12443691806fbf7707b160 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f8619d8fa12443691806fbf7707b160, State: Initialized, Role: FOLLOWER
I20260805 22:47:07.823650 17473 consensus_queue.cc:260] T a07234021fb5480bb1c2eca23b192c64 P 8f8619d8fa12443691806fbf7707b160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11a494b057764c20ab99f45811b3f066" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 32835 } } peers { permanent_uuid: "8f8619d8fa12443691806fbf7707b160" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40061 } } peers { permanent_uuid: "8ac59e7fd4154b20a35f2d22fb730d16" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 36753 } }
I20260805 22:47:07.823726 17473 ts_tablet_manager.cc:1428] T a07234021fb5480bb1c2eca23b192c64 P 8f8619d8fa12443691806fbf7707b160: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260805 22:47:07.823741 17471 tablet_bootstrap.cc:654] T a07234021fb5480bb1c2eca23b192c64 P 8ac59e7fd4154b20a35f2d22fb730d16: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:07.823820 17470 tablet_bootstrap.cc:654] T a07234021fb5480bb1c2eca23b192c64 P 11a494b057764c20ab99f45811b3f066: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:07.824476 17470 tablet_bootstrap.cc:492] T a07234021fb5480bb1c2eca23b192c64 P 11a494b057764c20ab99f45811b3f066: No bootstrap required, opened a new log
I20260805 22:47:07.824527 17470 ts_tablet_manager.cc:1397] T a07234021fb5480bb1c2eca23b192c64 P 11a494b057764c20ab99f45811b3f066: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260805 22:47:07.824674 17470 raft_consensus.cc:348] T a07234021fb5480bb1c2eca23b192c64 P 11a494b057764c20ab99f45811b3f066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11a494b057764c20ab99f45811b3f066" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 32835 } } peers { permanent_uuid: "8f8619d8fa12443691806fbf7707b160" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40061 } } peers { permanent_uuid: "8ac59e7fd4154b20a35f2d22fb730d16" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 36753 } }
I20260805 22:47:07.824703 17505 ts_tablet_manager.cc:1905] T 4d1fddc3f3374addbc4fccbaa97a579f P 8f8619d8fa12443691806fbf7707b160: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:47:07.824741 17470 raft_consensus.cc:374] T a07234021fb5480bb1c2eca23b192c64 P 11a494b057764c20ab99f45811b3f066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:07.824761 17470 raft_consensus.cc:729] T a07234021fb5480bb1c2eca23b192c64 P 11a494b057764c20ab99f45811b3f066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11a494b057764c20ab99f45811b3f066, State: Initialized, Role: FOLLOWER
I20260805 22:47:07.824802 17470 consensus_queue.cc:260] T a07234021fb5480bb1c2eca23b192c64 P 11a494b057764c20ab99f45811b3f066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11a494b057764c20ab99f45811b3f066" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 32835 } } peers { permanent_uuid: "8f8619d8fa12443691806fbf7707b160" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40061 } } peers { permanent_uuid: "8ac59e7fd4154b20a35f2d22fb730d16" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 36753 } }
I20260805 22:47:07.824898 17470 ts_tablet_manager.cc:1428] T a07234021fb5480bb1c2eca23b192c64 P 11a494b057764c20ab99f45811b3f066: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:07.825934 17508 tablet_replica.cc:330] T 4d1fddc3f3374addbc4fccbaa97a579f P 11a494b057764c20ab99f45811b3f066: stopping tablet replica
I20260805 22:47:07.826069 17508 raft_consensus.cc:2229] T 4d1fddc3f3374addbc4fccbaa97a579f P 11a494b057764c20ab99f45811b3f066 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:47:07.826197 17508 raft_consensus.cc:2258] T 4d1fddc3f3374addbc4fccbaa97a579f P 11a494b057764c20ab99f45811b3f066 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:47:07.826349 17505 ts_tablet_manager.cc:1918] T 4d1fddc3f3374addbc4fccbaa97a579f P 8f8619d8fa12443691806fbf7707b160: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:47:07.826421 17505 log.cc:1196] T 4d1fddc3f3374addbc4fccbaa97a579f P 8f8619d8fa12443691806fbf7707b160: Deleting WAL directory at /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/ts-1/wal/wals/4d1fddc3f3374addbc4fccbaa97a579f
I20260805 22:47:07.826674 17505 ts_tablet_manager.cc:1939] T 4d1fddc3f3374addbc4fccbaa97a579f P 8f8619d8fa12443691806fbf7707b160: Deleting consensus metadata
I20260805 22:47:07.827045 17508 ts_tablet_manager.cc:1905] T 4d1fddc3f3374addbc4fccbaa97a579f P 11a494b057764c20ab99f45811b3f066: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:47:07.827149 16761 catalog_manager.cc:4841] TS 8f8619d8fa12443691806fbf7707b160 (127.14.224.130:40061): tablet 4d1fddc3f3374addbc4fccbaa97a579f (table test-table [id=cc63f60742f94204b7dac9671bba7c77]) successfully deleted
I20260805 22:47:07.827422 17471 tablet_bootstrap.cc:492] T a07234021fb5480bb1c2eca23b192c64 P 8ac59e7fd4154b20a35f2d22fb730d16: No bootstrap required, opened a new log
I20260805 22:47:07.827481 17471 ts_tablet_manager.cc:1397] T a07234021fb5480bb1c2eca23b192c64 P 8ac59e7fd4154b20a35f2d22fb730d16: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260805 22:47:07.827637 17471 raft_consensus.cc:348] T a07234021fb5480bb1c2eca23b192c64 P 8ac59e7fd4154b20a35f2d22fb730d16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11a494b057764c20ab99f45811b3f066" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 32835 } } peers { permanent_uuid: "8f8619d8fa12443691806fbf7707b160" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40061 } } peers { permanent_uuid: "8ac59e7fd4154b20a35f2d22fb730d16" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 36753 } }
I20260805 22:47:07.827715 17471 raft_consensus.cc:374] T a07234021fb5480bb1c2eca23b192c64 P 8ac59e7fd4154b20a35f2d22fb730d16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:07.827734 17471 raft_consensus.cc:729] T a07234021fb5480bb1c2eca23b192c64 P 8ac59e7fd4154b20a35f2d22fb730d16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ac59e7fd4154b20a35f2d22fb730d16, State: Initialized, Role: FOLLOWER
I20260805 22:47:07.827775 17471 consensus_queue.cc:260] T a07234021fb5480bb1c2eca23b192c64 P 8ac59e7fd4154b20a35f2d22fb730d16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11a494b057764c20ab99f45811b3f066" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 32835 } } peers { permanent_uuid: "8f8619d8fa12443691806fbf7707b160" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40061 } } peers { permanent_uuid: "8ac59e7fd4154b20a35f2d22fb730d16" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 36753 } }
I20260805 22:47:07.827857 17471 ts_tablet_manager.cc:1428] T a07234021fb5480bb1c2eca23b192c64 P 8ac59e7fd4154b20a35f2d22fb730d16: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:07.828508 17508 ts_tablet_manager.cc:1918] T 4d1fddc3f3374addbc4fccbaa97a579f P 11a494b057764c20ab99f45811b3f066: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:47:07.828598 17508 log.cc:1196] T 4d1fddc3f3374addbc4fccbaa97a579f P 11a494b057764c20ab99f45811b3f066: Deleting WAL directory at /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/ts-0/wal/wals/4d1fddc3f3374addbc4fccbaa97a579f
I20260805 22:47:07.829093 17508 ts_tablet_manager.cc:1939] T 4d1fddc3f3374addbc4fccbaa97a579f P 11a494b057764c20ab99f45811b3f066: Deleting consensus metadata
I20260805 22:47:07.829450 16761 catalog_manager.cc:4841] TS 11a494b057764c20ab99f45811b3f066 (127.14.224.129:32835): tablet 4d1fddc3f3374addbc4fccbaa97a579f (table test-table [id=cc63f60742f94204b7dac9671bba7c77]) successfully deleted
I20260805 22:47:07.901283 17478 raft_consensus.cc:482] T a07234021fb5480bb1c2eca23b192c64 P 8f8619d8fa12443691806fbf7707b160 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:47:07.901423 17478 raft_consensus.cc:504] T a07234021fb5480bb1c2eca23b192c64 P 8f8619d8fa12443691806fbf7707b160 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11a494b057764c20ab99f45811b3f066" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 32835 } } peers { permanent_uuid: "8f8619d8fa12443691806fbf7707b160" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40061 } } peers { permanent_uuid: "8ac59e7fd4154b20a35f2d22fb730d16" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 36753 } }
I20260805 22:47:07.901644 17478 leader_election.cc:288] T a07234021fb5480bb1c2eca23b192c64 P 8f8619d8fa12443691806fbf7707b160 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11a494b057764c20ab99f45811b3f066 (127.14.224.129:32835), 8ac59e7fd4154b20a35f2d22fb730d16 (127.14.224.131:36753)
I20260805 22:47:07.901934 17010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a07234021fb5480bb1c2eca23b192c64" candidate_uuid: "8f8619d8fa12443691806fbf7707b160" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11a494b057764c20ab99f45811b3f066" is_pre_election: true
I20260805 22:47:07.902055 17010 raft_consensus.cc:2454] T a07234021fb5480bb1c2eca23b192c64 P 11a494b057764c20ab99f45811b3f066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f8619d8fa12443691806fbf7707b160 in term 0.
I20260805 22:47:07.902166 17374 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a07234021fb5480bb1c2eca23b192c64" candidate_uuid: "8f8619d8fa12443691806fbf7707b160" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ac59e7fd4154b20a35f2d22fb730d16" is_pre_election: true
I20260805 22:47:07.902220 17103 leader_election.cc:302] T a07234021fb5480bb1c2eca23b192c64 P 8f8619d8fa12443691806fbf7707b160 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11a494b057764c20ab99f45811b3f066, 8f8619d8fa12443691806fbf7707b160; no voters:
I20260805 22:47:07.902285 17374 raft_consensus.cc:2454] T a07234021fb5480bb1c2eca23b192c64 P 8ac59e7fd4154b20a35f2d22fb730d16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f8619d8fa12443691806fbf7707b160 in term 0.
I20260805 22:47:07.902315 17478 raft_consensus.cc:2781] T a07234021fb5480bb1c2eca23b192c64 P 8f8619d8fa12443691806fbf7707b160 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:47:07.902343 17478 raft_consensus.cc:482] T a07234021fb5480bb1c2eca23b192c64 P 8f8619d8fa12443691806fbf7707b160 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:47:07.902369 17478 raft_consensus.cc:3037] T a07234021fb5480bb1c2eca23b192c64 P 8f8619d8fa12443691806fbf7707b160 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:07.903249 17478 raft_consensus.cc:504] T a07234021fb5480bb1c2eca23b192c64 P 8f8619d8fa12443691806fbf7707b160 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11a494b057764c20ab99f45811b3f066" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 32835 } } peers { permanent_uuid: "8f8619d8fa12443691806fbf7707b160" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40061 } } peers { permanent_uuid: "8ac59e7fd4154b20a35f2d22fb730d16" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 36753 } }
I20260805 22:47:07.903432 17478 leader_election.cc:288] T a07234021fb5480bb1c2eca23b192c64 P 8f8619d8fa12443691806fbf7707b160 [CANDIDATE]: Term 1 election: Requested vote from peers 11a494b057764c20ab99f45811b3f066 (127.14.224.129:32835), 8ac59e7fd4154b20a35f2d22fb730d16 (127.14.224.131:36753)
I20260805 22:47:07.903638 17010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a07234021fb5480bb1c2eca23b192c64" candidate_uuid: "8f8619d8fa12443691806fbf7707b160" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11a494b057764c20ab99f45811b3f066"
I20260805 22:47:07.903728 17010 raft_consensus.cc:3037] T a07234021fb5480bb1c2eca23b192c64 P 11a494b057764c20ab99f45811b3f066 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:07.903702 17374 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a07234021fb5480bb1c2eca23b192c64" candidate_uuid: "8f8619d8fa12443691806fbf7707b160" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ac59e7fd4154b20a35f2d22fb730d16"
I20260805 22:47:07.903774 17374 raft_consensus.cc:3037] T a07234021fb5480bb1c2eca23b192c64 P 8ac59e7fd4154b20a35f2d22fb730d16 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:07.904557 17374 raft_consensus.cc:2454] T a07234021fb5480bb1c2eca23b192c64 P 8ac59e7fd4154b20a35f2d22fb730d16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f8619d8fa12443691806fbf7707b160 in term 1.
I20260805 22:47:07.904557 17010 raft_consensus.cc:2454] T a07234021fb5480bb1c2eca23b192c64 P 11a494b057764c20ab99f45811b3f066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f8619d8fa12443691806fbf7707b160 in term 1.
I20260805 22:47:07.904759 17103 leader_election.cc:302] T a07234021fb5480bb1c2eca23b192c64 P 8f8619d8fa12443691806fbf7707b160 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11a494b057764c20ab99f45811b3f066, 8f8619d8fa12443691806fbf7707b160; no voters:
I20260805 22:47:07.904866 17478 raft_consensus.cc:2781] T a07234021fb5480bb1c2eca23b192c64 P 8f8619d8fa12443691806fbf7707b160 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:47:07.905045 17478 raft_consensus.cc:686] T a07234021fb5480bb1c2eca23b192c64 P 8f8619d8fa12443691806fbf7707b160 [term 1 LEADER]: Becoming Leader. State: Replica: 8f8619d8fa12443691806fbf7707b160, State: Running, Role: LEADER
I20260805 22:47:07.905129 17478 consensus_queue.cc:237] T a07234021fb5480bb1c2eca23b192c64 P 8f8619d8fa12443691806fbf7707b160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11a494b057764c20ab99f45811b3f066" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 32835 } } peers { permanent_uuid: "8f8619d8fa12443691806fbf7707b160" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40061 } } peers { permanent_uuid: "8ac59e7fd4154b20a35f2d22fb730d16" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 36753 } }
I20260805 22:47:07.905933 16781 catalog_manager.cc:5495] T a07234021fb5480bb1c2eca23b192c64 P 8f8619d8fa12443691806fbf7707b160 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f8619d8fa12443691806fbf7707b160 (127.14.224.130). New cstate: current_term: 1 leader_uuid: "8f8619d8fa12443691806fbf7707b160" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11a494b057764c20ab99f45811b3f066" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 32835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f8619d8fa12443691806fbf7707b160" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ac59e7fd4154b20a35f2d22fb730d16" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 36753 } health_report { overall_health: UNKNOWN } } }
Aug 05 22:47:07 dist-test-slave-gjrz krb5kdc[16715](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970026, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.190@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:47:07.966718 16883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:07.960134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54352 (local address 127.14.224.190:41369)
0805 22:47:07.960212 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:07.960215 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:07.960309 (+ 94us) server_negotiation.cc:407] Connection header received
0805 22:47:07.960375 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:07.960375 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:07.960385 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:07.960434 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:07.960923 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:07.961428 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:07.962105 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:07.962295 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:07.962350 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:07.964412 (+ 2062us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:07.964413 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:07.964414 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:07.964421 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:07.965623 (+ 1202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:07.965996 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:07.965997 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:07.965998 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:07.966046 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:07.966211 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:07.966212 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:07.966212 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:07.966319 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:07.966375 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:07.966520 (+ 145us) server_negotiation.cc:299] Negotiation successful
0805 22:47:07.966611 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260805 22:47:07.966794 17523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:07.960053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:41369 (local address 127.0.0.1:54352)
0805 22:47:07.960226 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:07.960237 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:07.960314 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:07.960445 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:07.960446 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:07.960787 (+ 341us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:07.960838 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:07.960841 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:07.961511 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:07.961512 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:07.962028 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:07.962029 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:07.962356 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:07.962357 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:07.962404 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:07.962916 (+ 512us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:07.962921 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:07.964325 (+ 1404us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:07.965698 (+ 1373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:07.965707 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:07.965711 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:07.965906 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:07.966104 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:07.966105 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:07.966105 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:07.966159 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:07.966374 (+ 215us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:07.966383 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:07.966429 (+ 46us) client_negotiation.cc:769] Sending connection context
0805 22:47:07.966496 (+ 67us) client_negotiation.cc:240] Negotiation successful
0805 22:47:07.966681 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"mutex_wait_us":69,"thread_start_us":78,"threads_started":1}
I20260805 22:47:07.969183 16781 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:54352:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260805 22:47:07.969522 16781 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:47:07.971060 17169 tablet_service.cc:1467] Processing CreateTablet for tablet 8cf254299c794141a691a813697b694e (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=42185c2201c041f4930f51cc5b4c0bd8]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260805 22:47:07.971050 17350 tablet_service.cc:1467] Processing CreateTablet for tablet 8cf254299c794141a691a813697b694e (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=42185c2201c041f4930f51cc5b4c0bd8]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260805 22:47:07.971099 16982 tablet_service.cc:1467] Processing CreateTablet for tablet 8cf254299c794141a691a813697b694e (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=42185c2201c041f4930f51cc5b4c0bd8]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260805 22:47:07.971235 16982 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8cf254299c794141a691a813697b694e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:07.971236 17350 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8cf254299c794141a691a813697b694e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:07.971235 17169 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8cf254299c794141a691a813697b694e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:07.973649 17473 tablet_bootstrap.cc:492] T 8cf254299c794141a691a813697b694e P 8f8619d8fa12443691806fbf7707b160: Bootstrap starting.
I20260805 22:47:07.973675 17470 tablet_bootstrap.cc:492] T 8cf254299c794141a691a813697b694e P 11a494b057764c20ab99f45811b3f066: Bootstrap starting.
I20260805 22:47:07.974072 17473 tablet_bootstrap.cc:654] T 8cf254299c794141a691a813697b694e P 8f8619d8fa12443691806fbf7707b160: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:07.974102 17470 tablet_bootstrap.cc:654] T 8cf254299c794141a691a813697b694e P 11a494b057764c20ab99f45811b3f066: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:07.974434 17471 tablet_bootstrap.cc:492] T 8cf254299c794141a691a813697b694e P 8ac59e7fd4154b20a35f2d22fb730d16: Bootstrap starting.
I20260805 22:47:07.974781 17471 tablet_bootstrap.cc:654] T 8cf254299c794141a691a813697b694e P 8ac59e7fd4154b20a35f2d22fb730d16: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:07.974834 17470 tablet_bootstrap.cc:492] T 8cf254299c794141a691a813697b694e P 11a494b057764c20ab99f45811b3f066: No bootstrap required, opened a new log
I20260805 22:47:07.974880 17470 ts_tablet_manager.cc:1397] T 8cf254299c794141a691a813697b694e P 11a494b057764c20ab99f45811b3f066: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260805 22:47:07.975049 17470 raft_consensus.cc:348] T 8cf254299c794141a691a813697b694e P 11a494b057764c20ab99f45811b3f066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f8619d8fa12443691806fbf7707b160" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40061 } } peers { permanent_uuid: "8ac59e7fd4154b20a35f2d22fb730d16" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 36753 } } peers { permanent_uuid: "11a494b057764c20ab99f45811b3f066" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 32835 } }
I20260805 22:47:07.975134 17470 raft_consensus.cc:374] T 8cf254299c794141a691a813697b694e P 11a494b057764c20ab99f45811b3f066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:07.975155 17470 raft_consensus.cc:729] T 8cf254299c794141a691a813697b694e P 11a494b057764c20ab99f45811b3f066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11a494b057764c20ab99f45811b3f066, State: Initialized, Role: FOLLOWER
I20260805 22:47:07.975206 17470 consensus_queue.cc:260] T 8cf254299c794141a691a813697b694e P 11a494b057764c20ab99f45811b3f066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f8619d8fa12443691806fbf7707b160" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40061 } } peers { permanent_uuid: "8ac59e7fd4154b20a35f2d22fb730d16" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 36753 } } peers { permanent_uuid: "11a494b057764c20ab99f45811b3f066" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 32835 } }
I20260805 22:47:07.975324 17470 ts_tablet_manager.cc:1428] T 8cf254299c794141a691a813697b694e P 11a494b057764c20ab99f45811b3f066: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260805 22:47:07.975368 17471 tablet_bootstrap.cc:492] T 8cf254299c794141a691a813697b694e P 8ac59e7fd4154b20a35f2d22fb730d16: No bootstrap required, opened a new log
I20260805 22:47:07.975407 17471 ts_tablet_manager.cc:1397] T 8cf254299c794141a691a813697b694e P 8ac59e7fd4154b20a35f2d22fb730d16: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260805 22:47:07.975394 17480 tablet_replica.cc:439] T 8cf254299c794141a691a813697b694e P 11a494b057764c20ab99f45811b3f066: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f8619d8fa12443691806fbf7707b160" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40061 } } peers { permanent_uuid: "8ac59e7fd4154b20a35f2d22fb730d16" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 36753 } } peers { permanent_uuid: "11a494b057764c20ab99f45811b3f066" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 32835 } } }
I20260805 22:47:07.975510 17480 tablet_replica.cc:442] T 8cf254299c794141a691a813697b694e P 11a494b057764c20ab99f45811b3f066: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 22:47:07.975536 17471 raft_consensus.cc:348] T 8cf254299c794141a691a813697b694e P 8ac59e7fd4154b20a35f2d22fb730d16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f8619d8fa12443691806fbf7707b160" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40061 } } peers { permanent_uuid: "8ac59e7fd4154b20a35f2d22fb730d16" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 36753 } } peers { permanent_uuid: "11a494b057764c20ab99f45811b3f066" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 32835 } }
I20260805 22:47:07.975603 17471 raft_consensus.cc:374] T 8cf254299c794141a691a813697b694e P 8ac59e7fd4154b20a35f2d22fb730d16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:07.975620 17471 raft_consensus.cc:729] T 8cf254299c794141a691a813697b694e P 8ac59e7fd4154b20a35f2d22fb730d16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ac59e7fd4154b20a35f2d22fb730d16, State: Initialized, Role: FOLLOWER
I20260805 22:47:07.975666 17473 tablet_bootstrap.cc:492] T 8cf254299c794141a691a813697b694e P 8f8619d8fa12443691806fbf7707b160: No bootstrap required, opened a new log
I20260805 22:47:07.975665 17471 consensus_queue.cc:260] T 8cf254299c794141a691a813697b694e P 8ac59e7fd4154b20a35f2d22fb730d16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f8619d8fa12443691806fbf7707b160" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40061 } } peers { permanent_uuid: "8ac59e7fd4154b20a35f2d22fb730d16" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 36753 } } peers { permanent_uuid: "11a494b057764c20ab99f45811b3f066" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 32835 } }
I20260805 22:47:07.975709 17473 ts_tablet_manager.cc:1397] T 8cf254299c794141a691a813697b694e P 8f8619d8fa12443691806fbf7707b160: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260805 22:47:07.975750 17471 ts_tablet_manager.cc:1428] T 8cf254299c794141a691a813697b694e P 8ac59e7fd4154b20a35f2d22fb730d16: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:07.975804 17495 tablet_replica.cc:439] T 8cf254299c794141a691a813697b694e P 8ac59e7fd4154b20a35f2d22fb730d16: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f8619d8fa12443691806fbf7707b160" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40061 } } peers { permanent_uuid: "8ac59e7fd4154b20a35f2d22fb730d16" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 36753 } } peers { permanent_uuid: "11a494b057764c20ab99f45811b3f066" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 32835 } } }
I20260805 22:47:07.975862 17473 raft_consensus.cc:348] T 8cf254299c794141a691a813697b694e P 8f8619d8fa12443691806fbf7707b160 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f8619d8fa12443691806fbf7707b160" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40061 } } peers { permanent_uuid: "8ac59e7fd4154b20a35f2d22fb730d16" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 36753 } } peers { permanent_uuid: "11a494b057764c20ab99f45811b3f066" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 32835 } }
I20260805 22:47:07.975941 17473 raft_consensus.cc:374] T 8cf254299c794141a691a813697b694e P 8f8619d8fa12443691806fbf7707b160 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:07.975924 17495 tablet_replica.cc:442] T 8cf254299c794141a691a813697b694e P 8ac59e7fd4154b20a35f2d22fb730d16: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 22:47:07.975958 17473 raft_consensus.cc:729] T 8cf254299c794141a691a813697b694e P 8f8619d8fa12443691806fbf7707b160 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f8619d8fa12443691806fbf7707b160, State: Initialized, Role: FOLLOWER
I20260805 22:47:07.976001 17473 consensus_queue.cc:260] T 8cf254299c794141a691a813697b694e P 8f8619d8fa12443691806fbf7707b160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f8619d8fa12443691806fbf7707b160" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40061 } } peers { permanent_uuid: "8ac59e7fd4154b20a35f2d22fb730d16" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 36753 } } peers { permanent_uuid: "11a494b057764c20ab99f45811b3f066" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 32835 } }
I20260805 22:47:07.976080 17473 ts_tablet_manager.cc:1428] T 8cf254299c794141a691a813697b694e P 8f8619d8fa12443691806fbf7707b160: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:07.976135 17478 tablet_replica.cc:439] T 8cf254299c794141a691a813697b694e P 8f8619d8fa12443691806fbf7707b160: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f8619d8fa12443691806fbf7707b160" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40061 } } peers { permanent_uuid: "8ac59e7fd4154b20a35f2d22fb730d16" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 36753 } } peers { permanent_uuid: "11a494b057764c20ab99f45811b3f066" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 32835 } } }
I20260805 22:47:07.976194 17478 tablet_replica.cc:442] T 8cf254299c794141a691a813697b694e P 8f8619d8fa12443691806fbf7707b160: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 22:47:07.988953 17495 raft_consensus.cc:482] T 8cf254299c794141a691a813697b694e P 8ac59e7fd4154b20a35f2d22fb730d16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:47:07.989058 17495 raft_consensus.cc:504] T 8cf254299c794141a691a813697b694e P 8ac59e7fd4154b20a35f2d22fb730d16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f8619d8fa12443691806fbf7707b160" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40061 } } peers { permanent_uuid: "8ac59e7fd4154b20a35f2d22fb730d16" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 36753 } } peers { permanent_uuid: "11a494b057764c20ab99f45811b3f066" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 32835 } }
I20260805 22:47:07.989197 17495 leader_election.cc:288] T 8cf254299c794141a691a813697b694e P 8ac59e7fd4154b20a35f2d22fb730d16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f8619d8fa12443691806fbf7707b160 (127.14.224.130:40061), 11a494b057764c20ab99f45811b3f066 (127.14.224.129:32835)
I20260805 22:47:07.989403 17192 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cf254299c794141a691a813697b694e" candidate_uuid: "8ac59e7fd4154b20a35f2d22fb730d16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f8619d8fa12443691806fbf7707b160" is_pre_election: true
I20260805 22:47:07.989490 17192 raft_consensus.cc:2454] T 8cf254299c794141a691a813697b694e P 8f8619d8fa12443691806fbf7707b160 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ac59e7fd4154b20a35f2d22fb730d16 in term 0.
I20260805 22:47:07.989439 17010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cf254299c794141a691a813697b694e" candidate_uuid: "8ac59e7fd4154b20a35f2d22fb730d16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11a494b057764c20ab99f45811b3f066" is_pre_election: true
I20260805 22:47:07.989543 17010 raft_consensus.cc:2454] T 8cf254299c794141a691a813697b694e P 11a494b057764c20ab99f45811b3f066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ac59e7fd4154b20a35f2d22fb730d16 in term 0.
I20260805 22:47:07.989656 17292 leader_election.cc:302] T 8cf254299c794141a691a813697b694e P 8ac59e7fd4154b20a35f2d22fb730d16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ac59e7fd4154b20a35f2d22fb730d16, 8f8619d8fa12443691806fbf7707b160; no voters:
I20260805 22:47:07.989763 17495 raft_consensus.cc:2781] T 8cf254299c794141a691a813697b694e P 8ac59e7fd4154b20a35f2d22fb730d16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:47:07.989811 17495 raft_consensus.cc:482] T 8cf254299c794141a691a813697b694e P 8ac59e7fd4154b20a35f2d22fb730d16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:47:07.989825 17495 raft_consensus.cc:3037] T 8cf254299c794141a691a813697b694e P 8ac59e7fd4154b20a35f2d22fb730d16 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:07.990542 17495 raft_consensus.cc:504] T 8cf254299c794141a691a813697b694e P 8ac59e7fd4154b20a35f2d22fb730d16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f8619d8fa12443691806fbf7707b160" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40061 } } peers { permanent_uuid: "8ac59e7fd4154b20a35f2d22fb730d16" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 36753 } } peers { permanent_uuid: "11a494b057764c20ab99f45811b3f066" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 32835 } }
I20260805 22:47:07.990665 17495 leader_election.cc:288] T 8cf254299c794141a691a813697b694e P 8ac59e7fd4154b20a35f2d22fb730d16 [CANDIDATE]: Term 1 election: Requested vote from peers 8f8619d8fa12443691806fbf7707b160 (127.14.224.130:40061), 11a494b057764c20ab99f45811b3f066 (127.14.224.129:32835)
I20260805 22:47:07.990916 17192 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cf254299c794141a691a813697b694e" candidate_uuid: "8ac59e7fd4154b20a35f2d22fb730d16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f8619d8fa12443691806fbf7707b160"
I20260805 22:47:07.990916 17010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cf254299c794141a691a813697b694e" candidate_uuid: "8ac59e7fd4154b20a35f2d22fb730d16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11a494b057764c20ab99f45811b3f066"
I20260805 22:47:07.991005 17192 raft_consensus.cc:3037] T 8cf254299c794141a691a813697b694e P 8f8619d8fa12443691806fbf7707b160 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:07.991019 17010 raft_consensus.cc:3037] T 8cf254299c794141a691a813697b694e P 11a494b057764c20ab99f45811b3f066 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:07.991693 17010 raft_consensus.cc:2454] T 8cf254299c794141a691a813697b694e P 11a494b057764c20ab99f45811b3f066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ac59e7fd4154b20a35f2d22fb730d16 in term 1.
I20260805 22:47:07.991843 17192 raft_consensus.cc:2454] T 8cf254299c794141a691a813697b694e P 8f8619d8fa12443691806fbf7707b160 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ac59e7fd4154b20a35f2d22fb730d16 in term 1.
I20260805 22:47:07.991888 17292 leader_election.cc:302] T 8cf254299c794141a691a813697b694e P 8ac59e7fd4154b20a35f2d22fb730d16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11a494b057764c20ab99f45811b3f066, 8ac59e7fd4154b20a35f2d22fb730d16; no voters:
I20260805 22:47:07.991990 17495 raft_consensus.cc:2781] T 8cf254299c794141a691a813697b694e P 8ac59e7fd4154b20a35f2d22fb730d16 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:47:07.992057 17495 raft_consensus.cc:686] T 8cf254299c794141a691a813697b694e P 8ac59e7fd4154b20a35f2d22fb730d16 [term 1 LEADER]: Becoming Leader. State: Replica: 8ac59e7fd4154b20a35f2d22fb730d16, State: Running, Role: LEADER
I20260805 22:47:07.992117 17495 consensus_queue.cc:237] T 8cf254299c794141a691a813697b694e P 8ac59e7fd4154b20a35f2d22fb730d16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f8619d8fa12443691806fbf7707b160" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40061 } } peers { permanent_uuid: "8ac59e7fd4154b20a35f2d22fb730d16" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 36753 } } peers { permanent_uuid: "11a494b057764c20ab99f45811b3f066" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 32835 } }
I20260805 22:47:07.992444 17477 tablet_replica.cc:439] T 8cf254299c794141a691a813697b694e P 8ac59e7fd4154b20a35f2d22fb730d16: TxnStatusTablet state changed. Reason: New leader 8ac59e7fd4154b20a35f2d22fb730d16. Latest consensus state: current_term: 1 leader_uuid: "8ac59e7fd4154b20a35f2d22fb730d16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f8619d8fa12443691806fbf7707b160" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40061 } } peers { permanent_uuid: "8ac59e7fd4154b20a35f2d22fb730d16" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 36753 } } peers { permanent_uuid: "11a494b057764c20ab99f45811b3f066" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 32835 } } }
I20260805 22:47:07.992535 17477 tablet_replica.cc:442] T 8cf254299c794141a691a813697b694e P 8ac59e7fd4154b20a35f2d22fb730d16: This TxnStatusTablet replica's current role is: LEADER
I20260805 22:47:07.992727 17529 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260805 22:47:07.992830 17529 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260805 22:47:07.992787 16781 catalog_manager.cc:5495] T 8cf254299c794141a691a813697b694e P 8ac59e7fd4154b20a35f2d22fb730d16 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ac59e7fd4154b20a35f2d22fb730d16 (127.14.224.131). New cstate: current_term: 1 leader_uuid: "8ac59e7fd4154b20a35f2d22fb730d16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f8619d8fa12443691806fbf7707b160" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ac59e7fd4154b20a35f2d22fb730d16" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 36753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11a494b057764c20ab99f45811b3f066" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 32835 } health_report { overall_health: UNKNOWN } } }
I20260805 22:47:08.006038 17464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:08.002722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51930 (local address 127.14.224.131:36753)
0805 22:47:08.002782 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:08.002784 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:08.002866 (+ 82us) server_negotiation.cc:407] Connection header received
0805 22:47:08.002958 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:08.002959 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:08.002972 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:08.003019 (+ 47us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:47:08.003310 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:08.004055 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:08.005339 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:08.005542 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:08.005608 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:08.005811 (+ 203us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:47:08.005843 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:47:08.005876 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:08.005946 (+ 70us) server_negotiation.cc:299] Negotiation successful
0805 22:47:08.005969 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260805 22:47:08.006101 17523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:08.002647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.131:36753 (local address 127.0.0.1:51930)
0805 22:47:08.002805 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:08.002818 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:08.002888 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:08.003085 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:08.003086 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:08.003087 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0805 22:47:08.003157 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:08.003159 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:08.004272 (+ 1113us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:08.004273 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:08.005221 (+ 948us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:08.005225 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:08.005625 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:08.005626 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:08.005690 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:08.005720 (+ 30us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0805 22:47:08.005889 (+ 169us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0805 22:47:08.005896 (+ 7us) client_negotiation.cc:769] Sending connection context
0805 22:47:08.005944 (+ 48us) client_negotiation.cc:240] Negotiation successful
0805 22:47:08.005999 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112}
I20260805 22:47:08.007349 17010 raft_consensus.cc:1261] T 8cf254299c794141a691a813697b694e P 11a494b057764c20ab99f45811b3f066 [term 1 FOLLOWER]: Refusing update from remote peer 8ac59e7fd4154b20a35f2d22fb730d16: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:47:08.007339 17192 raft_consensus.cc:1261] T 8cf254299c794141a691a813697b694e P 8f8619d8fa12443691806fbf7707b160 [term 1 FOLLOWER]: Refusing update from remote peer 8ac59e7fd4154b20a35f2d22fb730d16: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:47:08.007606 17477 consensus_queue.cc:1035] T 8cf254299c794141a691a813697b694e P 8ac59e7fd4154b20a35f2d22fb730d16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11a494b057764c20ab99f45811b3f066" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:47:08.007740 17495 consensus_queue.cc:1035] T 8cf254299c794141a691a813697b694e P 8ac59e7fd4154b20a35f2d22fb730d16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f8619d8fa12443691806fbf7707b160" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:47:08.008158 17480 tablet_replica.cc:439] T 8cf254299c794141a691a813697b694e P 11a494b057764c20ab99f45811b3f066: TxnStatusTablet state changed. Reason: New leader 8ac59e7fd4154b20a35f2d22fb730d16. Latest consensus state: current_term: 1 leader_uuid: "8ac59e7fd4154b20a35f2d22fb730d16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f8619d8fa12443691806fbf7707b160" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40061 } } peers { permanent_uuid: "8ac59e7fd4154b20a35f2d22fb730d16" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 36753 } } peers { permanent_uuid: "11a494b057764c20ab99f45811b3f066" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 32835 } } }
I20260805 22:47:08.008255 17480 tablet_replica.cc:442] T 8cf254299c794141a691a813697b694e P 11a494b057764c20ab99f45811b3f066: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 22:47:08.008409 17478 tablet_replica.cc:439] T 8cf254299c794141a691a813697b694e P 8f8619d8fa12443691806fbf7707b160: TxnStatusTablet state changed. Reason: New leader 8ac59e7fd4154b20a35f2d22fb730d16. Latest consensus state: current_term: 1 leader_uuid: "8ac59e7fd4154b20a35f2d22fb730d16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f8619d8fa12443691806fbf7707b160" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40061 } } peers { permanent_uuid: "8ac59e7fd4154b20a35f2d22fb730d16" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 36753 } } peers { permanent_uuid: "11a494b057764c20ab99f45811b3f066" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 32835 } } }
I20260805 22:47:08.008493 17478 tablet_replica.cc:442] T 8cf254299c794141a691a813697b694e P 8f8619d8fa12443691806fbf7707b160: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 22:47:08.009411 17483 tablet_replica.cc:439] T 8cf254299c794141a691a813697b694e P 8ac59e7fd4154b20a35f2d22fb730d16: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8ac59e7fd4154b20a35f2d22fb730d16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f8619d8fa12443691806fbf7707b160" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40061 } } peers { permanent_uuid: "8ac59e7fd4154b20a35f2d22fb730d16" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 36753 } } peers { permanent_uuid: "11a494b057764c20ab99f45811b3f066" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 32835 } } }
I20260805 22:47:08.009507 17483 tablet_replica.cc:442] T 8cf254299c794141a691a813697b694e P 8ac59e7fd4154b20a35f2d22fb730d16: This TxnStatusTablet replica's current role is: LEADER
I20260805 22:47:08.010000 17492 mvcc.cc:205] Tried to move back new op lower bound from 7315333234716123136 to 7315333234656174080. Current Snapshot: MvccSnapshot[applied={T|T < 7315333234716123136 or (T in {7315333234716123136})}]
I20260805 22:47:08.010183 17480 tablet_replica.cc:439] T 8cf254299c794141a691a813697b694e P 11a494b057764c20ab99f45811b3f066: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8ac59e7fd4154b20a35f2d22fb730d16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f8619d8fa12443691806fbf7707b160" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40061 } } peers { permanent_uuid: "8ac59e7fd4154b20a35f2d22fb730d16" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 36753 } } peers { permanent_uuid: "11a494b057764c20ab99f45811b3f066" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 32835 } } }
I20260805 22:47:08.010275 17480 tablet_replica.cc:442] T 8cf254299c794141a691a813697b694e P 11a494b057764c20ab99f45811b3f066: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 22:47:08.012040 17483 tablet_replica.cc:439] T 8cf254299c794141a691a813697b694e P 8ac59e7fd4154b20a35f2d22fb730d16: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8ac59e7fd4154b20a35f2d22fb730d16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f8619d8fa12443691806fbf7707b160" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40061 } } peers { permanent_uuid: "8ac59e7fd4154b20a35f2d22fb730d16" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 36753 } } peers { permanent_uuid: "11a494b057764c20ab99f45811b3f066" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 32835 } } }
I20260805 22:47:08.012154 17483 tablet_replica.cc:442] T 8cf254299c794141a691a813697b694e P 8ac59e7fd4154b20a35f2d22fb730d16: This TxnStatusTablet replica's current role is: LEADER
I20260805 22:47:08.012809 17478 tablet_replica.cc:439] T 8cf254299c794141a691a813697b694e P 8f8619d8fa12443691806fbf7707b160: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8ac59e7fd4154b20a35f2d22fb730d16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f8619d8fa12443691806fbf7707b160" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40061 } } peers { permanent_uuid: "8ac59e7fd4154b20a35f2d22fb730d16" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 36753 } } peers { permanent_uuid: "11a494b057764c20ab99f45811b3f066" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 32835 } } }
I20260805 22:47:08.013756 17478 tablet_replica.cc:442] T 8cf254299c794141a691a813697b694e P 8f8619d8fa12443691806fbf7707b160: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 22:47:08.014642 17469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:08.011574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39788 (local address 127.14.224.130:40061)
0805 22:47:08.011615 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:08.011617 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:08.011623 (+ 6us) server_negotiation.cc:407] Connection header received
0805 22:47:08.011662 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:08.011663 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:08.011684 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:08.011754 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:47:08.011889 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:08.012566 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:08.013683 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:08.014004 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:08.014088 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:08.014250 (+ 162us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:47:08.014396 (+ 146us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:47:08.014466 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:08.014559 (+ 93us) server_negotiation.cc:299] Negotiation successful
0805 22:47:08.014588 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260805 22:47:08.020215 17464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:08.017364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:54641 (local address 127.14.224.131:36753)
0805 22:47:08.017415 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:08.017417 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:08.017510 (+ 93us) server_negotiation.cc:407] Connection header received
0805 22:47:08.017616 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:08.017617 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:08.017627 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:08.017664 (+ 37us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:47:08.017801 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:08.018316 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:08.019460 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:08.019648 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:08.019694 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:08.019934 (+ 240us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:47:08.019964 (+ 30us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:47:08.020024 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:08.020110 (+ 86us) server_negotiation.cc:299] Negotiation successful
0805 22:47:08.020130 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260805 22:47:08.020239 17537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:08.017254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.131:36753 (local address 127.14.224.130:54641)
0805 22:47:08.017438 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:08.017450 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:08.017539 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:08.017670 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:08.017671 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:08.017672 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0805 22:47:08.017745 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:08.017747 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:08.018387 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:08.018388 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:08.019372 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:08.019376 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:08.019751 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:08.019753 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:08.019830 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:08.019851 (+ 21us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0805 22:47:08.020047 (+ 196us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0805 22:47:08.020050 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:47:08.020095 (+ 45us) client_negotiation.cc:240] Negotiation successful
0805 22:47:08.020145 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":106,"threads_started":1}
I20260805 22:47:08.023003 17010 raft_consensus.cc:1261] T a07234021fb5480bb1c2eca23b192c64 P 11a494b057764c20ab99f45811b3f066 [term 1 FOLLOWER]: Refusing update from remote peer 8f8619d8fa12443691806fbf7707b160: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:47:08.023046 17374 raft_consensus.cc:1261] T a07234021fb5480bb1c2eca23b192c64 P 8ac59e7fd4154b20a35f2d22fb730d16 [term 1 FOLLOWER]: Refusing update from remote peer 8f8619d8fa12443691806fbf7707b160: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:47:08.023520 17513 consensus_queue.cc:1035] T a07234021fb5480bb1c2eca23b192c64 P 8f8619d8fa12443691806fbf7707b160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ac59e7fd4154b20a35f2d22fb730d16" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 36753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:47:08.023681 17478 consensus_queue.cc:1035] T a07234021fb5480bb1c2eca23b192c64 P 8f8619d8fa12443691806fbf7707b160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11a494b057764c20ab99f45811b3f066" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:47:08.025187 17488 mvcc.cc:205] Tried to move back new op lower bound from 7315333234780381184 to 7315333234300145664. Current Snapshot: MvccSnapshot[applied={T|T < 7315333234780381184}]
I20260805 22:47:08.033911 17469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:08.030639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:34029 (local address 127.14.224.130:40061)
0805 22:47:08.030679 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:08.030681 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:08.031462 (+ 781us) server_negotiation.cc:407] Connection header received
0805 22:47:08.031521 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:08.031522 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:08.031534 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:08.031583 (+ 49us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:47:08.031711 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:08.032182 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:08.033282 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:08.033481 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:08.033540 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:08.033702 (+ 162us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:47:08.033729 (+ 27us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:47:08.033760 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:08.033824 (+ 64us) server_negotiation.cc:299] Negotiation successful
0805 22:47:08.033842 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260805 22:47:08.033958 17542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:08.030608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.130:40061 (local address 127.14.224.131:34029)
0805 22:47:08.031383 (+ 775us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:08.031397 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:08.031462 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:08.031596 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:08.031597 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:08.031599 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0805 22:47:08.031657 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:08.031659 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:08.032254 (+ 595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:08.032255 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:08.033190 (+ 935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:08.033193 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:08.033551 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:08.033552 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:08.033611 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:08.033630 (+ 19us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0805 22:47:08.033774 (+ 144us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0805 22:47:08.033775 (+ 1us) client_negotiation.cc:769] Sending connection context
0805 22:47:08.033821 (+ 46us) client_negotiation.cc:240] Negotiation successful
0805 22:47:08.033870 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":729,"thread_start_us":89,"threads_started":1}
I20260805 22:47:08.042769 16781 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54346:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:47:08.042883 16781 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54346:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:47:08.043524 16781 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3787ee696aba431796bfff99173b09ef: Sending DeleteTablet for 3 replicas of tablet a07234021fb5480bb1c2eca23b192c64
I20260805 22:47:08.043812 16982 tablet_service.cc:1514] Processing DeleteTablet for tablet a07234021fb5480bb1c2eca23b192c64 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:47:08 UTC) from {username='kudu', principal='kudu/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:55424
I20260805 22:47:08.043861 17169 tablet_service.cc:1514] Processing DeleteTablet for tablet a07234021fb5480bb1c2eca23b192c64 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:47:08 UTC) from {username='kudu', principal='kudu/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:39786
I20260805 22:47:08.043951 17508 tablet_replica.cc:330] T a07234021fb5480bb1c2eca23b192c64 P 11a494b057764c20ab99f45811b3f066: stopping tablet replica
I20260805 22:47:08.044010 17508 raft_consensus.cc:2229] T a07234021fb5480bb1c2eca23b192c64 P 11a494b057764c20ab99f45811b3f066 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:47:08.044045 17508 raft_consensus.cc:2258] T a07234021fb5480bb1c2eca23b192c64 P 11a494b057764c20ab99f45811b3f066 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:47:08.044114 17505 tablet_replica.cc:330] T a07234021fb5480bb1c2eca23b192c64 P 8f8619d8fa12443691806fbf7707b160: stopping tablet replica
I20260805 22:47:08.044163 17505 raft_consensus.cc:2229] T a07234021fb5480bb1c2eca23b192c64 P 8f8619d8fa12443691806fbf7707b160 [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:47:08.044234 17505 raft_consensus.cc:2258] T a07234021fb5480bb1c2eca23b192c64 P 8f8619d8fa12443691806fbf7707b160 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:47:08.044363 17350 tablet_service.cc:1514] Processing DeleteTablet for tablet a07234021fb5480bb1c2eca23b192c64 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:47:08 UTC) from {username='kudu', principal='kudu/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:51916
I20260805 22:47:08.044499 17504 tablet_replica.cc:330] T a07234021fb5480bb1c2eca23b192c64 P 8ac59e7fd4154b20a35f2d22fb730d16: stopping tablet replica
I20260805 22:47:08.044561 17504 raft_consensus.cc:2229] T a07234021fb5480bb1c2eca23b192c64 P 8ac59e7fd4154b20a35f2d22fb730d16 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:47:08.044603 17504 raft_consensus.cc:2258] T a07234021fb5480bb1c2eca23b192c64 P 8ac59e7fd4154b20a35f2d22fb730d16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:47:08.044836 17505 ts_tablet_manager.cc:1905] T a07234021fb5480bb1c2eca23b192c64 P 8f8619d8fa12443691806fbf7707b160: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:47:08.044934 17504 ts_tablet_manager.cc:1905] T a07234021fb5480bb1c2eca23b192c64 P 8ac59e7fd4154b20a35f2d22fb730d16: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:47:08.046737 17505 ts_tablet_manager.cc:1918] T a07234021fb5480bb1c2eca23b192c64 P 8f8619d8fa12443691806fbf7707b160: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260805 22:47:08.046797 17505 log.cc:1196] T a07234021fb5480bb1c2eca23b192c64 P 8f8619d8fa12443691806fbf7707b160: Deleting WAL directory at /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/ts-1/wal/wals/a07234021fb5480bb1c2eca23b192c64
I20260805 22:47:08.046996 17505 ts_tablet_manager.cc:1939] T a07234021fb5480bb1c2eca23b192c64 P 8f8619d8fa12443691806fbf7707b160: Deleting consensus metadata
I20260805 22:47:08.047367 17504 ts_tablet_manager.cc:1918] T a07234021fb5480bb1c2eca23b192c64 P 8ac59e7fd4154b20a35f2d22fb730d16: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260805 22:47:08.047425 17504 log.cc:1196] T a07234021fb5480bb1c2eca23b192c64 P 8ac59e7fd4154b20a35f2d22fb730d16: Deleting WAL directory at /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/ts-2/wal/wals/a07234021fb5480bb1c2eca23b192c64
I20260805 22:47:08.047438 16761 catalog_manager.cc:4841] TS 8f8619d8fa12443691806fbf7707b160 (127.14.224.130:40061): tablet a07234021fb5480bb1c2eca23b192c64 (table test-table [id=a743f5105d6a42d088e36c2cbe4aef0d]) successfully deleted
I20260805 22:47:08.047611 17504 ts_tablet_manager.cc:1939] T a07234021fb5480bb1c2eca23b192c64 P 8ac59e7fd4154b20a35f2d22fb730d16: Deleting consensus metadata
I20260805 22:47:08.047778 17508 ts_tablet_manager.cc:1905] T a07234021fb5480bb1c2eca23b192c64 P 11a494b057764c20ab99f45811b3f066: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:47:08.048039 16761 catalog_manager.cc:4841] TS 8ac59e7fd4154b20a35f2d22fb730d16 (127.14.224.131:36753): tablet a07234021fb5480bb1c2eca23b192c64 (table test-table [id=a743f5105d6a42d088e36c2cbe4aef0d]) successfully deleted
I20260805 22:47:08.049180 17508 ts_tablet_manager.cc:1918] T a07234021fb5480bb1c2eca23b192c64 P 11a494b057764c20ab99f45811b3f066: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260805 22:47:08.049240 17508 log.cc:1196] T a07234021fb5480bb1c2eca23b192c64 P 11a494b057764c20ab99f45811b3f066: Deleting WAL directory at /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970021300824-15234-0/minicluster-data/ts-0/wal/wals/a07234021fb5480bb1c2eca23b192c64
I20260805 22:47:08.049454 17508 ts_tablet_manager.cc:1939] T a07234021fb5480bb1c2eca23b192c64 P 11a494b057764c20ab99f45811b3f066: Deleting consensus metadata
I20260805 22:47:08.049834 16761 catalog_manager.cc:4841] TS 11a494b057764c20ab99f45811b3f066 (127.14.224.129:32835): tablet a07234021fb5480bb1c2eca23b192c64 (table test-table [id=a743f5105d6a42d088e36c2cbe4aef0d]) successfully deleted
Aug 05 22:47:08 dist-test-slave-gjrz krb5kdc[16715](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970027, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.14.224.129@KRBTEST.COM
I20260805 22:47:08.057909 17467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:08.049214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55432 (local address 127.14.224.129:32835)
0805 22:47:08.049257 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:08.049259 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:08.049577 (+ 318us) server_negotiation.cc:407] Connection header received
0805 22:47:08.049675 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:08.049676 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:08.049689 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:08.049720 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:08.050368 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:08.050846 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:08.051681 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:08.051883 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:08.052059 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:08.054980 (+ 2921us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:08.054993 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:08.054993 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:08.055002 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:08.056693 (+ 1691us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:08.057071 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:08.057076 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:08.057076 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:08.057159 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:08.057339 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:08.057340 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:08.057340 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:08.057504 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:08.057655 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:08.057720 (+ 65us) server_negotiation.cc:299] Negotiation successful
0805 22:47:08.057809 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
W20260805 22:47:08.058288 17062 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55432
I20260805 22:47:08.065559 16883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:08.059237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54354 (local address 127.14.224.190:41369)
0805 22:47:08.059314 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:08.059316 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:08.059496 (+ 180us) server_negotiation.cc:407] Connection header received
0805 22:47:08.059558 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:08.059559 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:08.059570 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:08.059616 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:08.060112 (+ 496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:08.060628 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:08.061339 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:08.061550 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:08.061605 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:08.062795 (+ 1190us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:08.062797 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:08.062798 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:08.062806 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:08.064413 (+ 1607us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:08.064771 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:08.064772 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:08.064772 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:08.064830 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:08.065035 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:08.065036 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:08.065036 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:08.065159 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:08.065252 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:08.065371 (+ 119us) server_negotiation.cc:299] Negotiation successful
0805 22:47:08.065463 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
W20260805 22:47:08.065881 16781 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54354
I20260805 22:47:08.066586 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 16894
I20260805 22:47:08.104511 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 17080
I20260805 22:47:08.116730 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 17274
I20260805 22:47:08.130630 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 16734
2026-08-05T22:47:08Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2591 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:47:08 dist-test-slave-gjrz krb5kdc[17552](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:47:08 dist-test-slave-gjrz krb5kdc[17552](info): set up 2 sockets
Aug 05 22:47:08 dist-test-slave-gjrz krb5kdc[17552](info): commencing operation
krb5kdc: starting...
W20260805 22:47:09.279570 15234 mini_kdc.cc:121] Time spent starting KDC: real 1.116s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Aug 05 22:47:09 dist-test-slave-gjrz krb5kdc[17552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970029, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:47:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:47:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.224.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab.
Entry for principal kudu/127.14.224.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab.
I20260805 22:47:09.406947 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:44731
--webserver_interface=127.14.224.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:35111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.224.190:44731
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:47:09.492707 17569 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:09.493002 17569 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:09.493037 17569 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:09.494714 17569 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:47:09.494779 17569 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260805 22:47:09.494797 17569 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:09.494815 17569 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:09.494831 17569 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:47:09.494848 17569 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:47:09.496888 17569 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:35111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.224.190:44731
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:44731
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.224.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17569
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:09.497177 17569 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:09.497445 17569 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:09.502640 17576 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:09.502722 17569 server_base.cc:1034] running on GCE node
W20260805 22:47:09.502664 17580 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:09.502664 17577 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:09.503062 17569 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:09.503434 17569 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:09.504599 17569 hybrid_clock.cc:648] HybridClock initialized: now 1785970029504583 us; error 34 us; skew 500 ppm
Aug 05 22:47:09 dist-test-slave-gjrz krb5kdc[17552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970029, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:09.507215 17569 init.cc:377] Logged in from keytab as kudu/127.14.224.190@KRBTEST.COM (short username kudu)
I20260805 22:47:09.507685 17569 webserver.cc:460] Webserver started at http://127.14.224.190:39435/ using document root <none> and password file <none>
I20260805 22:47:09.507908 17569 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:09.507959 17569 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:09.508090 17569 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:09.509182 17569 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/master-0/data/instance:
uuid: "24e02d789cd748848fdaef4d12844340"
format_stamp: "Formatted at 2026-08-05 22:47:09 on dist-test-slave-gjrz"
server_key: "378f9cfd4a07b0023b5ba6d74f5f1cf7"
server_key_iv: "890602aadd6dc50a0b2b8764b3422470"
server_key_version: "encryptionkey@0"
I20260805 22:47:09.509534 17569 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/master-0/wal/instance:
uuid: "24e02d789cd748848fdaef4d12844340"
format_stamp: "Formatted at 2026-08-05 22:47:09 on dist-test-slave-gjrz"
server_key: "378f9cfd4a07b0023b5ba6d74f5f1cf7"
server_key_iv: "890602aadd6dc50a0b2b8764b3422470"
server_key_version: "encryptionkey@0"
I20260805 22:47:09.510818 17569 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260805 22:47:09.511579 17589 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:09.511735 17569 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260805 22:47:09.511823 17569 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/master-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/master-0/wal
uuid: "24e02d789cd748848fdaef4d12844340"
format_stamp: "Formatted at 2026-08-05 22:47:09 on dist-test-slave-gjrz"
server_key: "378f9cfd4a07b0023b5ba6d74f5f1cf7"
server_key_iv: "890602aadd6dc50a0b2b8764b3422470"
server_key_version: "encryptionkey@0"
I20260805 22:47:09.511888 17569 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:09.550828 17569 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:09.552932 17569 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:09.553085 17569 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:09.557662 17569 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.190:44731
I20260805 22:47:09.557739 17683 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.190:44731 every 8 connection(s)
I20260805 22:47:09.558041 17569 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
I20260805 22:47:09.558725 17684 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:09.561152 17684 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 24e02d789cd748848fdaef4d12844340: Bootstrap starting.
I20260805 22:47:09.561754 17684 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 24e02d789cd748848fdaef4d12844340: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:09.562047 17684 log.cc:824] T 00000000000000000000000000000000 P 24e02d789cd748848fdaef4d12844340: Log is configured to *not* fsync() on all Append() calls
I20260805 22:47:09.562824 17684 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 24e02d789cd748848fdaef4d12844340: No bootstrap required, opened a new log
I20260805 22:47:09.563378 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 17569
I20260805 22:47:09.563480 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/master-0/wal/instance
I20260805 22:47:09.563650 15234 external_mini_cluster.cc:1428] Setting key 1da5b6d7602d9a2811718cfd657536dd
I20260805 22:47:09.565277 17684 raft_consensus.cc:348] T 00000000000000000000000000000000 P 24e02d789cd748848fdaef4d12844340 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24e02d789cd748848fdaef4d12844340" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 44731 } }
I20260805 22:47:09.565438 17684 raft_consensus.cc:374] T 00000000000000000000000000000000 P 24e02d789cd748848fdaef4d12844340 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:09.565474 17684 raft_consensus.cc:729] T 00000000000000000000000000000000 P 24e02d789cd748848fdaef4d12844340 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24e02d789cd748848fdaef4d12844340, State: Initialized, Role: FOLLOWER
I20260805 22:47:09.565608 17684 consensus_queue.cc:260] T 00000000000000000000000000000000 P 24e02d789cd748848fdaef4d12844340 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24e02d789cd748848fdaef4d12844340" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 44731 } }
I20260805 22:47:09.565689 17684 raft_consensus.cc:388] T 00000000000000000000000000000000 P 24e02d789cd748848fdaef4d12844340 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:47:09.565728 17684 raft_consensus.cc:482] T 00000000000000000000000000000000 P 24e02d789cd748848fdaef4d12844340 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:47:09.565775 17684 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 24e02d789cd748848fdaef4d12844340 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:09.566453 17684 raft_consensus.cc:504] T 00000000000000000000000000000000 P 24e02d789cd748848fdaef4d12844340 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24e02d789cd748848fdaef4d12844340" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 44731 } }
I20260805 22:47:09.566565 17684 leader_election.cc:302] T 00000000000000000000000000000000 P 24e02d789cd748848fdaef4d12844340 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 24e02d789cd748848fdaef4d12844340; no voters:
I20260805 22:47:09.566731 17684 leader_election.cc:288] T 00000000000000000000000000000000 P 24e02d789cd748848fdaef4d12844340 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:47:09.566766 17691 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 24e02d789cd748848fdaef4d12844340 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:47:09.566872 17691 raft_consensus.cc:686] T 00000000000000000000000000000000 P 24e02d789cd748848fdaef4d12844340 [term 1 LEADER]: Becoming Leader. State: Replica: 24e02d789cd748848fdaef4d12844340, State: Running, Role: LEADER
I20260805 22:47:09.567016 17684 sys_catalog.cc:564] T 00000000000000000000000000000000 P 24e02d789cd748848fdaef4d12844340 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:47:09.567023 17691 consensus_queue.cc:237] T 00000000000000000000000000000000 P 24e02d789cd748848fdaef4d12844340 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24e02d789cd748848fdaef4d12844340" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 44731 } }
I20260805 22:47:09.567559 17693 sys_catalog.cc:455] T 00000000000000000000000000000000 P 24e02d789cd748848fdaef4d12844340 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "24e02d789cd748848fdaef4d12844340" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24e02d789cd748848fdaef4d12844340" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 44731 } } }
I20260805 22:47:09.567579 17692 sys_catalog.cc:455] T 00000000000000000000000000000000 P 24e02d789cd748848fdaef4d12844340 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 24e02d789cd748848fdaef4d12844340. Latest consensus state: current_term: 1 leader_uuid: "24e02d789cd748848fdaef4d12844340" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24e02d789cd748848fdaef4d12844340" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 44731 } } }
I20260805 22:47:09.567739 17693 sys_catalog.cc:458] T 00000000000000000000000000000000 P 24e02d789cd748848fdaef4d12844340 [sys.catalog]: This master's current role is: LEADER
I20260805 22:47:09.567831 17692 sys_catalog.cc:458] T 00000000000000000000000000000000 P 24e02d789cd748848fdaef4d12844340 [sys.catalog]: This master's current role is: LEADER
W20260805 22:47:09.568918 17711 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 24e02d789cd748848fdaef4d12844340: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260805 22:47:09.568985 17711 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260805 22:47:09.569410 17704 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:47:09.569671 17704 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:47:09.571257 17704 catalog_manager.cc:1347] Generated new cluster ID: 21bbcb35d41a485b8b8a9ed3f70d6866
I20260805 22:47:09.571331 17704 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 05 22:47:09 dist-test-slave-gjrz krb5kdc[17552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970029, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:47:09.575690 17688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:09.564205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39308 (local address 127.14.224.190:44731)
0805 22:47:09.564380 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:09.564394 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:09.564422 (+ 28us) server_negotiation.cc:407] Connection header received
0805 22:47:09.565240 (+ 818us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:09.565246 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:09.565293 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:09.565404 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:09.566207 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:09.567473 (+ 1266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:09.568636 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:09.569134 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:09.569234 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:09.571937 (+ 2703us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:09.571941 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:09.571942 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:09.571964 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:09.573941 (+ 1977us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:09.574349 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:09.574352 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:09.574353 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:09.574485 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:09.574667 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:09.574668 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:09.574668 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:09.575017 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:09.575173 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:09.575311 (+ 138us) server_negotiation.cc:299] Negotiation successful
0805 22:47:09.575467 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":87,"threads_started":1}
I20260805 22:47:09.589881 17704 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:47:09.590636 17704 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:47:09.600979 17704 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 24e02d789cd748848fdaef4d12844340: Generated new TSK 0
I20260805 22:47:09.601233 17704 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.224.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab.
Entry for principal kudu/127.14.224.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab.
I20260805 22:47:09.634369 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.129:0
--local_ip_for_outbound_sockets=127.14.224.129
--webserver_interface=127.14.224.129
--webserver_port=0
--tserver_master_addrs=127.14.224.190:44731
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab
--principal=kudu/127.14.224.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:35111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:47:09.718994 17717 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:09.719200 17717 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:09.719225 17717 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:09.720381 17717 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:09.720424 17717 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:09.720445 17717 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260805 22:47:09.720468 17717 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260805 22:47:09.720503 17717 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.129
I20260805 22:47:09.721995 17717 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:35111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab
--principal=kudu/127.14.224.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.224.129
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.14.224.190:44731
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17717
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.129
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:09.722221 17717 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:09.722474 17717 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260805 22:47:09.727875 17717 server_base.cc:1034] running on GCE node
W20260805 22:47:09.727852 17724 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:09.727828 17725 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:09.727855 17727 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:09.728298 17717 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:09.728549 17717 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:09.729688 17717 hybrid_clock.cc:648] HybridClock initialized: now 1785970029729671 us; error 34 us; skew 500 ppm
Aug 05 22:47:09 dist-test-slave-gjrz krb5kdc[17552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970029, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:09.732275 17717 init.cc:377] Logged in from keytab as kudu/127.14.224.129@KRBTEST.COM (short username kudu)
I20260805 22:47:09.732712 17717 webserver.cc:460] Webserver started at http://127.14.224.129:41689/ using document root <none> and password file <none>
I20260805 22:47:09.732950 17717 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:09.732998 17717 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:09.733127 17717 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:09.734196 17717 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/ts-0/data/instance:
uuid: "d6b5267961ac4d66a44999b51395b345"
format_stamp: "Formatted at 2026-08-05 22:47:09 on dist-test-slave-gjrz"
server_key: "f4810410ee01f11753e87219c2de1ed5"
server_key_iv: "932b4b68ba917d0d72b4076aaba9087d"
server_key_version: "encryptionkey@0"
I20260805 22:47:09.734545 17717 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/ts-0/wal/instance:
uuid: "d6b5267961ac4d66a44999b51395b345"
format_stamp: "Formatted at 2026-08-05 22:47:09 on dist-test-slave-gjrz"
server_key: "f4810410ee01f11753e87219c2de1ed5"
server_key_iv: "932b4b68ba917d0d72b4076aaba9087d"
server_key_version: "encryptionkey@0"
I20260805 22:47:09.735966 17717 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260805 22:47:09.736668 17736 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:09.736821 17717 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260805 22:47:09.736912 17717 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/ts-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/ts-0/wal
uuid: "d6b5267961ac4d66a44999b51395b345"
format_stamp: "Formatted at 2026-08-05 22:47:09 on dist-test-slave-gjrz"
server_key: "f4810410ee01f11753e87219c2de1ed5"
server_key_iv: "932b4b68ba917d0d72b4076aaba9087d"
server_key_version: "encryptionkey@0"
I20260805 22:47:09.736979 17717 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:09.746547 17717 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:09.748363 17717 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:09.748512 17717 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:09.749032 17717 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:47:09.749076 17717 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:09.749105 17717 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:47:09.749123 17717 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:09.756175 17717 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.129:42983
I20260805 22:47:09.756256 17901 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.129:42983 every 8 connection(s)
Aug 05 22:47:09 dist-test-slave-gjrz krb5kdc[17552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970029, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.129@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:47:09.756623 17717 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
I20260805 22:47:09.759531 17688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:09.749520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.129:59115 (local address 127.14.224.190:44731)
0805 22:47:09.749579 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:09.749582 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:09.749767 (+ 185us) server_negotiation.cc:407] Connection header received
0805 22:47:09.750307 (+ 540us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:09.750309 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:09.750327 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:09.750386 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:09.751367 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:09.752151 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:09.753712 (+ 1561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:09.754041 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:09.754113 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:09.756978 (+ 2865us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:09.756980 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:09.756980 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:09.756990 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:09.758315 (+ 1325us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:09.758699 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:09.758700 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:09.758700 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:09.758751 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:09.758921 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:09.758922 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:09.758922 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:09.759027 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:09.759072 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:09.759370 (+ 298us) server_negotiation.cc:299] Negotiation successful
0805 22:47:09.759462 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260805 22:47:09.759709 17751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:09.749478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:44731 (local address 127.14.224.129:59115)
0805 22:47:09.749650 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:09.749692 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:09.750201 (+ 509us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:09.750513 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:09.750520 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:09.750904 (+ 384us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:09.751228 (+ 324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:09.751238 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:09.752249 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:09.752251 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:09.753582 (+ 1331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:09.753587 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:09.754130 (+ 543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:09.754132 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:09.754290 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:09.754955 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:09.754967 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:09.756843 (+ 1876us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:09.758397 (+ 1554us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:09.758402 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:09.758405 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:09.758635 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:09.758788 (+ 153us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:09.758789 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:09.758789 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:09.758879 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:09.759091 (+ 212us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:09.759096 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:09.759222 (+ 126us) client_negotiation.cc:769] Sending connection context
0805 22:47:09.759356 (+ 134us) client_negotiation.cc:240] Negotiation successful
0805 22:47:09.759509 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":83,"threads_started":1}
I20260805 22:47:09.759992 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 17717
I20260805 22:47:09.760083 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/ts-0/wal/instance
I20260805 22:47:09.760250 17902 heartbeater.cc:347] Connected to a master server at 127.14.224.190:44731
I20260805 22:47:09.760285 15234 external_mini_cluster.cc:1428] Setting key deab2e3ac42bdb3d79c25833e8f434ff
I20260805 22:47:09.760340 17902 heartbeater.cc:464] Registering TS with master...
I20260805 22:47:09.760557 17902 heartbeater.cc:511] Master 127.14.224.190:44731 requested a full tablet report, sending...
I20260805 22:47:09.761317 17616 ts_manager.cc:194] Registered new tserver with Master: d6b5267961ac4d66a44999b51395b345 (127.14.224.129:42983)
I20260805 22:47:09.762132 17616 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.224.129@KRBTEST.COM'} at 127.14.224.129:59115
I20260805 22:47:09.767058 17688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:09.761340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.129:36281 (local address 127.14.224.190:44731)
0805 22:47:09.761383 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:09.761384 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:09.761507 (+ 123us) server_negotiation.cc:407] Connection header received
0805 22:47:09.761561 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:09.761562 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:09.761572 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:09.761618 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:09.761950 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:09.762478 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:09.763437 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:09.763634 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:09.763694 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:09.764662 (+ 968us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:09.764663 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:09.764663 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:09.764669 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:09.765952 (+ 1283us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:09.766337 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:09.766337 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:09.766338 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:09.766391 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:09.766576 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:09.766576 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:09.766576 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:09.766671 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:09.766716 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:09.766902 (+ 186us) server_negotiation.cc:299] Negotiation successful
0805 22:47:09.766992 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260805 22:47:09.767112 17910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:09.761285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:44731 (local address 127.14.224.129:36281)
0805 22:47:09.761440 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:09.761450 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:09.761506 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:09.761628 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:09.761628 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:09.761805 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:09.761865 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:09.761867 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:09.762563 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:09.762565 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:09.763355 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:09.763359 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:09.763706 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:09.763707 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:09.763777 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:09.764210 (+ 433us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:09.764215 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:09.764580 (+ 365us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:09.766034 (+ 1454us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:09.766035 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:09.766036 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:09.766267 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:09.766451 (+ 184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:09.766451 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:09.766452 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:09.766521 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:09.766726 (+ 205us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:09.766727 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:09.766777 (+ 50us) client_negotiation.cc:769] Sending connection context
0805 22:47:09.766885 (+ 108us) client_negotiation.cc:240] Negotiation successful
0805 22:47:09.767003 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":76,"threads_started":1}
WARNING: no policy specified for kudu/127.14.224.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab.
Entry for principal kudu/127.14.224.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab.
I20260805 22:47:09.788007 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.130:0
--local_ip_for_outbound_sockets=127.14.224.130
--webserver_interface=127.14.224.130
--webserver_port=0
--tserver_master_addrs=127.14.224.190:44731
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab
--principal=kudu/127.14.224.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:35111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:47:09.871134 17914 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:09.871397 17914 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:09.871425 17914 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:09.872583 17914 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:09.872620 17914 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:09.872640 17914 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260805 22:47:09.872651 17914 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260805 22:47:09.872668 17914 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.130
I20260805 22:47:09.874136 17914 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:35111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab
--principal=kudu/127.14.224.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.224.130
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.14.224.190:44731
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17914
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.130
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:09.874356 17914 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:09.874544 17914 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:09.879565 17928 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:09.879555 17925 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:09.879555 17924 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:09.879834 17914 server_base.cc:1034] running on GCE node
I20260805 22:47:09.880039 17914 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:09.880298 17914 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:09.881448 17914 hybrid_clock.cc:648] HybridClock initialized: now 1785970029881422 us; error 30 us; skew 500 ppm
Aug 05 22:47:09 dist-test-slave-gjrz krb5kdc[17552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970029, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:09.884073 17914 init.cc:377] Logged in from keytab as kudu/127.14.224.130@KRBTEST.COM (short username kudu)
I20260805 22:47:09.884552 17914 webserver.cc:460] Webserver started at http://127.14.224.130:38901/ using document root <none> and password file <none>
I20260805 22:47:09.884789 17914 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:09.884841 17914 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:09.884979 17914 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:09.886096 17914 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/ts-1/data/instance:
uuid: "574de84d62eb4b68811043701d2301fd"
format_stamp: "Formatted at 2026-08-05 22:47:09 on dist-test-slave-gjrz"
server_key: "46c075d0aca61eae46e59caf9705d79a"
server_key_iv: "19b9e8575eedf578f57fb7d9b162cee2"
server_key_version: "encryptionkey@0"
I20260805 22:47:09.886579 17914 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/ts-1/wal/instance:
uuid: "574de84d62eb4b68811043701d2301fd"
format_stamp: "Formatted at 2026-08-05 22:47:09 on dist-test-slave-gjrz"
server_key: "46c075d0aca61eae46e59caf9705d79a"
server_key_iv: "19b9e8575eedf578f57fb7d9b162cee2"
server_key_version: "encryptionkey@0"
I20260805 22:47:09.888151 17914 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260805 22:47:09.888938 17935 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:09.889096 17914 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260805 22:47:09.889179 17914 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/ts-1/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/ts-1/wal
uuid: "574de84d62eb4b68811043701d2301fd"
format_stamp: "Formatted at 2026-08-05 22:47:09 on dist-test-slave-gjrz"
server_key: "46c075d0aca61eae46e59caf9705d79a"
server_key_iv: "19b9e8575eedf578f57fb7d9b162cee2"
server_key_version: "encryptionkey@0"
I20260805 22:47:09.889238 17914 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:09.900964 17914 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:09.903199 17914 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:09.903390 17914 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:09.903930 17914 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:47:09.903980 17914 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:09.904002 17914 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:47:09.904016 17914 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:09.910324 17914 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.130:41497
I20260805 22:47:09.910449 18099 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.130:41497 every 8 connection(s)
I20260805 22:47:09.910764 17914 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
Aug 05 22:47:09 dist-test-slave-gjrz krb5kdc[17552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970029, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.130@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:47:09.913885 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 17914
I20260805 22:47:09.913977 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/ts-1/wal/instance
I20260805 22:47:09.914167 15234 external_mini_cluster.cc:1428] Setting key 6cea5ffa868c34846ccfb685bd2ffdb0
I20260805 22:47:09.914373 17688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:09.904454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:56749 (local address 127.14.224.190:44731)
0805 22:47:09.904523 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:09.904526 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:09.904800 (+ 274us) server_negotiation.cc:407] Connection header received
0805 22:47:09.905381 (+ 581us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:09.905383 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:09.905396 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:09.905429 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:09.906438 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:09.907211 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:09.908765 (+ 1554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:09.909082 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:09.909168 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:09.911828 (+ 2660us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:09.911829 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:09.911830 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:09.911839 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:09.912931 (+ 1092us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:09.913341 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:09.913342 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:09.913342 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:09.913403 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:09.913665 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:09.913666 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:09.913667 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:09.913817 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:09.913876 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:09.914191 (+ 315us) server_negotiation.cc:299] Negotiation successful
0805 22:47:09.914282 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260805 22:47:09.914556 17950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:09.904418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:44731 (local address 127.14.224.130:56749)
0805 22:47:09.904686 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:09.904716 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:09.905253 (+ 537us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:09.905644 (+ 391us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:09.905649 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:09.906008 (+ 359us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:09.906310 (+ 302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:09.906318 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:09.907365 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:09.907366 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:09.908661 (+ 1295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:09.908665 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:09.909181 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:09.909182 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:09.909342 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:09.909930 (+ 588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:09.909939 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:09.911725 (+ 1786us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:09.913044 (+ 1319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:09.913050 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:09.913052 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:09.913270 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:09.913463 (+ 193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:09.913464 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:09.913464 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:09.913601 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:09.913875 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:09.913882 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:09.914051 (+ 169us) client_negotiation.cc:769] Sending connection context
0805 22:47:09.914159 (+ 108us) client_negotiation.cc:240] Negotiation successful
0805 22:47:09.914322 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":95,"threads_started":1}
I20260805 22:47:09.915059 18100 heartbeater.cc:347] Connected to a master server at 127.14.224.190:44731
I20260805 22:47:09.915162 18100 heartbeater.cc:464] Registering TS with master...
I20260805 22:47:09.915388 18100 heartbeater.cc:511] Master 127.14.224.190:44731 requested a full tablet report, sending...
I20260805 22:47:09.915803 17615 ts_manager.cc:194] Registered new tserver with Master: 574de84d62eb4b68811043701d2301fd (127.14.224.130:41497)
I20260805 22:47:09.916252 17615 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.224.130@KRBTEST.COM'} at 127.14.224.130:56749
I20260805 22:47:09.922312 17688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:09.916176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:46831 (local address 127.14.224.190:44731)
0805 22:47:09.916218 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:09.916220 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:09.916344 (+ 124us) server_negotiation.cc:407] Connection header received
0805 22:47:09.916442 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:09.916444 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:09.916454 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:09.916497 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:09.916979 (+ 482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:09.917650 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:09.918550 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:09.918746 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:09.918803 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:09.919860 (+ 1057us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:09.919862 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:09.919862 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:09.919871 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:09.921158 (+ 1287us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:09.921558 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:09.921558 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:09.921558 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:09.921610 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:09.921805 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:09.921805 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:09.921805 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:09.921963 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:09.922014 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:09.922174 (+ 160us) server_negotiation.cc:299] Negotiation successful
0805 22:47:09.922241 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260805 22:47:09.922386 18111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:09.916115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:44731 (local address 127.14.224.130:46831)
0805 22:47:09.916284 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:09.916294 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:09.916370 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:09.916511 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:09.916511 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:09.916712 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:09.916783 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:09.916786 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:09.917767 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:09.917767 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:09.918470 (+ 703us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:09.918473 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:09.918820 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:09.918821 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:09.918895 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:09.919343 (+ 448us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:09.919348 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:09.919753 (+ 405us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:09.921250 (+ 1497us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:09.921251 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:09.921252 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:09.921483 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:09.921677 (+ 194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:09.921678 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:09.921678 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:09.921749 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:09.922022 (+ 273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:09.922023 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:09.922078 (+ 55us) client_negotiation.cc:769] Sending connection context
0805 22:47:09.922157 (+ 79us) client_negotiation.cc:240] Negotiation successful
0805 22:47:09.922275 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":71,"threads_started":1}
WARNING: no policy specified for kudu/127.14.224.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab.
Entry for principal kudu/127.14.224.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab.
I20260805 22:47:09.944245 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.131:0
--local_ip_for_outbound_sockets=127.14.224.131
--webserver_interface=127.14.224.131
--webserver_port=0
--tserver_master_addrs=127.14.224.190:44731
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab
--principal=kudu/127.14.224.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:35111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:47:10.029206 18115 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:10.029534 18115 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:10.029594 18115 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:10.030948 18115 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:10.031006 18115 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:10.031101 18115 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260805 22:47:10.031177 18115 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260805 22:47:10.031206 18115 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.131
I20260805 22:47:10.033114 18115 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:35111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab
--principal=kudu/127.14.224.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.224.131
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.14.224.190:44731
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18115
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.131
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:10.033396 18115 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:10.033667 18115 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:10.038825 18125 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:10.038825 18127 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:10.038828 18129 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:10.039110 18115 server_base.cc:1034] running on GCE node
I20260805 22:47:10.039350 18115 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:10.039597 18115 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:10.040727 18115 hybrid_clock.cc:648] HybridClock initialized: now 1785970030040716 us; error 29 us; skew 500 ppm
Aug 05 22:47:10 dist-test-slave-gjrz krb5kdc[17552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970030, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:10.043226 18115 init.cc:377] Logged in from keytab as kudu/127.14.224.131@KRBTEST.COM (short username kudu)
I20260805 22:47:10.043749 18115 webserver.cc:460] Webserver started at http://127.14.224.131:37687/ using document root <none> and password file <none>
I20260805 22:47:10.043983 18115 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:10.044034 18115 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:10.044165 18115 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:10.045222 18115 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/ts-2/data/instance:
uuid: "7bc375740395411da040a5c9111bb32d"
format_stamp: "Formatted at 2026-08-05 22:47:10 on dist-test-slave-gjrz"
server_key: "214cfb4786b47f8417752a3551cb3d24"
server_key_iv: "97087f4c0becfd414e0558028332324d"
server_key_version: "encryptionkey@0"
I20260805 22:47:10.045569 18115 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/ts-2/wal/instance:
uuid: "7bc375740395411da040a5c9111bb32d"
format_stamp: "Formatted at 2026-08-05 22:47:10 on dist-test-slave-gjrz"
server_key: "214cfb4786b47f8417752a3551cb3d24"
server_key_iv: "97087f4c0becfd414e0558028332324d"
server_key_version: "encryptionkey@0"
I20260805 22:47:10.046875 18115 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260805 22:47:10.047638 18139 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:10.047809 18115 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:10.047909 18115 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/ts-2/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/ts-2/wal
uuid: "7bc375740395411da040a5c9111bb32d"
format_stamp: "Formatted at 2026-08-05 22:47:10 on dist-test-slave-gjrz"
server_key: "214cfb4786b47f8417752a3551cb3d24"
server_key_iv: "97087f4c0becfd414e0558028332324d"
server_key_version: "encryptionkey@0"
I20260805 22:47:10.047974 18115 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:10.064637 18115 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:10.066509 18115 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:10.066669 18115 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:10.067255 18115 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:47:10.067333 18115 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:10.067368 18115 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:47:10.067390 18115 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 05 22:47:10 dist-test-slave-gjrz krb5kdc[17552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970030, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.131@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:47:10.074537 18115 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.131:46567
I20260805 22:47:10.074601 18302 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.131:46567 every 8 connection(s)
I20260805 22:47:10.074972 18115 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
I20260805 22:47:10.076913 17688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:10.067738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:41807 (local address 127.14.224.190:44731)
0805 22:47:10.067782 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:10.067784 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:10.068029 (+ 245us) server_negotiation.cc:407] Connection header received
0805 22:47:10.068611 (+ 582us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:10.068613 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:10.068635 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:10.068689 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:10.069377 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:10.069966 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:10.071019 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:10.071227 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:10.071315 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:10.073914 (+ 2599us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:10.073915 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:10.073915 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:10.073923 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:10.075536 (+ 1613us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:10.076015 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:10.076016 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:10.076016 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:10.076085 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:10.076334 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:10.076336 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:10.076336 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:10.076476 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:10.076543 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:10.076771 (+ 228us) server_negotiation.cc:299] Negotiation successful
0805 22:47:10.076846 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260805 22:47:10.077075 18152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:10.067742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:44731 (local address 127.14.224.131:41807)
0805 22:47:10.067901 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:10.067940 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:10.068502 (+ 562us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:10.068764 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:10.068767 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:10.069063 (+ 296us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:10.069280 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:10.069285 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:10.070059 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:10.070060 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:10.070921 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:10.070925 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:10.071324 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:10.071325 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:10.071486 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:10.072062 (+ 576us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:10.072073 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:10.073814 (+ 1741us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:10.075611 (+ 1797us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:10.075635 (+ 24us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:10.075637 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:10.075931 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:10.076146 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:10.076146 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:10.076146 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:10.076244 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:10.076535 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:10.076539 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:10.076667 (+ 128us) client_negotiation.cc:769] Sending connection context
0805 22:47:10.076748 (+ 81us) client_negotiation.cc:240] Negotiation successful
0805 22:47:10.076873 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":88,"threads_started":1}
I20260805 22:47:10.077610 18304 heartbeater.cc:347] Connected to a master server at 127.14.224.190:44731
I20260805 22:47:10.077703 18304 heartbeater.cc:464] Registering TS with master...
I20260805 22:47:10.077875 18304 heartbeater.cc:511] Master 127.14.224.190:44731 requested a full tablet report, sending...
I20260805 22:47:10.078254 17617 ts_manager.cc:194] Registered new tserver with Master: 7bc375740395411da040a5c9111bb32d (127.14.224.131:46567)
I20260805 22:47:10.078753 17617 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.224.131@KRBTEST.COM'} at 127.14.224.131:41807
I20260805 22:47:10.080204 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 18115
I20260805 22:47:10.080293 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/ts-2/wal/instance
I20260805 22:47:10.080472 15234 external_mini_cluster.cc:1428] Setting key 0b66d16dac9e55ae3d5f001f7be1170e
I20260805 22:47:10.081285 15234 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 22:47:10.084184 18314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:10.078584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:44731 (local address 127.14.224.131:38771)
0805 22:47:10.078715 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:10.078725 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:10.078787 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:10.078927 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:10.078928 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:10.079093 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:10.079159 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:10.079160 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:10.079908 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:10.079909 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:10.080623 (+ 714us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:10.080627 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:10.080994 (+ 367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:10.080995 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:10.081058 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:10.081492 (+ 434us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:10.081497 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:10.081855 (+ 358us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:10.083163 (+ 1308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:10.083165 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:10.083165 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:10.083406 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:10.083636 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:10.083637 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:10.083637 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:10.083693 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:10.083929 (+ 236us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:10.083929 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:10.083967 (+ 38us) client_negotiation.cc:769] Sending connection context
0805 22:47:10.084013 (+ 46us) client_negotiation.cc:240] Negotiation successful
0805 22:47:10.084099 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":73,"threads_started":1}
I20260805 22:47:10.084206 17688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:10.078676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:38771 (local address 127.14.224.190:44731)
0805 22:47:10.078720 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:10.078722 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:10.078772 (+ 50us) server_negotiation.cc:407] Connection header received
0805 22:47:10.078845 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:10.078845 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:10.078855 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:10.078905 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:10.079229 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:10.079826 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:10.080696 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:10.080925 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:10.080983 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:10.081945 (+ 962us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:10.081947 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:10.081947 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:10.081953 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:10.083081 (+ 1128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:10.083500 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:10.083501 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:10.083502 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:10.083574 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:10.083744 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:10.083745 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:10.083745 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:10.083872 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:10.083941 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:10.084034 (+ 93us) server_negotiation.cc:299] Negotiation successful
0805 22:47:10.084121 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
Aug 05 22:47:10 dist-test-slave-gjrz krb5kdc[17552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970030, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 05 22:47:10 dist-test-slave-gjrz krb5kdc[17552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970030, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:47:10.105643 17688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:10.098833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44428 (local address 127.14.224.190:44731)
0805 22:47:10.098903 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:10.098905 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:10.098917 (+ 12us) server_negotiation.cc:407] Connection header received
0805 22:47:10.098979 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:10.098980 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:10.098991 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:10.099037 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:10.099683 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:10.100193 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:10.100958 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:10.101163 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:10.101221 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:10.103533 (+ 2312us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:10.103535 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:10.103535 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:10.103543 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:10.104728 (+ 1185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:10.105076 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:10.105077 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:10.105077 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:10.105124 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:10.105255 (+ 131us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:10.105255 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:10.105256 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:10.105356 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:10.105442 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:10.105508 (+ 66us) server_negotiation.cc:299] Negotiation successful
0805 22:47:10.105573 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260805 22:47:10.107355 17617 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44428:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:47:10.108863 17617 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:47:10.115456 18332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:10.111386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.129:42983 (local address 127.0.0.1:46274)
0805 22:47:10.111616 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:10.111624 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:10.111661 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:10.112019 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:10.112020 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:10.112022 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:47:10.112052 (+ 30us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:10.112057 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:10.113332 (+ 1275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:10.113332 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:10.114241 (+ 909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:10.114244 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:10.115175 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:10.115176 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:10.115227 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:10.115230 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:47:10.115292 (+ 62us) client_negotiation.cc:240] Negotiation successful
0805 22:47:10.115359 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":215,"mutex_wait_us":79,"thread_start_us":86,"threads_started":1}
I20260805 22:47:10.115537 18334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:10.111636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46274 (local address 127.14.224.129:42983)
0805 22:47:10.111812 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:10.111816 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:10.111825 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:47:10.111865 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:10.111867 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:10.111880 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:10.111957 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:47:10.112123 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:10.113243 (+ 1120us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:10.114330 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:10.115102 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:10.115219 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:10.115347 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:10.115378 (+ 31us) server_negotiation.cc:299] Negotiation successful
0805 22:47:10.115430 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":95,"threads_started":1}
I20260805 22:47:10.115559 18331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:10.111348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46562 (local address 127.14.224.130:41497)
0805 22:47:10.111539 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:10.111544 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:10.111553 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:47:10.111592 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:10.111594 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:10.111609 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:10.111680 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:47:10.111920 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:10.112815 (+ 895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:10.114241 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:10.114971 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:10.115040 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:10.115102 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:10.115423 (+ 321us) server_negotiation.cc:299] Negotiation successful
0805 22:47:10.115464 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":82,"threads_started":1}
I20260805 22:47:10.115643 18330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:10.111155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.131:46567 (local address 127.0.0.1:58294)
0805 22:47:10.111569 (+ 414us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:10.111580 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:10.111632 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:10.111939 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:10.111940 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:10.111942 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:47:10.111994 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:10.111996 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:10.113319 (+ 1323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:10.113320 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:10.114394 (+ 1074us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:10.114396 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:10.115401 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:10.115402 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:10.115483 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:10.115488 (+ 5us) client_negotiation.cc:769] Sending connection context
0805 22:47:10.115520 (+ 32us) client_negotiation.cc:240] Negotiation successful
0805 22:47:10.115561 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":391,"spinlock_wait_cycles":768,"thread_start_us":91,"threads_started":1}
I20260805 22:47:10.115784 18329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:10.111154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.130:41497 (local address 127.0.0.1:46562)
0805 22:47:10.111325 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:10.111371 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:10.111457 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:10.111765 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:10.111768 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:10.111770 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:47:10.111845 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:10.111847 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:10.112897 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:10.112898 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:10.114132 (+ 1234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:10.114135 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:10.115049 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:10.115050 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:10.115149 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:10.115168 (+ 19us) client_negotiation.cc:769] Sending connection context
0805 22:47:10.115237 (+ 69us) client_negotiation.cc:240] Negotiation successful
0805 22:47:10.115359 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":65,"threads_started":1}
I20260805 22:47:10.116336 18333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:10.111366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58294 (local address 127.14.224.131:46567)
0805 22:47:10.111767 (+ 401us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:10.111772 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:10.111782 (+ 10us) server_negotiation.cc:407] Connection header received
0805 22:47:10.111822 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:10.111824 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:10.111840 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:10.112066 (+ 226us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:47:10.112124 (+ 58us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:10.113222 (+ 1098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:10.114485 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:10.115309 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:10.116079 (+ 770us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:10.116169 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:10.116197 (+ 28us) server_negotiation.cc:299] Negotiation successful
0805 22:47:10.116237 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":365,"thread_start_us":109,"threads_started":1}
I20260805 22:47:10.116339 18010 tablet_service.cc:1467] Processing CreateTablet for tablet 5eb58463867d4057b47e82a3a38d0c79 (DEFAULT_TABLE table=test-table [id=86c48a1a07dd46a7932007e16096ef70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:47:10.116343 17812 tablet_service.cc:1467] Processing CreateTablet for tablet 5eb58463867d4057b47e82a3a38d0c79 (DEFAULT_TABLE table=test-table [id=86c48a1a07dd46a7932007e16096ef70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:47:10.116710 18010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5eb58463867d4057b47e82a3a38d0c79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:10.116710 17812 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5eb58463867d4057b47e82a3a38d0c79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:10.117053 18209 tablet_service.cc:1467] Processing CreateTablet for tablet 5eb58463867d4057b47e82a3a38d0c79 (DEFAULT_TABLE table=test-table [id=86c48a1a07dd46a7932007e16096ef70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:47:10.117393 18209 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5eb58463867d4057b47e82a3a38d0c79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:10.120209 18335 tablet_bootstrap.cc:492] T 5eb58463867d4057b47e82a3a38d0c79 P 7bc375740395411da040a5c9111bb32d: Bootstrap starting.
I20260805 22:47:10.120719 18336 tablet_bootstrap.cc:492] T 5eb58463867d4057b47e82a3a38d0c79 P 574de84d62eb4b68811043701d2301fd: Bootstrap starting.
I20260805 22:47:10.121289 18336 tablet_bootstrap.cc:654] T 5eb58463867d4057b47e82a3a38d0c79 P 574de84d62eb4b68811043701d2301fd: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:10.121320 18335 tablet_bootstrap.cc:654] T 5eb58463867d4057b47e82a3a38d0c79 P 7bc375740395411da040a5c9111bb32d: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:10.121560 18336 log.cc:824] T 5eb58463867d4057b47e82a3a38d0c79 P 574de84d62eb4b68811043701d2301fd: Log is configured to *not* fsync() on all Append() calls
I20260805 22:47:10.121596 18335 log.cc:824] T 5eb58463867d4057b47e82a3a38d0c79 P 7bc375740395411da040a5c9111bb32d: Log is configured to *not* fsync() on all Append() calls
I20260805 22:47:10.121920 18338 tablet_bootstrap.cc:492] T 5eb58463867d4057b47e82a3a38d0c79 P d6b5267961ac4d66a44999b51395b345: Bootstrap starting.
I20260805 22:47:10.122290 18336 tablet_bootstrap.cc:492] T 5eb58463867d4057b47e82a3a38d0c79 P 574de84d62eb4b68811043701d2301fd: No bootstrap required, opened a new log
I20260805 22:47:10.122340 18335 tablet_bootstrap.cc:492] T 5eb58463867d4057b47e82a3a38d0c79 P 7bc375740395411da040a5c9111bb32d: No bootstrap required, opened a new log
I20260805 22:47:10.122359 18336 ts_tablet_manager.cc:1397] T 5eb58463867d4057b47e82a3a38d0c79 P 574de84d62eb4b68811043701d2301fd: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260805 22:47:10.122431 18335 ts_tablet_manager.cc:1397] T 5eb58463867d4057b47e82a3a38d0c79 P 7bc375740395411da040a5c9111bb32d: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260805 22:47:10.122547 18338 tablet_bootstrap.cc:654] T 5eb58463867d4057b47e82a3a38d0c79 P d6b5267961ac4d66a44999b51395b345: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:10.122855 18338 log.cc:824] T 5eb58463867d4057b47e82a3a38d0c79 P d6b5267961ac4d66a44999b51395b345: Log is configured to *not* fsync() on all Append() calls
I20260805 22:47:10.123682 18338 tablet_bootstrap.cc:492] T 5eb58463867d4057b47e82a3a38d0c79 P d6b5267961ac4d66a44999b51395b345: No bootstrap required, opened a new log
I20260805 22:47:10.123764 18338 ts_tablet_manager.cc:1397] T 5eb58463867d4057b47e82a3a38d0c79 P d6b5267961ac4d66a44999b51395b345: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260805 22:47:10.124298 18336 raft_consensus.cc:348] T 5eb58463867d4057b47e82a3a38d0c79 P 574de84d62eb4b68811043701d2301fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc375740395411da040a5c9111bb32d" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46567 } } peers { permanent_uuid: "574de84d62eb4b68811043701d2301fd" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41497 } } peers { permanent_uuid: "d6b5267961ac4d66a44999b51395b345" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42983 } }
I20260805 22:47:10.124447 18336 raft_consensus.cc:374] T 5eb58463867d4057b47e82a3a38d0c79 P 574de84d62eb4b68811043701d2301fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:10.124480 18336 raft_consensus.cc:729] T 5eb58463867d4057b47e82a3a38d0c79 P 574de84d62eb4b68811043701d2301fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 574de84d62eb4b68811043701d2301fd, State: Initialized, Role: FOLLOWER
I20260805 22:47:10.124416 18335 raft_consensus.cc:348] T 5eb58463867d4057b47e82a3a38d0c79 P 7bc375740395411da040a5c9111bb32d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc375740395411da040a5c9111bb32d" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46567 } } peers { permanent_uuid: "574de84d62eb4b68811043701d2301fd" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41497 } } peers { permanent_uuid: "d6b5267961ac4d66a44999b51395b345" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42983 } }
I20260805 22:47:10.124570 18335 raft_consensus.cc:374] T 5eb58463867d4057b47e82a3a38d0c79 P 7bc375740395411da040a5c9111bb32d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:10.124611 18335 raft_consensus.cc:729] T 5eb58463867d4057b47e82a3a38d0c79 P 7bc375740395411da040a5c9111bb32d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bc375740395411da040a5c9111bb32d, State: Initialized, Role: FOLLOWER
I20260805 22:47:10.124665 18336 consensus_queue.cc:260] T 5eb58463867d4057b47e82a3a38d0c79 P 574de84d62eb4b68811043701d2301fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc375740395411da040a5c9111bb32d" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46567 } } peers { permanent_uuid: "574de84d62eb4b68811043701d2301fd" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41497 } } peers { permanent_uuid: "d6b5267961ac4d66a44999b51395b345" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42983 } }
I20260805 22:47:10.124729 18335 consensus_queue.cc:260] T 5eb58463867d4057b47e82a3a38d0c79 P 7bc375740395411da040a5c9111bb32d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc375740395411da040a5c9111bb32d" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46567 } } peers { permanent_uuid: "574de84d62eb4b68811043701d2301fd" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41497 } } peers { permanent_uuid: "d6b5267961ac4d66a44999b51395b345" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42983 } }
I20260805 22:47:10.125007 18335 ts_tablet_manager.cc:1428] T 5eb58463867d4057b47e82a3a38d0c79 P 7bc375740395411da040a5c9111bb32d: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260805 22:47:10.125006 18336 ts_tablet_manager.cc:1428] T 5eb58463867d4057b47e82a3a38d0c79 P 574de84d62eb4b68811043701d2301fd: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260805 22:47:10.125138 18100 heartbeater.cc:503] Master 127.14.224.190:44731 was elected leader, sending a full tablet report...
I20260805 22:47:10.125157 18304 heartbeater.cc:503] Master 127.14.224.190:44731 was elected leader, sending a full tablet report...
I20260805 22:47:10.125854 18338 raft_consensus.cc:348] T 5eb58463867d4057b47e82a3a38d0c79 P d6b5267961ac4d66a44999b51395b345 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc375740395411da040a5c9111bb32d" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46567 } } peers { permanent_uuid: "574de84d62eb4b68811043701d2301fd" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41497 } } peers { permanent_uuid: "d6b5267961ac4d66a44999b51395b345" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42983 } }
I20260805 22:47:10.126029 18338 raft_consensus.cc:374] T 5eb58463867d4057b47e82a3a38d0c79 P d6b5267961ac4d66a44999b51395b345 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:10.126065 18338 raft_consensus.cc:729] T 5eb58463867d4057b47e82a3a38d0c79 P d6b5267961ac4d66a44999b51395b345 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6b5267961ac4d66a44999b51395b345, State: Initialized, Role: FOLLOWER
I20260805 22:47:10.126176 18338 consensus_queue.cc:260] T 5eb58463867d4057b47e82a3a38d0c79 P d6b5267961ac4d66a44999b51395b345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc375740395411da040a5c9111bb32d" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46567 } } peers { permanent_uuid: "574de84d62eb4b68811043701d2301fd" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41497 } } peers { permanent_uuid: "d6b5267961ac4d66a44999b51395b345" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42983 } }
I20260805 22:47:10.126399 18338 ts_tablet_manager.cc:1428] T 5eb58463867d4057b47e82a3a38d0c79 P d6b5267961ac4d66a44999b51395b345: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260805 22:47:10.126464 17902 heartbeater.cc:503] Master 127.14.224.190:44731 was elected leader, sending a full tablet report...
W20260805 22:47:10.161324 18101 tablet.cc:2369] T 5eb58463867d4057b47e82a3a38d0c79 P 574de84d62eb4b68811043701d2301fd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:47:10.214545 18342 raft_consensus.cc:482] T 5eb58463867d4057b47e82a3a38d0c79 P 7bc375740395411da040a5c9111bb32d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:47:10.214689 18342 raft_consensus.cc:504] T 5eb58463867d4057b47e82a3a38d0c79 P 7bc375740395411da040a5c9111bb32d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc375740395411da040a5c9111bb32d" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46567 } } peers { permanent_uuid: "574de84d62eb4b68811043701d2301fd" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41497 } } peers { permanent_uuid: "d6b5267961ac4d66a44999b51395b345" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42983 } }
I20260805 22:47:10.215131 18342 leader_election.cc:288] T 5eb58463867d4057b47e82a3a38d0c79 P 7bc375740395411da040a5c9111bb32d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 574de84d62eb4b68811043701d2301fd (127.14.224.130:41497), d6b5267961ac4d66a44999b51395b345 (127.14.224.129:42983)
I20260805 22:47:10.218398 18152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:10.215360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.130:41497 (local address 127.14.224.131:55235)
0805 22:47:10.215398 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:10.215411 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:10.215457 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:10.215619 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:10.215621 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:10.215623 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:47:10.215691 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:10.215693 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:10.216475 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:10.216475 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:10.217268 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:10.217271 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:10.218045 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:10.218046 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:10.218149 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:10.218154 (+ 5us) client_negotiation.cc:769] Sending connection context
0805 22:47:10.218239 (+ 85us) client_negotiation.cc:240] Negotiation successful
0805 22:47:10.218296 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17,"mutex_wait_us":60}
I20260805 22:47:10.218408 18334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:10.215418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:55275 (local address 127.14.224.129:42983)
0805 22:47:10.215474 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:10.215476 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:10.215750 (+ 274us) server_negotiation.cc:407] Connection header received
0805 22:47:10.215792 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:10.215794 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:10.215802 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:10.215859 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:47:10.216016 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:10.216521 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:10.217408 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:10.217977 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:10.218039 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:10.218046 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:10.218289 (+ 243us) server_negotiation.cc:299] Negotiation successful
0805 22:47:10.218338 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260805 22:47:10.218405 18346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:10.215360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.129:42983 (local address 127.14.224.131:55275)
0805 22:47:10.215681 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:10.215690 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:10.215742 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:10.215871 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:10.215872 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:10.215873 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:47:10.215949 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:10.215951 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:10.216604 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:10.216605 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:10.217330 (+ 725us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:10.217332 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:10.218105 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:10.218106 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:10.218174 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:10.218176 (+ 2us) client_negotiation.cc:769] Sending connection context
0805 22:47:10.218237 (+ 61us) client_negotiation.cc:240] Negotiation successful
0805 22:47:10.218295 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":302,"mutex_wait_us":142,"thread_start_us":131,"threads_started":1}
I20260805 22:47:10.218501 18331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:10.215432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:55235 (local address 127.14.224.130:41497)
0805 22:47:10.215477 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:10.215480 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:10.215491 (+ 11us) server_negotiation.cc:407] Connection header received
0805 22:47:10.215520 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:10.215521 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:10.215529 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:10.215601 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:47:10.215906 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:10.216374 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:10.217378 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:10.217922 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:10.218003 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:10.218013 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:10.218371 (+ 358us) server_negotiation.cc:299] Negotiation successful
0805 22:47:10.218442 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260805 22:47:10.218797 18038 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5eb58463867d4057b47e82a3a38d0c79" candidate_uuid: "7bc375740395411da040a5c9111bb32d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "574de84d62eb4b68811043701d2301fd" is_pre_election: true
I20260805 22:47:10.218967 18038 raft_consensus.cc:2454] T 5eb58463867d4057b47e82a3a38d0c79 P 574de84d62eb4b68811043701d2301fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7bc375740395411da040a5c9111bb32d in term 0.
I20260805 22:47:10.218945 17842 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5eb58463867d4057b47e82a3a38d0c79" candidate_uuid: "7bc375740395411da040a5c9111bb32d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6b5267961ac4d66a44999b51395b345" is_pre_election: true
I20260805 22:47:10.219099 17842 raft_consensus.cc:2454] T 5eb58463867d4057b47e82a3a38d0c79 P d6b5267961ac4d66a44999b51395b345 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7bc375740395411da040a5c9111bb32d in term 0.
I20260805 22:47:10.219223 18142 leader_election.cc:302] T 5eb58463867d4057b47e82a3a38d0c79 P 7bc375740395411da040a5c9111bb32d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 574de84d62eb4b68811043701d2301fd, 7bc375740395411da040a5c9111bb32d; no voters:
I20260805 22:47:10.219404 18342 raft_consensus.cc:2781] T 5eb58463867d4057b47e82a3a38d0c79 P 7bc375740395411da040a5c9111bb32d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:47:10.219475 18342 raft_consensus.cc:482] T 5eb58463867d4057b47e82a3a38d0c79 P 7bc375740395411da040a5c9111bb32d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:47:10.219492 18342 raft_consensus.cc:3037] T 5eb58463867d4057b47e82a3a38d0c79 P 7bc375740395411da040a5c9111bb32d [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:10.220234 18342 raft_consensus.cc:504] T 5eb58463867d4057b47e82a3a38d0c79 P 7bc375740395411da040a5c9111bb32d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc375740395411da040a5c9111bb32d" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46567 } } peers { permanent_uuid: "574de84d62eb4b68811043701d2301fd" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41497 } } peers { permanent_uuid: "d6b5267961ac4d66a44999b51395b345" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42983 } }
I20260805 22:47:10.220448 18342 leader_election.cc:288] T 5eb58463867d4057b47e82a3a38d0c79 P 7bc375740395411da040a5c9111bb32d [CANDIDATE]: Term 1 election: Requested vote from peers 574de84d62eb4b68811043701d2301fd (127.14.224.130:41497), d6b5267961ac4d66a44999b51395b345 (127.14.224.129:42983)
I20260805 22:47:10.220549 18038 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5eb58463867d4057b47e82a3a38d0c79" candidate_uuid: "7bc375740395411da040a5c9111bb32d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "574de84d62eb4b68811043701d2301fd"
I20260805 22:47:10.220599 17842 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5eb58463867d4057b47e82a3a38d0c79" candidate_uuid: "7bc375740395411da040a5c9111bb32d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6b5267961ac4d66a44999b51395b345"
I20260805 22:47:10.220645 18038 raft_consensus.cc:3037] T 5eb58463867d4057b47e82a3a38d0c79 P 574de84d62eb4b68811043701d2301fd [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:10.220667 17842 raft_consensus.cc:3037] T 5eb58463867d4057b47e82a3a38d0c79 P d6b5267961ac4d66a44999b51395b345 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:10.221341 17842 raft_consensus.cc:2454] T 5eb58463867d4057b47e82a3a38d0c79 P d6b5267961ac4d66a44999b51395b345 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7bc375740395411da040a5c9111bb32d in term 1.
I20260805 22:47:10.221390 18038 raft_consensus.cc:2454] T 5eb58463867d4057b47e82a3a38d0c79 P 574de84d62eb4b68811043701d2301fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7bc375740395411da040a5c9111bb32d in term 1.
I20260805 22:47:10.221547 18140 leader_election.cc:302] T 5eb58463867d4057b47e82a3a38d0c79 P 7bc375740395411da040a5c9111bb32d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7bc375740395411da040a5c9111bb32d, d6b5267961ac4d66a44999b51395b345; no voters:
I20260805 22:47:10.221658 18342 raft_consensus.cc:2781] T 5eb58463867d4057b47e82a3a38d0c79 P 7bc375740395411da040a5c9111bb32d [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:47:10.221822 18342 raft_consensus.cc:686] T 5eb58463867d4057b47e82a3a38d0c79 P 7bc375740395411da040a5c9111bb32d [term 1 LEADER]: Becoming Leader. State: Replica: 7bc375740395411da040a5c9111bb32d, State: Running, Role: LEADER
I20260805 22:47:10.221920 18342 consensus_queue.cc:237] T 5eb58463867d4057b47e82a3a38d0c79 P 7bc375740395411da040a5c9111bb32d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc375740395411da040a5c9111bb32d" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46567 } } peers { permanent_uuid: "574de84d62eb4b68811043701d2301fd" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41497 } } peers { permanent_uuid: "d6b5267961ac4d66a44999b51395b345" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42983 } }
I20260805 22:47:10.222806 17616 catalog_manager.cc:5495] T 5eb58463867d4057b47e82a3a38d0c79 P 7bc375740395411da040a5c9111bb32d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7bc375740395411da040a5c9111bb32d (127.14.224.131). New cstate: current_term: 1 leader_uuid: "7bc375740395411da040a5c9111bb32d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc375740395411da040a5c9111bb32d" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "574de84d62eb4b68811043701d2301fd" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6b5267961ac4d66a44999b51395b345" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42983 } health_report { overall_health: UNKNOWN } } }
Aug 05 22:47:10 dist-test-slave-gjrz krb5kdc[17552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970029, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.190@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
W20260805 22:47:10.257524 17905 tablet.cc:2369] T 5eb58463867d4057b47e82a3a38d0c79 P d6b5267961ac4d66a44999b51395b345: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:47:10.258670 17688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:10.252120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44430 (local address 127.14.224.190:44731)
0805 22:47:10.252192 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:10.252194 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:10.252291 (+ 97us) server_negotiation.cc:407] Connection header received
0805 22:47:10.252361 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:10.252362 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:10.252372 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:10.252412 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:10.252866 (+ 454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:10.253366 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:10.254070 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:10.254270 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:10.254325 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:10.256367 (+ 2042us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:10.256369 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:10.256369 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:10.256375 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:10.257651 (+ 1276us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:10.258062 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:10.258063 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:10.258063 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:10.258118 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:10.258262 (+ 144us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:10.258263 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:10.258263 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:10.258367 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:10.258414 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:10.258525 (+ 111us) server_negotiation.cc:299] Negotiation successful
0805 22:47:10.258602 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260805 22:47:10.258774 18356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:10.252038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:44731 (local address 127.0.0.1:44430)
0805 22:47:10.252225 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:10.252236 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:10.252299 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:10.252426 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:10.252426 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:10.252750 (+ 324us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:10.252803 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:10.252807 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:10.253429 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:10.253429 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:10.253968 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:10.253970 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:10.254327 (+ 357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:10.254328 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:10.254366 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:10.254851 (+ 485us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:10.254855 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:10.256275 (+ 1420us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:10.257757 (+ 1482us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:10.257768 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:10.257770 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:10.257981 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:10.258169 (+ 188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:10.258169 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:10.258169 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:10.258221 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:10.258409 (+ 188us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:10.258415 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:10.258460 (+ 45us) client_negotiation.cc:769] Sending connection context
0805 22:47:10.258509 (+ 49us) client_negotiation.cc:240] Negotiation successful
0805 22:47:10.258673 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"mutex_wait_us":46,"thread_start_us":95,"threads_started":1}
I20260805 22:47:10.260846 17616 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:44430:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260805 22:47:10.261137 17616 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:47:10.262600 17812 tablet_service.cc:1467] Processing CreateTablet for tablet 2b7d6a81a96d4c819bf8bf63963eb309 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=5b2adb07240a4cafa6c42766bbd67c0e]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260805 22:47:10.262697 18209 tablet_service.cc:1467] Processing CreateTablet for tablet 2b7d6a81a96d4c819bf8bf63963eb309 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=5b2adb07240a4cafa6c42766bbd67c0e]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260805 22:47:10.262735 18010 tablet_service.cc:1467] Processing CreateTablet for tablet 2b7d6a81a96d4c819bf8bf63963eb309 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=5b2adb07240a4cafa6c42766bbd67c0e]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260805 22:47:10.262809 17812 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b7d6a81a96d4c819bf8bf63963eb309. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:10.262868 18209 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b7d6a81a96d4c819bf8bf63963eb309. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:10.262880 18010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b7d6a81a96d4c819bf8bf63963eb309. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:10.264200 18335 tablet_bootstrap.cc:492] T 2b7d6a81a96d4c819bf8bf63963eb309 P 7bc375740395411da040a5c9111bb32d: Bootstrap starting.
I20260805 22:47:10.264379 18336 tablet_bootstrap.cc:492] T 2b7d6a81a96d4c819bf8bf63963eb309 P 574de84d62eb4b68811043701d2301fd: Bootstrap starting.
I20260805 22:47:10.264398 18338 tablet_bootstrap.cc:492] T 2b7d6a81a96d4c819bf8bf63963eb309 P d6b5267961ac4d66a44999b51395b345: Bootstrap starting.
I20260805 22:47:10.264693 18335 tablet_bootstrap.cc:654] T 2b7d6a81a96d4c819bf8bf63963eb309 P 7bc375740395411da040a5c9111bb32d: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:10.264829 18338 tablet_bootstrap.cc:654] T 2b7d6a81a96d4c819bf8bf63963eb309 P d6b5267961ac4d66a44999b51395b345: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:10.265095 18336 tablet_bootstrap.cc:654] T 2b7d6a81a96d4c819bf8bf63963eb309 P 574de84d62eb4b68811043701d2301fd: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:10.265476 18335 tablet_bootstrap.cc:492] T 2b7d6a81a96d4c819bf8bf63963eb309 P 7bc375740395411da040a5c9111bb32d: No bootstrap required, opened a new log
I20260805 22:47:10.265527 18335 ts_tablet_manager.cc:1397] T 2b7d6a81a96d4c819bf8bf63963eb309 P 7bc375740395411da040a5c9111bb32d: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260805 22:47:10.265669 18335 raft_consensus.cc:348] T 2b7d6a81a96d4c819bf8bf63963eb309 P 7bc375740395411da040a5c9111bb32d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6b5267961ac4d66a44999b51395b345" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42983 } } peers { permanent_uuid: "574de84d62eb4b68811043701d2301fd" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41497 } } peers { permanent_uuid: "7bc375740395411da040a5c9111bb32d" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46567 } }
I20260805 22:47:10.265750 18335 raft_consensus.cc:374] T 2b7d6a81a96d4c819bf8bf63963eb309 P 7bc375740395411da040a5c9111bb32d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:10.265766 18335 raft_consensus.cc:729] T 2b7d6a81a96d4c819bf8bf63963eb309 P 7bc375740395411da040a5c9111bb32d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bc375740395411da040a5c9111bb32d, State: Initialized, Role: FOLLOWER
I20260805 22:47:10.265754 18336 tablet_bootstrap.cc:492] T 2b7d6a81a96d4c819bf8bf63963eb309 P 574de84d62eb4b68811043701d2301fd: No bootstrap required, opened a new log
I20260805 22:47:10.265799 18336 ts_tablet_manager.cc:1397] T 2b7d6a81a96d4c819bf8bf63963eb309 P 574de84d62eb4b68811043701d2301fd: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260805 22:47:10.265805 18335 consensus_queue.cc:260] T 2b7d6a81a96d4c819bf8bf63963eb309 P 7bc375740395411da040a5c9111bb32d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6b5267961ac4d66a44999b51395b345" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42983 } } peers { permanent_uuid: "574de84d62eb4b68811043701d2301fd" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41497 } } peers { permanent_uuid: "7bc375740395411da040a5c9111bb32d" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46567 } }
I20260805 22:47:10.265829 18338 tablet_bootstrap.cc:492] T 2b7d6a81a96d4c819bf8bf63963eb309 P d6b5267961ac4d66a44999b51395b345: No bootstrap required, opened a new log
I20260805 22:47:10.265872 18338 ts_tablet_manager.cc:1397] T 2b7d6a81a96d4c819bf8bf63963eb309 P d6b5267961ac4d66a44999b51395b345: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260805 22:47:10.265890 18335 ts_tablet_manager.cc:1428] T 2b7d6a81a96d4c819bf8bf63963eb309 P 7bc375740395411da040a5c9111bb32d: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:10.265934 18342 tablet_replica.cc:439] T 2b7d6a81a96d4c819bf8bf63963eb309 P 7bc375740395411da040a5c9111bb32d: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6b5267961ac4d66a44999b51395b345" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42983 } } peers { permanent_uuid: "574de84d62eb4b68811043701d2301fd" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41497 } } peers { permanent_uuid: "7bc375740395411da040a5c9111bb32d" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46567 } } }
I20260805 22:47:10.266004 18342 tablet_replica.cc:442] T 2b7d6a81a96d4c819bf8bf63963eb309 P 7bc375740395411da040a5c9111bb32d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 22:47:10.265969 18336 raft_consensus.cc:348] T 2b7d6a81a96d4c819bf8bf63963eb309 P 574de84d62eb4b68811043701d2301fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6b5267961ac4d66a44999b51395b345" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42983 } } peers { permanent_uuid: "574de84d62eb4b68811043701d2301fd" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41497 } } peers { permanent_uuid: "7bc375740395411da040a5c9111bb32d" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46567 } }
I20260805 22:47:10.266049 18336 raft_consensus.cc:374] T 2b7d6a81a96d4c819bf8bf63963eb309 P 574de84d62eb4b68811043701d2301fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:10.266065 18336 raft_consensus.cc:729] T 2b7d6a81a96d4c819bf8bf63963eb309 P 574de84d62eb4b68811043701d2301fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 574de84d62eb4b68811043701d2301fd, State: Initialized, Role: FOLLOWER
I20260805 22:47:10.266108 18336 consensus_queue.cc:260] T 2b7d6a81a96d4c819bf8bf63963eb309 P 574de84d62eb4b68811043701d2301fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6b5267961ac4d66a44999b51395b345" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42983 } } peers { permanent_uuid: "574de84d62eb4b68811043701d2301fd" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41497 } } peers { permanent_uuid: "7bc375740395411da040a5c9111bb32d" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46567 } }
I20260805 22:47:10.266191 18338 raft_consensus.cc:348] T 2b7d6a81a96d4c819bf8bf63963eb309 P d6b5267961ac4d66a44999b51395b345 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6b5267961ac4d66a44999b51395b345" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42983 } } peers { permanent_uuid: "574de84d62eb4b68811043701d2301fd" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41497 } } peers { permanent_uuid: "7bc375740395411da040a5c9111bb32d" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46567 } }
I20260805 22:47:10.266223 18336 ts_tablet_manager.cc:1428] T 2b7d6a81a96d4c819bf8bf63963eb309 P 574de84d62eb4b68811043701d2301fd: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:10.266264 18338 raft_consensus.cc:374] T 2b7d6a81a96d4c819bf8bf63963eb309 P d6b5267961ac4d66a44999b51395b345 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:10.266288 18338 raft_consensus.cc:729] T 2b7d6a81a96d4c819bf8bf63963eb309 P d6b5267961ac4d66a44999b51395b345 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6b5267961ac4d66a44999b51395b345, State: Initialized, Role: FOLLOWER
I20260805 22:47:10.266332 18338 consensus_queue.cc:260] T 2b7d6a81a96d4c819bf8bf63963eb309 P d6b5267961ac4d66a44999b51395b345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6b5267961ac4d66a44999b51395b345" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42983 } } peers { permanent_uuid: "574de84d62eb4b68811043701d2301fd" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41497 } } peers { permanent_uuid: "7bc375740395411da040a5c9111bb32d" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46567 } }
I20260805 22:47:10.266425 18338 ts_tablet_manager.cc:1428] T 2b7d6a81a96d4c819bf8bf63963eb309 P d6b5267961ac4d66a44999b51395b345: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260805 22:47:10.266513 18344 tablet_replica.cc:439] T 2b7d6a81a96d4c819bf8bf63963eb309 P d6b5267961ac4d66a44999b51395b345: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6b5267961ac4d66a44999b51395b345" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42983 } } peers { permanent_uuid: "574de84d62eb4b68811043701d2301fd" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41497 } } peers { permanent_uuid: "7bc375740395411da040a5c9111bb32d" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46567 } } }
I20260805 22:47:10.266567 18343 tablet_replica.cc:439] T 2b7d6a81a96d4c819bf8bf63963eb309 P 574de84d62eb4b68811043701d2301fd: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6b5267961ac4d66a44999b51395b345" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42983 } } peers { permanent_uuid: "574de84d62eb4b68811043701d2301fd" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41497 } } peers { permanent_uuid: "7bc375740395411da040a5c9111bb32d" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46567 } } }
I20260805 22:47:10.266623 18344 tablet_replica.cc:442] T 2b7d6a81a96d4c819bf8bf63963eb309 P d6b5267961ac4d66a44999b51395b345: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 22:47:10.266642 18343 tablet_replica.cc:442] T 2b7d6a81a96d4c819bf8bf63963eb309 P 574de84d62eb4b68811043701d2301fd: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 22:47:10.301155 18342 raft_consensus.cc:482] T 2b7d6a81a96d4c819bf8bf63963eb309 P 7bc375740395411da040a5c9111bb32d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:47:10.301262 18342 raft_consensus.cc:504] T 2b7d6a81a96d4c819bf8bf63963eb309 P 7bc375740395411da040a5c9111bb32d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6b5267961ac4d66a44999b51395b345" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42983 } } peers { permanent_uuid: "574de84d62eb4b68811043701d2301fd" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41497 } } peers { permanent_uuid: "7bc375740395411da040a5c9111bb32d" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46567 } }
I20260805 22:47:10.301434 18342 leader_election.cc:288] T 2b7d6a81a96d4c819bf8bf63963eb309 P 7bc375740395411da040a5c9111bb32d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d6b5267961ac4d66a44999b51395b345 (127.14.224.129:42983), 574de84d62eb4b68811043701d2301fd (127.14.224.130:41497)
I20260805 22:47:10.301841 17842 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b7d6a81a96d4c819bf8bf63963eb309" candidate_uuid: "7bc375740395411da040a5c9111bb32d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6b5267961ac4d66a44999b51395b345" is_pre_election: true
I20260805 22:47:10.301857 18038 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b7d6a81a96d4c819bf8bf63963eb309" candidate_uuid: "7bc375740395411da040a5c9111bb32d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "574de84d62eb4b68811043701d2301fd" is_pre_election: true
I20260805 22:47:10.301975 17842 raft_consensus.cc:2454] T 2b7d6a81a96d4c819bf8bf63963eb309 P d6b5267961ac4d66a44999b51395b345 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7bc375740395411da040a5c9111bb32d in term 0.
I20260805 22:47:10.301975 18038 raft_consensus.cc:2454] T 2b7d6a81a96d4c819bf8bf63963eb309 P 574de84d62eb4b68811043701d2301fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7bc375740395411da040a5c9111bb32d in term 0.
I20260805 22:47:10.302194 18140 leader_election.cc:302] T 2b7d6a81a96d4c819bf8bf63963eb309 P 7bc375740395411da040a5c9111bb32d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7bc375740395411da040a5c9111bb32d, d6b5267961ac4d66a44999b51395b345; no voters:
I20260805 22:47:10.302335 18342 raft_consensus.cc:2781] T 2b7d6a81a96d4c819bf8bf63963eb309 P 7bc375740395411da040a5c9111bb32d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:47:10.302399 18342 raft_consensus.cc:482] T 2b7d6a81a96d4c819bf8bf63963eb309 P 7bc375740395411da040a5c9111bb32d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:47:10.302424 18342 raft_consensus.cc:3037] T 2b7d6a81a96d4c819bf8bf63963eb309 P 7bc375740395411da040a5c9111bb32d [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:10.303117 18342 raft_consensus.cc:504] T 2b7d6a81a96d4c819bf8bf63963eb309 P 7bc375740395411da040a5c9111bb32d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6b5267961ac4d66a44999b51395b345" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42983 } } peers { permanent_uuid: "574de84d62eb4b68811043701d2301fd" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41497 } } peers { permanent_uuid: "7bc375740395411da040a5c9111bb32d" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46567 } }
I20260805 22:47:10.303237 18342 leader_election.cc:288] T 2b7d6a81a96d4c819bf8bf63963eb309 P 7bc375740395411da040a5c9111bb32d [CANDIDATE]: Term 1 election: Requested vote from peers d6b5267961ac4d66a44999b51395b345 (127.14.224.129:42983), 574de84d62eb4b68811043701d2301fd (127.14.224.130:41497)
I20260805 22:47:10.303424 17842 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b7d6a81a96d4c819bf8bf63963eb309" candidate_uuid: "7bc375740395411da040a5c9111bb32d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6b5267961ac4d66a44999b51395b345"
I20260805 22:47:10.303499 17842 raft_consensus.cc:3037] T 2b7d6a81a96d4c819bf8bf63963eb309 P d6b5267961ac4d66a44999b51395b345 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:10.303483 18038 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b7d6a81a96d4c819bf8bf63963eb309" candidate_uuid: "7bc375740395411da040a5c9111bb32d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "574de84d62eb4b68811043701d2301fd"
I20260805 22:47:10.303568 18038 raft_consensus.cc:3037] T 2b7d6a81a96d4c819bf8bf63963eb309 P 574de84d62eb4b68811043701d2301fd [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:10.304131 17842 raft_consensus.cc:2454] T 2b7d6a81a96d4c819bf8bf63963eb309 P d6b5267961ac4d66a44999b51395b345 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7bc375740395411da040a5c9111bb32d in term 1.
I20260805 22:47:10.304291 18038 raft_consensus.cc:2454] T 2b7d6a81a96d4c819bf8bf63963eb309 P 574de84d62eb4b68811043701d2301fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7bc375740395411da040a5c9111bb32d in term 1.
I20260805 22:47:10.304430 18140 leader_election.cc:302] T 2b7d6a81a96d4c819bf8bf63963eb309 P 7bc375740395411da040a5c9111bb32d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7bc375740395411da040a5c9111bb32d, d6b5267961ac4d66a44999b51395b345; no voters:
I20260805 22:47:10.304548 18342 raft_consensus.cc:2781] T 2b7d6a81a96d4c819bf8bf63963eb309 P 7bc375740395411da040a5c9111bb32d [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:47:10.304616 18342 raft_consensus.cc:686] T 2b7d6a81a96d4c819bf8bf63963eb309 P 7bc375740395411da040a5c9111bb32d [term 1 LEADER]: Becoming Leader. State: Replica: 7bc375740395411da040a5c9111bb32d, State: Running, Role: LEADER
I20260805 22:47:10.304670 18342 consensus_queue.cc:237] T 2b7d6a81a96d4c819bf8bf63963eb309 P 7bc375740395411da040a5c9111bb32d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6b5267961ac4d66a44999b51395b345" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42983 } } peers { permanent_uuid: "574de84d62eb4b68811043701d2301fd" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41497 } } peers { permanent_uuid: "7bc375740395411da040a5c9111bb32d" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46567 } }
I20260805 22:47:10.305008 18347 tablet_replica.cc:439] T 2b7d6a81a96d4c819bf8bf63963eb309 P 7bc375740395411da040a5c9111bb32d: TxnStatusTablet state changed. Reason: New leader 7bc375740395411da040a5c9111bb32d. Latest consensus state: current_term: 1 leader_uuid: "7bc375740395411da040a5c9111bb32d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6b5267961ac4d66a44999b51395b345" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42983 } } peers { permanent_uuid: "574de84d62eb4b68811043701d2301fd" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41497 } } peers { permanent_uuid: "7bc375740395411da040a5c9111bb32d" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46567 } } }
I20260805 22:47:10.305104 18347 tablet_replica.cc:442] T 2b7d6a81a96d4c819bf8bf63963eb309 P 7bc375740395411da040a5c9111bb32d: This TxnStatusTablet replica's current role is: LEADER
I20260805 22:47:10.305330 18362 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260805 22:47:10.305480 18362 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260805 22:47:10.305342 17615 catalog_manager.cc:5495] T 2b7d6a81a96d4c819bf8bf63963eb309 P 7bc375740395411da040a5c9111bb32d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7bc375740395411da040a5c9111bb32d (127.14.224.131). New cstate: current_term: 1 leader_uuid: "7bc375740395411da040a5c9111bb32d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6b5267961ac4d66a44999b51395b345" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "574de84d62eb4b68811043701d2301fd" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7bc375740395411da040a5c9111bb32d" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46567 } health_report { overall_health: HEALTHY } } }
I20260805 22:47:10.315133 18356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:10.312028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.131:46567 (local address 127.0.0.1:58306)
0805 22:47:10.312142 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:10.312157 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:10.312214 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:10.312385 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:10.312386 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:10.312387 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0805 22:47:10.312438 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:10.312441 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:10.313322 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:10.313323 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:10.313915 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:10.313917 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:10.314444 (+ 527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:10.314446 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:10.314514 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:10.314535 (+ 21us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0805 22:47:10.314906 (+ 371us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0805 22:47:10.314921 (+ 15us) client_negotiation.cc:769] Sending connection context
0805 22:47:10.314999 (+ 78us) client_negotiation.cc:240] Negotiation successful
0805 22:47:10.315065 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":57}
I20260805 22:47:10.315125 18333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:10.312145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58306 (local address 127.14.224.131:46567)
0805 22:47:10.312214 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:10.312216 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:10.312227 (+ 11us) server_negotiation.cc:407] Connection header received
0805 22:47:10.312284 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:10.312285 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:10.312306 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:10.312374 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:47:10.312478 (+ 104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:10.313235 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:10.314010 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:10.314309 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:10.314377 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:10.314666 (+ 289us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:47:10.314798 (+ 132us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:47:10.314886 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:10.315007 (+ 121us) server_negotiation.cc:299] Negotiation successful
0805 22:47:10.315039 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260805 22:47:10.317253 17842 raft_consensus.cc:1261] T 2b7d6a81a96d4c819bf8bf63963eb309 P d6b5267961ac4d66a44999b51395b345 [term 1 FOLLOWER]: Refusing update from remote peer 7bc375740395411da040a5c9111bb32d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:47:10.317288 18038 raft_consensus.cc:1261] T 2b7d6a81a96d4c819bf8bf63963eb309 P 574de84d62eb4b68811043701d2301fd [term 1 FOLLOWER]: Refusing update from remote peer 7bc375740395411da040a5c9111bb32d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:47:10.317691 18342 consensus_queue.cc:1035] T 2b7d6a81a96d4c819bf8bf63963eb309 P 7bc375740395411da040a5c9111bb32d [LEADER]: Connected to new peer: Peer: permanent_uuid: "574de84d62eb4b68811043701d2301fd" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:47:10.317855 18347 consensus_queue.cc:1035] T 2b7d6a81a96d4c819bf8bf63963eb309 P 7bc375740395411da040a5c9111bb32d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6b5267961ac4d66a44999b51395b345" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:47:10.319288 18344 tablet_replica.cc:439] T 2b7d6a81a96d4c819bf8bf63963eb309 P d6b5267961ac4d66a44999b51395b345: TxnStatusTablet state changed. Reason: New leader 7bc375740395411da040a5c9111bb32d. Latest consensus state: current_term: 1 leader_uuid: "7bc375740395411da040a5c9111bb32d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6b5267961ac4d66a44999b51395b345" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42983 } } peers { permanent_uuid: "574de84d62eb4b68811043701d2301fd" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41497 } } peers { permanent_uuid: "7bc375740395411da040a5c9111bb32d" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46567 } } }
I20260805 22:47:10.319394 18344 tablet_replica.cc:442] T 2b7d6a81a96d4c819bf8bf63963eb309 P d6b5267961ac4d66a44999b51395b345: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 22:47:10.319985 18343 tablet_replica.cc:439] T 2b7d6a81a96d4c819bf8bf63963eb309 P 574de84d62eb4b68811043701d2301fd: TxnStatusTablet state changed. Reason: New leader 7bc375740395411da040a5c9111bb32d. Latest consensus state: current_term: 1 leader_uuid: "7bc375740395411da040a5c9111bb32d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6b5267961ac4d66a44999b51395b345" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42983 } } peers { permanent_uuid: "574de84d62eb4b68811043701d2301fd" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41497 } } peers { permanent_uuid: "7bc375740395411da040a5c9111bb32d" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46567 } } }
I20260805 22:47:10.320111 18343 tablet_replica.cc:442] T 2b7d6a81a96d4c819bf8bf63963eb309 P 574de84d62eb4b68811043701d2301fd: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 22:47:10.321197 18347 tablet_replica.cc:439] T 2b7d6a81a96d4c819bf8bf63963eb309 P 7bc375740395411da040a5c9111bb32d: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7bc375740395411da040a5c9111bb32d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6b5267961ac4d66a44999b51395b345" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42983 } } peers { permanent_uuid: "574de84d62eb4b68811043701d2301fd" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41497 } } peers { permanent_uuid: "7bc375740395411da040a5c9111bb32d" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46567 } } }
I20260805 22:47:10.321301 18347 tablet_replica.cc:442] T 2b7d6a81a96d4c819bf8bf63963eb309 P 7bc375740395411da040a5c9111bb32d: This TxnStatusTablet replica's current role is: LEADER
I20260805 22:47:10.321352 18347 tablet_replica.cc:439] T 2b7d6a81a96d4c819bf8bf63963eb309 P 7bc375740395411da040a5c9111bb32d: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7bc375740395411da040a5c9111bb32d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6b5267961ac4d66a44999b51395b345" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42983 } } peers { permanent_uuid: "574de84d62eb4b68811043701d2301fd" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41497 } } peers { permanent_uuid: "7bc375740395411da040a5c9111bb32d" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46567 } } }
I20260805 22:47:10.321388 18347 tablet_replica.cc:442] T 2b7d6a81a96d4c819bf8bf63963eb309 P 7bc375740395411da040a5c9111bb32d: This TxnStatusTablet replica's current role is: LEADER
I20260805 22:47:10.321455 18366 mvcc.cc:205] Tried to move back new op lower bound from 7315333244176654336 to 7315333244128342016. Current Snapshot: MvccSnapshot[applied={T|T < 7315333244176654336}]
I20260805 22:47:10.321898 18344 tablet_replica.cc:439] T 2b7d6a81a96d4c819bf8bf63963eb309 P d6b5267961ac4d66a44999b51395b345: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7bc375740395411da040a5c9111bb32d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6b5267961ac4d66a44999b51395b345" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42983 } } peers { permanent_uuid: "574de84d62eb4b68811043701d2301fd" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41497 } } peers { permanent_uuid: "7bc375740395411da040a5c9111bb32d" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46567 } } }
I20260805 22:47:10.322006 18344 tablet_replica.cc:442] T 2b7d6a81a96d4c819bf8bf63963eb309 P d6b5267961ac4d66a44999b51395b345: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 22:47:10.322304 18343 tablet_replica.cc:439] T 2b7d6a81a96d4c819bf8bf63963eb309 P 574de84d62eb4b68811043701d2301fd: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7bc375740395411da040a5c9111bb32d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6b5267961ac4d66a44999b51395b345" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42983 } } peers { permanent_uuid: "574de84d62eb4b68811043701d2301fd" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41497 } } peers { permanent_uuid: "7bc375740395411da040a5c9111bb32d" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46567 } } }
I20260805 22:47:10.322397 18343 tablet_replica.cc:442] T 2b7d6a81a96d4c819bf8bf63963eb309 P 574de84d62eb4b68811043701d2301fd: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 22:47:10.322530 18370 mvcc.cc:205] Tried to move back new op lower bound from 7315333244176654336 to 7315333244128342016. Current Snapshot: MvccSnapshot[applied={T|T < 7315333244176654336}]
I20260805 22:47:10.322623 18368 mvcc.cc:205] Tried to move back new op lower bound from 7315333244176654336 to 7315333244128342016. Current Snapshot: MvccSnapshot[applied={T|T < 7315333244176654336}]
W20260805 22:47:10.325672 18305 tablet.cc:2369] T 5eb58463867d4057b47e82a3a38d0c79 P 7bc375740395411da040a5c9111bb32d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:47:10.326459 18333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:10.323684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58322 (local address 127.14.224.131:46567)
0805 22:47:10.323727 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:10.323729 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:10.323761 (+ 32us) server_negotiation.cc:407] Connection header received
0805 22:47:10.323839 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:10.323840 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:10.323849 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:10.323900 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:47:10.324070 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:10.324544 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:10.325676 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:10.325956 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:10.326023 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:10.326226 (+ 203us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:47:10.326262 (+ 36us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:47:10.326318 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:10.326379 (+ 61us) server_negotiation.cc:299] Negotiation successful
0805 22:47:10.326402 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260805 22:47:10.332021 18333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:10.329377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:55293 (local address 127.14.224.131:46567)
0805 22:47:10.329412 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:10.329414 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:10.329465 (+ 51us) server_negotiation.cc:407] Connection header received
0805 22:47:10.329515 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:10.329516 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:10.329525 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:10.329574 (+ 49us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:47:10.329711 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:10.330436 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:10.331199 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:10.331536 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:10.331604 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:10.331762 (+ 158us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:47:10.331797 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:47:10.331843 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:10.331882 (+ 39us) server_negotiation.cc:299] Negotiation successful
0805 22:47:10.331909 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260805 22:47:10.332021 18314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:10.329324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.131:46567 (local address 127.14.224.131:55293)
0805 22:47:10.329403 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:10.329416 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:10.329472 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:10.329584 (+ 112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:10.329585 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:10.329586 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0805 22:47:10.329644 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:10.329646 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:10.330522 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:10.330523 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:10.331124 (+ 601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:10.331127 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:10.331604 (+ 477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:10.331605 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:10.331656 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:10.331673 (+ 17us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0805 22:47:10.331847 (+ 174us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0805 22:47:10.331848 (+ 1us) client_negotiation.cc:769] Sending connection context
0805 22:47:10.331879 (+ 31us) client_negotiation.cc:240] Negotiation successful
0805 22:47:10.331917 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22}
I20260805 22:47:10.334345 18038 raft_consensus.cc:1261] T 5eb58463867d4057b47e82a3a38d0c79 P 574de84d62eb4b68811043701d2301fd [term 1 FOLLOWER]: Refusing update from remote peer 7bc375740395411da040a5c9111bb32d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:47:10.334405 17842 raft_consensus.cc:1261] T 5eb58463867d4057b47e82a3a38d0c79 P d6b5267961ac4d66a44999b51395b345 [term 1 FOLLOWER]: Refusing update from remote peer 7bc375740395411da040a5c9111bb32d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:47:10.334620 18383 consensus_queue.cc:1035] T 5eb58463867d4057b47e82a3a38d0c79 P 7bc375740395411da040a5c9111bb32d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6b5267961ac4d66a44999b51395b345" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:47:10.334730 18347 consensus_queue.cc:1035] T 5eb58463867d4057b47e82a3a38d0c79 P 7bc375740395411da040a5c9111bb32d [LEADER]: Connected to new peer: Peer: permanent_uuid: "574de84d62eb4b68811043701d2301fd" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:47:10.347254 17616 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44428:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:47:10.347422 17616 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44428:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:47:10.348253 17616 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 24e02d789cd748848fdaef4d12844340: Sending DeleteTablet for 3 replicas of tablet 5eb58463867d4057b47e82a3a38d0c79
I20260805 22:47:10.348594 18010 tablet_service.cc:1514] Processing DeleteTablet for tablet 5eb58463867d4057b47e82a3a38d0c79 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:47:10 UTC) from {username='kudu', principal='kudu/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:46562
I20260805 22:47:10.348646 18206 tablet_service.cc:1514] Processing DeleteTablet for tablet 5eb58463867d4057b47e82a3a38d0c79 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:47:10 UTC) from {username='kudu', principal='kudu/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:58294
I20260805 22:47:10.348711 17812 tablet_service.cc:1514] Processing DeleteTablet for tablet 5eb58463867d4057b47e82a3a38d0c79 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:47:10 UTC) from {username='kudu', principal='kudu/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:46274
I20260805 22:47:10.348923 18393 tablet_replica.cc:330] T 5eb58463867d4057b47e82a3a38d0c79 P 574de84d62eb4b68811043701d2301fd: stopping tablet replica
I20260805 22:47:10.348934 17616 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44428:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260805 22:47:10.349052 18393 raft_consensus.cc:2229] T 5eb58463867d4057b47e82a3a38d0c79 P 574de84d62eb4b68811043701d2301fd [term 1 FOLLOWER]: Raft consensus shutting down.
W20260805 22:47:10.349083 17616 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:47:10.349120 18393 raft_consensus.cc:2258] T 5eb58463867d4057b47e82a3a38d0c79 P 574de84d62eb4b68811043701d2301fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:47:10.349682 18396 tablet_replica.cc:330] T 5eb58463867d4057b47e82a3a38d0c79 P d6b5267961ac4d66a44999b51395b345: stopping tablet replica
I20260805 22:47:10.349834 18395 tablet_replica.cc:330] T 5eb58463867d4057b47e82a3a38d0c79 P 7bc375740395411da040a5c9111bb32d: stopping tablet replica
I20260805 22:47:10.349989 18393 ts_tablet_manager.cc:1905] T 5eb58463867d4057b47e82a3a38d0c79 P 574de84d62eb4b68811043701d2301fd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:47:10.350270 18010 tablet_service.cc:1467] Processing CreateTablet for tablet ad8ca177f641476ab7e46fb87d4d5907 (DEFAULT_TABLE table=test-table [id=824a51afa60f42549be11eab9ccdda4c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:47:10.350409 18010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad8ca177f641476ab7e46fb87d4d5907. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:10.350392 18206 tablet_service.cc:1467] Processing CreateTablet for tablet ad8ca177f641476ab7e46fb87d4d5907 (DEFAULT_TABLE table=test-table [id=824a51afa60f42549be11eab9ccdda4c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:47:10.350514 18206 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad8ca177f641476ab7e46fb87d4d5907. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:10.351827 18336 tablet_bootstrap.cc:492] T ad8ca177f641476ab7e46fb87d4d5907 P 574de84d62eb4b68811043701d2301fd: Bootstrap starting.
I20260805 22:47:10.351930 18393 ts_tablet_manager.cc:1918] T 5eb58463867d4057b47e82a3a38d0c79 P 574de84d62eb4b68811043701d2301fd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260805 22:47:10.352003 18393 log.cc:1196] T 5eb58463867d4057b47e82a3a38d0c79 P 574de84d62eb4b68811043701d2301fd: Deleting WAL directory at /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/ts-1/wal/wals/5eb58463867d4057b47e82a3a38d0c79
I20260805 22:47:10.352007 18335 tablet_bootstrap.cc:492] T ad8ca177f641476ab7e46fb87d4d5907 P 7bc375740395411da040a5c9111bb32d: Bootstrap starting.
I20260805 22:47:10.352255 18393 ts_tablet_manager.cc:1939] T 5eb58463867d4057b47e82a3a38d0c79 P 574de84d62eb4b68811043701d2301fd: Deleting consensus metadata
I20260805 22:47:10.352254 18336 tablet_bootstrap.cc:654] T ad8ca177f641476ab7e46fb87d4d5907 P 574de84d62eb4b68811043701d2301fd: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:10.352391 18335 tablet_bootstrap.cc:654] T ad8ca177f641476ab7e46fb87d4d5907 P 7bc375740395411da040a5c9111bb32d: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:10.352707 17591 catalog_manager.cc:4841] TS 574de84d62eb4b68811043701d2301fd (127.14.224.130:41497): tablet 5eb58463867d4057b47e82a3a38d0c79 (table test-table [id=86c48a1a07dd46a7932007e16096ef70]) successfully deleted
I20260805 22:47:10.350306 17812 tablet_service.cc:1467] Processing CreateTablet for tablet ad8ca177f641476ab7e46fb87d4d5907 (DEFAULT_TABLE table=test-table [id=824a51afa60f42549be11eab9ccdda4c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:47:10.352950 17812 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad8ca177f641476ab7e46fb87d4d5907. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:10.353080 18336 tablet_bootstrap.cc:492] T ad8ca177f641476ab7e46fb87d4d5907 P 574de84d62eb4b68811043701d2301fd: No bootstrap required, opened a new log
I20260805 22:47:10.353127 18336 ts_tablet_manager.cc:1397] T ad8ca177f641476ab7e46fb87d4d5907 P 574de84d62eb4b68811043701d2301fd: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260805 22:47:10.353271 18336 raft_consensus.cc:348] T ad8ca177f641476ab7e46fb87d4d5907 P 574de84d62eb4b68811043701d2301fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6b5267961ac4d66a44999b51395b345" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42983 } } peers { permanent_uuid: "574de84d62eb4b68811043701d2301fd" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41497 } } peers { permanent_uuid: "7bc375740395411da040a5c9111bb32d" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46567 } }
I20260805 22:47:10.353345 18336 raft_consensus.cc:374] T ad8ca177f641476ab7e46fb87d4d5907 P 574de84d62eb4b68811043701d2301fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:10.353365 18336 raft_consensus.cc:729] T ad8ca177f641476ab7e46fb87d4d5907 P 574de84d62eb4b68811043701d2301fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 574de84d62eb4b68811043701d2301fd, State: Initialized, Role: FOLLOWER
I20260805 22:47:10.353403 18336 consensus_queue.cc:260] T ad8ca177f641476ab7e46fb87d4d5907 P 574de84d62eb4b68811043701d2301fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6b5267961ac4d66a44999b51395b345" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42983 } } peers { permanent_uuid: "574de84d62eb4b68811043701d2301fd" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41497 } } peers { permanent_uuid: "7bc375740395411da040a5c9111bb32d" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46567 } }
I20260805 22:47:10.353498 18336 ts_tablet_manager.cc:1428] T ad8ca177f641476ab7e46fb87d4d5907 P 574de84d62eb4b68811043701d2301fd: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260805 22:47:10.354195 18338 tablet_bootstrap.cc:492] T ad8ca177f641476ab7e46fb87d4d5907 P d6b5267961ac4d66a44999b51395b345: Bootstrap starting.
I20260805 22:47:10.354409 18396 raft_consensus.cc:2229] T 5eb58463867d4057b47e82a3a38d0c79 P d6b5267961ac4d66a44999b51395b345 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:47:10.354497 18396 raft_consensus.cc:2258] T 5eb58463867d4057b47e82a3a38d0c79 P d6b5267961ac4d66a44999b51395b345 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:47:10.354590 18338 tablet_bootstrap.cc:654] T ad8ca177f641476ab7e46fb87d4d5907 P d6b5267961ac4d66a44999b51395b345: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:10.354673 18395 raft_consensus.cc:2229] T 5eb58463867d4057b47e82a3a38d0c79 P 7bc375740395411da040a5c9111bb32d [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:47:10.354795 18395 raft_consensus.cc:2258] T 5eb58463867d4057b47e82a3a38d0c79 P 7bc375740395411da040a5c9111bb32d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:47:10.355221 18338 tablet_bootstrap.cc:492] T ad8ca177f641476ab7e46fb87d4d5907 P d6b5267961ac4d66a44999b51395b345: No bootstrap required, opened a new log
I20260805 22:47:10.355291 18338 ts_tablet_manager.cc:1397] T ad8ca177f641476ab7e46fb87d4d5907 P d6b5267961ac4d66a44999b51395b345: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260805 22:47:10.355315 18395 ts_tablet_manager.cc:1905] T 5eb58463867d4057b47e82a3a38d0c79 P 7bc375740395411da040a5c9111bb32d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:47:10.355432 18338 raft_consensus.cc:348] T ad8ca177f641476ab7e46fb87d4d5907 P d6b5267961ac4d66a44999b51395b345 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6b5267961ac4d66a44999b51395b345" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42983 } } peers { permanent_uuid: "574de84d62eb4b68811043701d2301fd" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41497 } } peers { permanent_uuid: "7bc375740395411da040a5c9111bb32d" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46567 } }
I20260805 22:47:10.355505 18338 raft_consensus.cc:374] T ad8ca177f641476ab7e46fb87d4d5907 P d6b5267961ac4d66a44999b51395b345 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:10.355525 18338 raft_consensus.cc:729] T ad8ca177f641476ab7e46fb87d4d5907 P d6b5267961ac4d66a44999b51395b345 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6b5267961ac4d66a44999b51395b345, State: Initialized, Role: FOLLOWER
I20260805 22:47:10.355568 18338 consensus_queue.cc:260] T ad8ca177f641476ab7e46fb87d4d5907 P d6b5267961ac4d66a44999b51395b345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6b5267961ac4d66a44999b51395b345" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42983 } } peers { permanent_uuid: "574de84d62eb4b68811043701d2301fd" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41497 } } peers { permanent_uuid: "7bc375740395411da040a5c9111bb32d" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46567 } }
I20260805 22:47:10.355659 18338 ts_tablet_manager.cc:1428] T ad8ca177f641476ab7e46fb87d4d5907 P d6b5267961ac4d66a44999b51395b345: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:10.356014 18396 ts_tablet_manager.cc:1905] T 5eb58463867d4057b47e82a3a38d0c79 P d6b5267961ac4d66a44999b51395b345: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:47:10.357649 18396 ts_tablet_manager.cc:1918] T 5eb58463867d4057b47e82a3a38d0c79 P d6b5267961ac4d66a44999b51395b345: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260805 22:47:10.357726 18396 log.cc:1196] T 5eb58463867d4057b47e82a3a38d0c79 P d6b5267961ac4d66a44999b51395b345: Deleting WAL directory at /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/ts-0/wal/wals/5eb58463867d4057b47e82a3a38d0c79
I20260805 22:47:10.357734 18335 tablet_bootstrap.cc:492] T ad8ca177f641476ab7e46fb87d4d5907 P 7bc375740395411da040a5c9111bb32d: No bootstrap required, opened a new log
I20260805 22:47:10.357801 18335 ts_tablet_manager.cc:1397] T ad8ca177f641476ab7e46fb87d4d5907 P 7bc375740395411da040a5c9111bb32d: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20260805 22:47:10.358000 18396 ts_tablet_manager.cc:1939] T 5eb58463867d4057b47e82a3a38d0c79 P d6b5267961ac4d66a44999b51395b345: Deleting consensus metadata
I20260805 22:47:10.358006 18335 raft_consensus.cc:348] T ad8ca177f641476ab7e46fb87d4d5907 P 7bc375740395411da040a5c9111bb32d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6b5267961ac4d66a44999b51395b345" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42983 } } peers { permanent_uuid: "574de84d62eb4b68811043701d2301fd" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41497 } } peers { permanent_uuid: "7bc375740395411da040a5c9111bb32d" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46567 } }
I20260805 22:47:10.358083 18335 raft_consensus.cc:374] T ad8ca177f641476ab7e46fb87d4d5907 P 7bc375740395411da040a5c9111bb32d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:10.358107 18335 raft_consensus.cc:729] T ad8ca177f641476ab7e46fb87d4d5907 P 7bc375740395411da040a5c9111bb32d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bc375740395411da040a5c9111bb32d, State: Initialized, Role: FOLLOWER
I20260805 22:47:10.358146 18335 consensus_queue.cc:260] T ad8ca177f641476ab7e46fb87d4d5907 P 7bc375740395411da040a5c9111bb32d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6b5267961ac4d66a44999b51395b345" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42983 } } peers { permanent_uuid: "574de84d62eb4b68811043701d2301fd" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41497 } } peers { permanent_uuid: "7bc375740395411da040a5c9111bb32d" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46567 } }
I20260805 22:47:10.358232 18335 ts_tablet_manager.cc:1428] T ad8ca177f641476ab7e46fb87d4d5907 P 7bc375740395411da040a5c9111bb32d: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260805 22:47:10.358448 17590 catalog_manager.cc:4841] TS d6b5267961ac4d66a44999b51395b345 (127.14.224.129:42983): tablet 5eb58463867d4057b47e82a3a38d0c79 (table test-table [id=86c48a1a07dd46a7932007e16096ef70]) successfully deleted
I20260805 22:47:10.359603 18395 ts_tablet_manager.cc:1918] T 5eb58463867d4057b47e82a3a38d0c79 P 7bc375740395411da040a5c9111bb32d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260805 22:47:10.359685 18395 log.cc:1196] T 5eb58463867d4057b47e82a3a38d0c79 P 7bc375740395411da040a5c9111bb32d: Deleting WAL directory at /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/ts-2/wal/wals/5eb58463867d4057b47e82a3a38d0c79
I20260805 22:47:10.359972 18395 ts_tablet_manager.cc:1939] T 5eb58463867d4057b47e82a3a38d0c79 P 7bc375740395411da040a5c9111bb32d: Deleting consensus metadata
I20260805 22:47:10.360435 17590 catalog_manager.cc:4841] TS 7bc375740395411da040a5c9111bb32d (127.14.224.131:46567): tablet 5eb58463867d4057b47e82a3a38d0c79 (table test-table [id=86c48a1a07dd46a7932007e16096ef70]) successfully deleted
I20260805 22:47:10.619500 18343 raft_consensus.cc:482] T ad8ca177f641476ab7e46fb87d4d5907 P 574de84d62eb4b68811043701d2301fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:47:10.619611 18343 raft_consensus.cc:504] T ad8ca177f641476ab7e46fb87d4d5907 P 574de84d62eb4b68811043701d2301fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6b5267961ac4d66a44999b51395b345" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42983 } } peers { permanent_uuid: "574de84d62eb4b68811043701d2301fd" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41497 } } peers { permanent_uuid: "7bc375740395411da040a5c9111bb32d" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46567 } }
I20260805 22:47:10.619884 18343 leader_election.cc:288] T ad8ca177f641476ab7e46fb87d4d5907 P 574de84d62eb4b68811043701d2301fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d6b5267961ac4d66a44999b51395b345 (127.14.224.129:42983), 7bc375740395411da040a5c9111bb32d (127.14.224.131:46567)
I20260805 22:47:10.622916 18333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:10.620353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:41753 (local address 127.14.224.131:46567)
0805 22:47:10.620417 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:10.620419 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:10.620506 (+ 87us) server_negotiation.cc:407] Connection header received
0805 22:47:10.620555 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:10.620557 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:10.620566 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:10.620621 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:47:10.620792 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:10.621247 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:10.622237 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:10.622600 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:10.622669 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:10.622680 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:10.622807 (+ 127us) server_negotiation.cc:299] Negotiation successful
0805 22:47:10.622847 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260805 22:47:10.622916 18334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:10.620145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:43495 (local address 127.14.224.129:42983)
0805 22:47:10.620199 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:10.620201 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:10.620288 (+ 87us) server_negotiation.cc:407] Connection header received
0805 22:47:10.620432 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:10.620433 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:10.620446 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:10.620507 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:47:10.620717 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:10.621216 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:10.622235 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:10.622595 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:10.622659 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:10.622668 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:10.622808 (+ 140us) server_negotiation.cc:299] Negotiation successful
0805 22:47:10.622849 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260805 22:47:10.622963 18401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:10.620073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.129:42983 (local address 127.14.224.130:43495)
0805 22:47:10.620215 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:10.620228 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:10.620298 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:10.620532 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:10.620533 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:10.620537 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:47:10.620634 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:10.620637 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:10.621291 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:10.621292 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:10.622139 (+ 847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:10.622141 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:10.622663 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:10.622664 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:10.622740 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:10.622745 (+ 5us) client_negotiation.cc:769] Sending connection context
0805 22:47:10.622792 (+ 47us) client_negotiation.cc:240] Negotiation successful
0805 22:47:10.622838 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"mutex_wait_us":27,"thread_start_us":80,"threads_started":1}
I20260805 22:47:10.622975 18402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:10.620272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.131:46567 (local address 127.14.224.130:41753)
0805 22:47:10.620420 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:10.620431 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:10.620506 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:10.620625 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:10.620626 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:10.620628 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:47:10.620687 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:10.620689 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:10.621329 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:10.621330 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:10.622146 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:10.622149 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:10.622678 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:10.622679 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:10.622746 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:10.622749 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:47:10.622794 (+ 45us) client_negotiation.cc:240] Negotiation successful
0805 22:47:10.622842 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"mutex_wait_us":2,"thread_start_us":38,"threads_started":1}
I20260805 22:47:10.623181 17842 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad8ca177f641476ab7e46fb87d4d5907" candidate_uuid: "574de84d62eb4b68811043701d2301fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6b5267961ac4d66a44999b51395b345" is_pre_election: true
I20260805 22:47:10.623291 17842 raft_consensus.cc:2454] T ad8ca177f641476ab7e46fb87d4d5907 P d6b5267961ac4d66a44999b51395b345 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 574de84d62eb4b68811043701d2301fd in term 0.
I20260805 22:47:10.623378 18242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad8ca177f641476ab7e46fb87d4d5907" candidate_uuid: "574de84d62eb4b68811043701d2301fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7bc375740395411da040a5c9111bb32d" is_pre_election: true
I20260805 22:47:10.623478 17937 leader_election.cc:302] T ad8ca177f641476ab7e46fb87d4d5907 P 574de84d62eb4b68811043701d2301fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 574de84d62eb4b68811043701d2301fd, d6b5267961ac4d66a44999b51395b345; no voters:
I20260805 22:47:10.623533 18242 raft_consensus.cc:2454] T ad8ca177f641476ab7e46fb87d4d5907 P 7bc375740395411da040a5c9111bb32d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 574de84d62eb4b68811043701d2301fd in term 0.
I20260805 22:47:10.623651 18343 raft_consensus.cc:2781] T ad8ca177f641476ab7e46fb87d4d5907 P 574de84d62eb4b68811043701d2301fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:47:10.623704 18343 raft_consensus.cc:482] T ad8ca177f641476ab7e46fb87d4d5907 P 574de84d62eb4b68811043701d2301fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:47:10.623739 18343 raft_consensus.cc:3037] T ad8ca177f641476ab7e46fb87d4d5907 P 574de84d62eb4b68811043701d2301fd [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:10.624446 18343 raft_consensus.cc:504] T ad8ca177f641476ab7e46fb87d4d5907 P 574de84d62eb4b68811043701d2301fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6b5267961ac4d66a44999b51395b345" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42983 } } peers { permanent_uuid: "574de84d62eb4b68811043701d2301fd" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41497 } } peers { permanent_uuid: "7bc375740395411da040a5c9111bb32d" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46567 } }
I20260805 22:47:10.624562 18343 leader_election.cc:288] T ad8ca177f641476ab7e46fb87d4d5907 P 574de84d62eb4b68811043701d2301fd [CANDIDATE]: Term 1 election: Requested vote from peers d6b5267961ac4d66a44999b51395b345 (127.14.224.129:42983), 7bc375740395411da040a5c9111bb32d (127.14.224.131:46567)
I20260805 22:47:10.624719 17842 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad8ca177f641476ab7e46fb87d4d5907" candidate_uuid: "574de84d62eb4b68811043701d2301fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6b5267961ac4d66a44999b51395b345"
I20260805 22:47:10.624766 18242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad8ca177f641476ab7e46fb87d4d5907" candidate_uuid: "574de84d62eb4b68811043701d2301fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7bc375740395411da040a5c9111bb32d"
I20260805 22:47:10.624818 17842 raft_consensus.cc:3037] T ad8ca177f641476ab7e46fb87d4d5907 P d6b5267961ac4d66a44999b51395b345 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:10.624825 18242 raft_consensus.cc:3037] T ad8ca177f641476ab7e46fb87d4d5907 P 7bc375740395411da040a5c9111bb32d [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:10.625576 17842 raft_consensus.cc:2454] T ad8ca177f641476ab7e46fb87d4d5907 P d6b5267961ac4d66a44999b51395b345 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 574de84d62eb4b68811043701d2301fd in term 1.
I20260805 22:47:10.625633 18242 raft_consensus.cc:2454] T ad8ca177f641476ab7e46fb87d4d5907 P 7bc375740395411da040a5c9111bb32d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 574de84d62eb4b68811043701d2301fd in term 1.
I20260805 22:47:10.625758 17937 leader_election.cc:302] T ad8ca177f641476ab7e46fb87d4d5907 P 574de84d62eb4b68811043701d2301fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 574de84d62eb4b68811043701d2301fd, 7bc375740395411da040a5c9111bb32d; no voters:
I20260805 22:47:10.625844 18343 raft_consensus.cc:2781] T ad8ca177f641476ab7e46fb87d4d5907 P 574de84d62eb4b68811043701d2301fd [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:47:10.625965 18343 raft_consensus.cc:686] T ad8ca177f641476ab7e46fb87d4d5907 P 574de84d62eb4b68811043701d2301fd [term 1 LEADER]: Becoming Leader. State: Replica: 574de84d62eb4b68811043701d2301fd, State: Running, Role: LEADER
I20260805 22:47:10.626040 18343 consensus_queue.cc:237] T ad8ca177f641476ab7e46fb87d4d5907 P 574de84d62eb4b68811043701d2301fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6b5267961ac4d66a44999b51395b345" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42983 } } peers { permanent_uuid: "574de84d62eb4b68811043701d2301fd" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41497 } } peers { permanent_uuid: "7bc375740395411da040a5c9111bb32d" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46567 } }
I20260805 22:47:10.626686 17616 catalog_manager.cc:5495] T ad8ca177f641476ab7e46fb87d4d5907 P 574de84d62eb4b68811043701d2301fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 574de84d62eb4b68811043701d2301fd (127.14.224.130). New cstate: current_term: 1 leader_uuid: "574de84d62eb4b68811043701d2301fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6b5267961ac4d66a44999b51395b345" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "574de84d62eb4b68811043701d2301fd" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7bc375740395411da040a5c9111bb32d" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46567 } health_report { overall_health: UNKNOWN } } }
I20260805 22:47:10.638911 18331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:10.636773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46568 (local address 127.14.224.130:41497)
0805 22:47:10.636824 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:10.636826 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:10.636833 (+ 7us) server_negotiation.cc:407] Connection header received
0805 22:47:10.636863 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:10.636864 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:10.636883 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:10.636943 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:47:10.637028 (+ 85us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:10.637549 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:10.638240 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:10.638423 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:10.638487 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:10.638587 (+ 100us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:47:10.638700 (+ 113us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:47:10.638756 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:10.638784 (+ 28us) server_negotiation.cc:299] Negotiation successful
0805 22:47:10.638800 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260805 22:47:10.643795 18333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:10.641450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:36323 (local address 127.14.224.131:46567)
0805 22:47:10.641511 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:10.641514 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:10.641562 (+ 48us) server_negotiation.cc:407] Connection header received
0805 22:47:10.641631 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:10.641632 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:10.641642 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:10.641689 (+ 47us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:47:10.641817 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:10.642305 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:10.643082 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:10.643313 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:10.643366 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:10.643548 (+ 182us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:47:10.643581 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:47:10.643622 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:10.643690 (+ 68us) server_negotiation.cc:299] Negotiation successful
0805 22:47:10.643710 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260805 22:47:10.643816 18409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:10.641356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.131:46567 (local address 127.14.224.130:36323)
0805 22:47:10.641506 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:10.641518 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:10.641580 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:10.641696 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:10.641697 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:10.641699 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0805 22:47:10.641762 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:10.641764 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:10.642384 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:10.642385 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:10.642997 (+ 612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:10.642999 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:10.643386 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:10.643387 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:10.643457 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:10.643474 (+ 17us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0805 22:47:10.643636 (+ 162us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0805 22:47:10.643638 (+ 2us) client_negotiation.cc:769] Sending connection context
0805 22:47:10.643685 (+ 47us) client_negotiation.cc:240] Negotiation successful
0805 22:47:10.643731 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":79,"threads_started":1}
I20260805 22:47:10.646104 17842 raft_consensus.cc:1261] T ad8ca177f641476ab7e46fb87d4d5907 P d6b5267961ac4d66a44999b51395b345 [term 1 FOLLOWER]: Refusing update from remote peer 574de84d62eb4b68811043701d2301fd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:47:10.646163 18242 raft_consensus.cc:1261] T ad8ca177f641476ab7e46fb87d4d5907 P 7bc375740395411da040a5c9111bb32d [term 1 FOLLOWER]: Refusing update from remote peer 574de84d62eb4b68811043701d2301fd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:47:10.646389 18343 consensus_queue.cc:1035] T ad8ca177f641476ab7e46fb87d4d5907 P 574de84d62eb4b68811043701d2301fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6b5267961ac4d66a44999b51395b345" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:47:10.646548 18403 consensus_queue.cc:1035] T ad8ca177f641476ab7e46fb87d4d5907 P 574de84d62eb4b68811043701d2301fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7bc375740395411da040a5c9111bb32d" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:47:10.653470 18331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:10.651068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:40659 (local address 127.14.224.130:41497)
0805 22:47:10.651110 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:10.651112 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:10.651135 (+ 23us) server_negotiation.cc:407] Connection header received
0805 22:47:10.651156 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:10.651157 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:10.651167 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:10.651210 (+ 43us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:47:10.651353 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:10.651963 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:10.652739 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:10.652926 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:10.652990 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:10.653160 (+ 170us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:47:10.653198 (+ 38us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:47:10.653251 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:10.653369 (+ 118us) server_negotiation.cc:299] Negotiation successful
0805 22:47:10.653392 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260805 22:47:10.653471 18314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:10.651008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.130:41497 (local address 127.14.224.131:40659)
0805 22:47:10.651054 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:10.651066 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:10.651110 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:10.651211 (+ 101us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:10.651211 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:10.651212 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0805 22:47:10.651293 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:10.651295 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:10.652034 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:10.652035 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:10.652595 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:10.652597 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:10.653026 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:10.653027 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:10.653086 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:10.653091 (+ 5us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0805 22:47:10.653318 (+ 227us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0805 22:47:10.653321 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:47:10.653357 (+ 36us) client_negotiation.cc:240] Negotiation successful
0805 22:47:10.653403 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21}
W20260805 22:47:10.653880 18370 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260805 22:47:12.173532 17615 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44428:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:47:12.173640 17615 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44428:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:47:12.174456 17615 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 24e02d789cd748848fdaef4d12844340: Sending DeleteTablet for 3 replicas of tablet ad8ca177f641476ab7e46fb87d4d5907
I20260805 22:47:12.174700 18010 tablet_service.cc:1514] Processing DeleteTablet for tablet ad8ca177f641476ab7e46fb87d4d5907 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:47:12 UTC) from {username='kudu', principal='kudu/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:46562
I20260805 22:47:12.174757 18206 tablet_service.cc:1514] Processing DeleteTablet for tablet ad8ca177f641476ab7e46fb87d4d5907 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:47:12 UTC) from {username='kudu', principal='kudu/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:58294
I20260805 22:47:12.174757 17812 tablet_service.cc:1514] Processing DeleteTablet for tablet ad8ca177f641476ab7e46fb87d4d5907 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:47:12 UTC) from {username='kudu', principal='kudu/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:46274
I20260805 22:47:12.174962 18448 tablet_replica.cc:330] T ad8ca177f641476ab7e46fb87d4d5907 P 7bc375740395411da040a5c9111bb32d: stopping tablet replica
I20260805 22:47:12.175066 18448 raft_consensus.cc:2229] T ad8ca177f641476ab7e46fb87d4d5907 P 7bc375740395411da040a5c9111bb32d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:47:12.175132 18448 raft_consensus.cc:2258] T ad8ca177f641476ab7e46fb87d4d5907 P 7bc375740395411da040a5c9111bb32d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:47:12.175379 18447 tablet_replica.cc:330] T ad8ca177f641476ab7e46fb87d4d5907 P 574de84d62eb4b68811043701d2301fd: stopping tablet replica
I20260805 22:47:12.175464 18447 raft_consensus.cc:2229] T ad8ca177f641476ab7e46fb87d4d5907 P 574de84d62eb4b68811043701d2301fd [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:47:12.175578 18447 raft_consensus.cc:2258] T ad8ca177f641476ab7e46fb87d4d5907 P 574de84d62eb4b68811043701d2301fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:47:12.175868 18447 ts_tablet_manager.cc:1905] T ad8ca177f641476ab7e46fb87d4d5907 P 574de84d62eb4b68811043701d2301fd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:47:12.177532 18448 ts_tablet_manager.cc:1905] T ad8ca177f641476ab7e46fb87d4d5907 P 7bc375740395411da040a5c9111bb32d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:47:12.177742 18447 ts_tablet_manager.cc:1918] T ad8ca177f641476ab7e46fb87d4d5907 P 574de84d62eb4b68811043701d2301fd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260805 22:47:12.177793 18447 log.cc:1196] T ad8ca177f641476ab7e46fb87d4d5907 P 574de84d62eb4b68811043701d2301fd: Deleting WAL directory at /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/ts-1/wal/wals/ad8ca177f641476ab7e46fb87d4d5907
I20260805 22:47:12.178040 18447 ts_tablet_manager.cc:1939] T ad8ca177f641476ab7e46fb87d4d5907 P 574de84d62eb4b68811043701d2301fd: Deleting consensus metadata
I20260805 22:47:12.178203 18449 tablet_replica.cc:330] T ad8ca177f641476ab7e46fb87d4d5907 P d6b5267961ac4d66a44999b51395b345: stopping tablet replica
I20260805 22:47:12.178258 18449 raft_consensus.cc:2229] T ad8ca177f641476ab7e46fb87d4d5907 P d6b5267961ac4d66a44999b51395b345 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:47:12.178287 18449 raft_consensus.cc:2258] T ad8ca177f641476ab7e46fb87d4d5907 P d6b5267961ac4d66a44999b51395b345 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:47:12.178377 17591 catalog_manager.cc:4841] TS 574de84d62eb4b68811043701d2301fd (127.14.224.130:41497): tablet ad8ca177f641476ab7e46fb87d4d5907 (table test-table [id=824a51afa60f42549be11eab9ccdda4c]) successfully deleted
I20260805 22:47:12.178539 18449 ts_tablet_manager.cc:1905] T ad8ca177f641476ab7e46fb87d4d5907 P d6b5267961ac4d66a44999b51395b345: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:47:12.179185 18448 ts_tablet_manager.cc:1918] T ad8ca177f641476ab7e46fb87d4d5907 P 7bc375740395411da040a5c9111bb32d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260805 22:47:12.179297 18448 log.cc:1196] T ad8ca177f641476ab7e46fb87d4d5907 P 7bc375740395411da040a5c9111bb32d: Deleting WAL directory at /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/ts-2/wal/wals/ad8ca177f641476ab7e46fb87d4d5907
I20260805 22:47:12.179524 18448 ts_tablet_manager.cc:1939] T ad8ca177f641476ab7e46fb87d4d5907 P 7bc375740395411da040a5c9111bb32d: Deleting consensus metadata
I20260805 22:47:12.179813 18449 ts_tablet_manager.cc:1918] T ad8ca177f641476ab7e46fb87d4d5907 P d6b5267961ac4d66a44999b51395b345: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260805 22:47:12.179877 18449 log.cc:1196] T ad8ca177f641476ab7e46fb87d4d5907 P d6b5267961ac4d66a44999b51395b345: Deleting WAL directory at /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/ts-0/wal/wals/ad8ca177f641476ab7e46fb87d4d5907
I20260805 22:47:12.179922 17590 catalog_manager.cc:4841] TS 7bc375740395411da040a5c9111bb32d (127.14.224.131:46567): tablet ad8ca177f641476ab7e46fb87d4d5907 (table test-table [id=824a51afa60f42549be11eab9ccdda4c]) successfully deleted
I20260805 22:47:12.180078 18449 ts_tablet_manager.cc:1939] T ad8ca177f641476ab7e46fb87d4d5907 P d6b5267961ac4d66a44999b51395b345: Deleting consensus metadata
I20260805 22:47:12.180560 17590 catalog_manager.cc:4841] TS d6b5267961ac4d66a44999b51395b345 (127.14.224.129:42983): tablet ad8ca177f641476ab7e46fb87d4d5907 (table test-table [id=824a51afa60f42549be11eab9ccdda4c]) successfully deleted
Aug 05 22:47:12 dist-test-slave-gjrz krb5kdc[17552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970032, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 05 22:47:12 dist-test-slave-gjrz krb5kdc[17552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970032, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:47:12.203984 18458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:12.193871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44444 (local address 127.14.224.190:44731)
0805 22:47:12.194050 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:12.194052 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:12.194061 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:47:12.194086 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:12.194087 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:12.194097 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:12.194158 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:12.194700 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:12.195208 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:12.195987 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:12.196194 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:12.196253 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:12.201469 (+ 5216us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:12.201471 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:12.201472 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:12.201481 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:12.202919 (+ 1438us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:12.203347 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:12.203348 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:12.203348 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:12.203404 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:12.203553 (+ 149us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:12.203553 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:12.203554 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:12.203662 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:12.203733 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:12.203806 (+ 73us) server_negotiation.cc:299] Negotiation successful
0805 22:47:12.203878 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":108,"threads_started":1}
I20260805 22:47:12.205948 17615 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44444:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:47:12.206137 17615 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:47:12.207490 18010 tablet_service.cc:1467] Processing CreateTablet for tablet 95e2f086514941e2a408a037ada417be (DEFAULT_TABLE table=test-table [id=3dbbfa0f0f9b4d1785882ac6ff7fbdb4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:47:12.207506 18206 tablet_service.cc:1467] Processing CreateTablet for tablet 95e2f086514941e2a408a037ada417be (DEFAULT_TABLE table=test-table [id=3dbbfa0f0f9b4d1785882ac6ff7fbdb4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:47:12.207659 18010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95e2f086514941e2a408a037ada417be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:12.207661 18206 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95e2f086514941e2a408a037ada417be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:12.207629 17812 tablet_service.cc:1467] Processing CreateTablet for tablet 95e2f086514941e2a408a037ada417be (DEFAULT_TABLE table=test-table [id=3dbbfa0f0f9b4d1785882ac6ff7fbdb4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:47:12.207752 17812 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95e2f086514941e2a408a037ada417be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:12.208933 18459 tablet_bootstrap.cc:492] T 95e2f086514941e2a408a037ada417be P 7bc375740395411da040a5c9111bb32d: Bootstrap starting.
I20260805 22:47:12.209115 18461 tablet_bootstrap.cc:492] T 95e2f086514941e2a408a037ada417be P 574de84d62eb4b68811043701d2301fd: Bootstrap starting.
I20260805 22:47:12.209513 18459 tablet_bootstrap.cc:654] T 95e2f086514941e2a408a037ada417be P 7bc375740395411da040a5c9111bb32d: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:12.209533 18461 tablet_bootstrap.cc:654] T 95e2f086514941e2a408a037ada417be P 574de84d62eb4b68811043701d2301fd: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:12.209836 18462 tablet_bootstrap.cc:492] T 95e2f086514941e2a408a037ada417be P d6b5267961ac4d66a44999b51395b345: Bootstrap starting.
I20260805 22:47:12.210124 18461 tablet_bootstrap.cc:492] T 95e2f086514941e2a408a037ada417be P 574de84d62eb4b68811043701d2301fd: No bootstrap required, opened a new log
I20260805 22:47:12.210158 18462 tablet_bootstrap.cc:654] T 95e2f086514941e2a408a037ada417be P d6b5267961ac4d66a44999b51395b345: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:12.210191 18461 ts_tablet_manager.cc:1397] T 95e2f086514941e2a408a037ada417be P 574de84d62eb4b68811043701d2301fd: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260805 22:47:12.210309 18461 raft_consensus.cc:348] T 95e2f086514941e2a408a037ada417be P 574de84d62eb4b68811043701d2301fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6b5267961ac4d66a44999b51395b345" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42983 } } peers { permanent_uuid: "574de84d62eb4b68811043701d2301fd" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41497 } } peers { permanent_uuid: "7bc375740395411da040a5c9111bb32d" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46567 } }
I20260805 22:47:12.210398 18459 tablet_bootstrap.cc:492] T 95e2f086514941e2a408a037ada417be P 7bc375740395411da040a5c9111bb32d: No bootstrap required, opened a new log
I20260805 22:47:12.210419 18461 raft_consensus.cc:374] T 95e2f086514941e2a408a037ada417be P 574de84d62eb4b68811043701d2301fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:12.210445 18461 raft_consensus.cc:729] T 95e2f086514941e2a408a037ada417be P 574de84d62eb4b68811043701d2301fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 574de84d62eb4b68811043701d2301fd, State: Initialized, Role: FOLLOWER
I20260805 22:47:12.210472 18459 ts_tablet_manager.cc:1397] T 95e2f086514941e2a408a037ada417be P 7bc375740395411da040a5c9111bb32d: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260805 22:47:12.210531 18461 consensus_queue.cc:260] T 95e2f086514941e2a408a037ada417be P 574de84d62eb4b68811043701d2301fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6b5267961ac4d66a44999b51395b345" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42983 } } peers { permanent_uuid: "574de84d62eb4b68811043701d2301fd" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41497 } } peers { permanent_uuid: "7bc375740395411da040a5c9111bb32d" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46567 } }
I20260805 22:47:12.210635 18459 raft_consensus.cc:348] T 95e2f086514941e2a408a037ada417be P 7bc375740395411da040a5c9111bb32d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6b5267961ac4d66a44999b51395b345" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42983 } } peers { permanent_uuid: "574de84d62eb4b68811043701d2301fd" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41497 } } peers { permanent_uuid: "7bc375740395411da040a5c9111bb32d" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46567 } }
I20260805 22:47:12.210685 18461 ts_tablet_manager.cc:1428] T 95e2f086514941e2a408a037ada417be P 574de84d62eb4b68811043701d2301fd: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260805 22:47:12.210718 18462 tablet_bootstrap.cc:492] T 95e2f086514941e2a408a037ada417be P d6b5267961ac4d66a44999b51395b345: No bootstrap required, opened a new log
I20260805 22:47:12.210767 18459 raft_consensus.cc:374] T 95e2f086514941e2a408a037ada417be P 7bc375740395411da040a5c9111bb32d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:12.210778 18462 ts_tablet_manager.cc:1397] T 95e2f086514941e2a408a037ada417be P d6b5267961ac4d66a44999b51395b345: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260805 22:47:12.210796 18459 raft_consensus.cc:729] T 95e2f086514941e2a408a037ada417be P 7bc375740395411da040a5c9111bb32d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bc375740395411da040a5c9111bb32d, State: Initialized, Role: FOLLOWER
I20260805 22:47:12.210858 18459 consensus_queue.cc:260] T 95e2f086514941e2a408a037ada417be P 7bc375740395411da040a5c9111bb32d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6b5267961ac4d66a44999b51395b345" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42983 } } peers { permanent_uuid: "574de84d62eb4b68811043701d2301fd" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41497 } } peers { permanent_uuid: "7bc375740395411da040a5c9111bb32d" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46567 } }
I20260805 22:47:12.210893 18462 raft_consensus.cc:348] T 95e2f086514941e2a408a037ada417be P d6b5267961ac4d66a44999b51395b345 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6b5267961ac4d66a44999b51395b345" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42983 } } peers { permanent_uuid: "574de84d62eb4b68811043701d2301fd" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41497 } } peers { permanent_uuid: "7bc375740395411da040a5c9111bb32d" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46567 } }
I20260805 22:47:12.210960 18462 raft_consensus.cc:374] T 95e2f086514941e2a408a037ada417be P d6b5267961ac4d66a44999b51395b345 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:12.210979 18462 raft_consensus.cc:729] T 95e2f086514941e2a408a037ada417be P d6b5267961ac4d66a44999b51395b345 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6b5267961ac4d66a44999b51395b345, State: Initialized, Role: FOLLOWER
I20260805 22:47:12.211037 18462 consensus_queue.cc:260] T 95e2f086514941e2a408a037ada417be P d6b5267961ac4d66a44999b51395b345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6b5267961ac4d66a44999b51395b345" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42983 } } peers { permanent_uuid: "574de84d62eb4b68811043701d2301fd" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41497 } } peers { permanent_uuid: "7bc375740395411da040a5c9111bb32d" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46567 } }
I20260805 22:47:12.211216 18462 ts_tablet_manager.cc:1428] T 95e2f086514941e2a408a037ada417be P d6b5267961ac4d66a44999b51395b345: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260805 22:47:12.211297 18459 ts_tablet_manager.cc:1428] T 95e2f086514941e2a408a037ada417be P 7bc375740395411da040a5c9111bb32d: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260805 22:47:12.585058 18421 raft_consensus.cc:482] T 95e2f086514941e2a408a037ada417be P 7bc375740395411da040a5c9111bb32d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:47:12.585175 18421 raft_consensus.cc:504] T 95e2f086514941e2a408a037ada417be P 7bc375740395411da040a5c9111bb32d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6b5267961ac4d66a44999b51395b345" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42983 } } peers { permanent_uuid: "574de84d62eb4b68811043701d2301fd" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41497 } } peers { permanent_uuid: "7bc375740395411da040a5c9111bb32d" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46567 } }
I20260805 22:47:12.585359 18421 leader_election.cc:288] T 95e2f086514941e2a408a037ada417be P 7bc375740395411da040a5c9111bb32d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d6b5267961ac4d66a44999b51395b345 (127.14.224.129:42983), 574de84d62eb4b68811043701d2301fd (127.14.224.130:41497)
I20260805 22:47:12.585626 17842 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95e2f086514941e2a408a037ada417be" candidate_uuid: "7bc375740395411da040a5c9111bb32d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6b5267961ac4d66a44999b51395b345" is_pre_election: true
I20260805 22:47:12.585657 18038 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95e2f086514941e2a408a037ada417be" candidate_uuid: "7bc375740395411da040a5c9111bb32d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "574de84d62eb4b68811043701d2301fd" is_pre_election: true
I20260805 22:47:12.585740 18038 raft_consensus.cc:2454] T 95e2f086514941e2a408a037ada417be P 574de84d62eb4b68811043701d2301fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7bc375740395411da040a5c9111bb32d in term 0.
I20260805 22:47:12.585738 17842 raft_consensus.cc:2454] T 95e2f086514941e2a408a037ada417be P d6b5267961ac4d66a44999b51395b345 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7bc375740395411da040a5c9111bb32d in term 0.
I20260805 22:47:12.585896 18142 leader_election.cc:302] T 95e2f086514941e2a408a037ada417be P 7bc375740395411da040a5c9111bb32d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 574de84d62eb4b68811043701d2301fd, 7bc375740395411da040a5c9111bb32d; no voters:
I20260805 22:47:12.585999 18421 raft_consensus.cc:2781] T 95e2f086514941e2a408a037ada417be P 7bc375740395411da040a5c9111bb32d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:47:12.586043 18421 raft_consensus.cc:482] T 95e2f086514941e2a408a037ada417be P 7bc375740395411da040a5c9111bb32d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:47:12.586061 18421 raft_consensus.cc:3037] T 95e2f086514941e2a408a037ada417be P 7bc375740395411da040a5c9111bb32d [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:12.586755 18421 raft_consensus.cc:504] T 95e2f086514941e2a408a037ada417be P 7bc375740395411da040a5c9111bb32d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6b5267961ac4d66a44999b51395b345" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42983 } } peers { permanent_uuid: "574de84d62eb4b68811043701d2301fd" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41497 } } peers { permanent_uuid: "7bc375740395411da040a5c9111bb32d" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46567 } }
I20260805 22:47:12.586882 18421 leader_election.cc:288] T 95e2f086514941e2a408a037ada417be P 7bc375740395411da040a5c9111bb32d [CANDIDATE]: Term 1 election: Requested vote from peers d6b5267961ac4d66a44999b51395b345 (127.14.224.129:42983), 574de84d62eb4b68811043701d2301fd (127.14.224.130:41497)
I20260805 22:47:12.587108 18038 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95e2f086514941e2a408a037ada417be" candidate_uuid: "7bc375740395411da040a5c9111bb32d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "574de84d62eb4b68811043701d2301fd"
I20260805 22:47:12.587113 17842 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95e2f086514941e2a408a037ada417be" candidate_uuid: "7bc375740395411da040a5c9111bb32d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6b5267961ac4d66a44999b51395b345"
I20260805 22:47:12.587206 18038 raft_consensus.cc:3037] T 95e2f086514941e2a408a037ada417be P 574de84d62eb4b68811043701d2301fd [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:12.587206 17842 raft_consensus.cc:3037] T 95e2f086514941e2a408a037ada417be P d6b5267961ac4d66a44999b51395b345 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:12.587993 17842 raft_consensus.cc:2454] T 95e2f086514941e2a408a037ada417be P d6b5267961ac4d66a44999b51395b345 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7bc375740395411da040a5c9111bb32d in term 1.
I20260805 22:47:12.587994 18038 raft_consensus.cc:2454] T 95e2f086514941e2a408a037ada417be P 574de84d62eb4b68811043701d2301fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7bc375740395411da040a5c9111bb32d in term 1.
I20260805 22:47:12.588205 18142 leader_election.cc:302] T 95e2f086514941e2a408a037ada417be P 7bc375740395411da040a5c9111bb32d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 574de84d62eb4b68811043701d2301fd, 7bc375740395411da040a5c9111bb32d; no voters:
I20260805 22:47:12.588301 18421 raft_consensus.cc:2781] T 95e2f086514941e2a408a037ada417be P 7bc375740395411da040a5c9111bb32d [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:47:12.588387 18421 raft_consensus.cc:686] T 95e2f086514941e2a408a037ada417be P 7bc375740395411da040a5c9111bb32d [term 1 LEADER]: Becoming Leader. State: Replica: 7bc375740395411da040a5c9111bb32d, State: Running, Role: LEADER
I20260805 22:47:12.588431 18421 consensus_queue.cc:237] T 95e2f086514941e2a408a037ada417be P 7bc375740395411da040a5c9111bb32d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6b5267961ac4d66a44999b51395b345" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42983 } } peers { permanent_uuid: "574de84d62eb4b68811043701d2301fd" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41497 } } peers { permanent_uuid: "7bc375740395411da040a5c9111bb32d" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46567 } }
I20260805 22:47:12.589113 17617 catalog_manager.cc:5495] T 95e2f086514941e2a408a037ada417be P 7bc375740395411da040a5c9111bb32d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7bc375740395411da040a5c9111bb32d (127.14.224.131). New cstate: current_term: 1 leader_uuid: "7bc375740395411da040a5c9111bb32d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6b5267961ac4d66a44999b51395b345" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "574de84d62eb4b68811043701d2301fd" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7bc375740395411da040a5c9111bb32d" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46567 } health_report { overall_health: HEALTHY } } }
I20260805 22:47:12.655211 18472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:12.653058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58332 (local address 127.14.224.131:46567)
0805 22:47:12.653211 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:12.653213 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:12.653220 (+ 7us) server_negotiation.cc:407] Connection header received
0805 22:47:12.653239 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:12.653240 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:12.653250 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:12.653307 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:47:12.653437 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:12.653913 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:12.654663 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:12.654866 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:12.654922 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:12.655024 (+ 102us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:47:12.655053 (+ 29us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:47:12.655086 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:12.655123 (+ 37us) server_negotiation.cc:299] Negotiation successful
0805 22:47:12.655141 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":93,"threads_started":1}
I20260805 22:47:12.657518 18038 raft_consensus.cc:1261] T 95e2f086514941e2a408a037ada417be P 574de84d62eb4b68811043701d2301fd [term 1 FOLLOWER]: Refusing update from remote peer 7bc375740395411da040a5c9111bb32d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:47:12.657567 17842 raft_consensus.cc:1261] T 95e2f086514941e2a408a037ada417be P d6b5267961ac4d66a44999b51395b345 [term 1 FOLLOWER]: Refusing update from remote peer 7bc375740395411da040a5c9111bb32d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:47:12.657760 18421 consensus_queue.cc:1035] T 95e2f086514941e2a408a037ada417be P 7bc375740395411da040a5c9111bb32d [LEADER]: Connected to new peer: Peer: permanent_uuid: "574de84d62eb4b68811043701d2301fd" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:47:12.657884 18428 consensus_queue.cc:1035] T 95e2f086514941e2a408a037ada417be P 7bc375740395411da040a5c9111bb32d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6b5267961ac4d66a44999b51395b345" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:47:12.668088 17617 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44444:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:47:12.668195 17617 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44444:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:47:12.668777 17617 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 24e02d789cd748848fdaef4d12844340: Sending DeleteTablet for 3 replicas of tablet 95e2f086514941e2a408a037ada417be
I20260805 22:47:12.669023 17812 tablet_service.cc:1514] Processing DeleteTablet for tablet 95e2f086514941e2a408a037ada417be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:47:12 UTC) from {username='kudu', principal='kudu/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:46274
I20260805 22:47:12.669128 18449 tablet_replica.cc:330] T 95e2f086514941e2a408a037ada417be P d6b5267961ac4d66a44999b51395b345: stopping tablet replica
I20260805 22:47:12.669100 18206 tablet_service.cc:1514] Processing DeleteTablet for tablet 95e2f086514941e2a408a037ada417be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:47:12 UTC) from {username='kudu', principal='kudu/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:58294
I20260805 22:47:12.669127 18010 tablet_service.cc:1514] Processing DeleteTablet for tablet 95e2f086514941e2a408a037ada417be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:47:12 UTC) from {username='kudu', principal='kudu/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:46562
I20260805 22:47:12.669188 18449 raft_consensus.cc:2229] T 95e2f086514941e2a408a037ada417be P d6b5267961ac4d66a44999b51395b345 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:47:12.669212 18447 tablet_replica.cc:330] T 95e2f086514941e2a408a037ada417be P 574de84d62eb4b68811043701d2301fd: stopping tablet replica
I20260805 22:47:12.669214 18448 tablet_replica.cc:330] T 95e2f086514941e2a408a037ada417be P 7bc375740395411da040a5c9111bb32d: stopping tablet replica
I20260805 22:47:12.669250 18449 raft_consensus.cc:2258] T 95e2f086514941e2a408a037ada417be P d6b5267961ac4d66a44999b51395b345 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:47:12.669255 18447 raft_consensus.cc:2229] T 95e2f086514941e2a408a037ada417be P 574de84d62eb4b68811043701d2301fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:47:12.669270 18448 raft_consensus.cc:2229] T 95e2f086514941e2a408a037ada417be P 7bc375740395411da040a5c9111bb32d [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:47:12.669291 18447 raft_consensus.cc:2258] T 95e2f086514941e2a408a037ada417be P 574de84d62eb4b68811043701d2301fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:47:12.669328 18448 raft_consensus.cc:2258] T 95e2f086514941e2a408a037ada417be P 7bc375740395411da040a5c9111bb32d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:47:12.669327 17617 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44444:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:47:12.669461 17617 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:47:12.669713 18447 ts_tablet_manager.cc:1905] T 95e2f086514941e2a408a037ada417be P 574de84d62eb4b68811043701d2301fd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:47:12.670233 18448 ts_tablet_manager.cc:1905] T 95e2f086514941e2a408a037ada417be P 7bc375740395411da040a5c9111bb32d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:47:12.670290 18449 ts_tablet_manager.cc:1905] T 95e2f086514941e2a408a037ada417be P d6b5267961ac4d66a44999b51395b345: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:47:12.671535 18447 ts_tablet_manager.cc:1918] T 95e2f086514941e2a408a037ada417be P 574de84d62eb4b68811043701d2301fd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260805 22:47:12.671593 18447 log.cc:1196] T 95e2f086514941e2a408a037ada417be P 574de84d62eb4b68811043701d2301fd: Deleting WAL directory at /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/ts-1/wal/wals/95e2f086514941e2a408a037ada417be
I20260805 22:47:12.671747 18448 ts_tablet_manager.cc:1918] T 95e2f086514941e2a408a037ada417be P 7bc375740395411da040a5c9111bb32d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260805 22:47:12.671761 18449 ts_tablet_manager.cc:1918] T 95e2f086514941e2a408a037ada417be P d6b5267961ac4d66a44999b51395b345: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260805 22:47:12.671804 18449 log.cc:1196] T 95e2f086514941e2a408a037ada417be P d6b5267961ac4d66a44999b51395b345: Deleting WAL directory at /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/ts-0/wal/wals/95e2f086514941e2a408a037ada417be
I20260805 22:47:12.671802 18448 log.cc:1196] T 95e2f086514941e2a408a037ada417be P 7bc375740395411da040a5c9111bb32d: Deleting WAL directory at /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/ts-2/wal/wals/95e2f086514941e2a408a037ada417be
I20260805 22:47:12.671854 18447 ts_tablet_manager.cc:1939] T 95e2f086514941e2a408a037ada417be P 574de84d62eb4b68811043701d2301fd: Deleting consensus metadata
I20260805 22:47:12.672008 18448 ts_tablet_manager.cc:1939] T 95e2f086514941e2a408a037ada417be P 7bc375740395411da040a5c9111bb32d: Deleting consensus metadata
I20260805 22:47:12.672026 18449 ts_tablet_manager.cc:1939] T 95e2f086514941e2a408a037ada417be P d6b5267961ac4d66a44999b51395b345: Deleting consensus metadata
I20260805 22:47:12.672163 17591 catalog_manager.cc:4841] TS 574de84d62eb4b68811043701d2301fd (127.14.224.130:41497): tablet 95e2f086514941e2a408a037ada417be (table test-table [id=3dbbfa0f0f9b4d1785882ac6ff7fbdb4]) successfully deleted
I20260805 22:47:12.672287 18010 tablet_service.cc:1467] Processing CreateTablet for tablet 45ed1104410e4a6d994dbd0928aa326d (DEFAULT_TABLE table=test-table [id=c4358e449bed42ea866d952d1e7daa72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:47:12.672396 18010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45ed1104410e4a6d994dbd0928aa326d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:12.672499 17590 catalog_manager.cc:4841] TS 7bc375740395411da040a5c9111bb32d (127.14.224.131:46567): tablet 95e2f086514941e2a408a037ada417be (table test-table [id=3dbbfa0f0f9b4d1785882ac6ff7fbdb4]) successfully deleted
I20260805 22:47:12.672603 18206 tablet_service.cc:1467] Processing CreateTablet for tablet 45ed1104410e4a6d994dbd0928aa326d (DEFAULT_TABLE table=test-table [id=c4358e449bed42ea866d952d1e7daa72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:47:12.672703 18206 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45ed1104410e4a6d994dbd0928aa326d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:12.673026 17812 tablet_service.cc:1467] Processing CreateTablet for tablet 45ed1104410e4a6d994dbd0928aa326d (DEFAULT_TABLE table=test-table [id=c4358e449bed42ea866d952d1e7daa72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:47:12.673125 17812 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45ed1104410e4a6d994dbd0928aa326d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:12.673267 18461 tablet_bootstrap.cc:492] T 45ed1104410e4a6d994dbd0928aa326d P 574de84d62eb4b68811043701d2301fd: Bootstrap starting.
I20260805 22:47:12.673560 18461 tablet_bootstrap.cc:654] T 45ed1104410e4a6d994dbd0928aa326d P 574de84d62eb4b68811043701d2301fd: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:12.673880 18459 tablet_bootstrap.cc:492] T 45ed1104410e4a6d994dbd0928aa326d P 7bc375740395411da040a5c9111bb32d: Bootstrap starting.
I20260805 22:47:12.674170 18459 tablet_bootstrap.cc:654] T 45ed1104410e4a6d994dbd0928aa326d P 7bc375740395411da040a5c9111bb32d: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:12.674280 18462 tablet_bootstrap.cc:492] T 45ed1104410e4a6d994dbd0928aa326d P d6b5267961ac4d66a44999b51395b345: Bootstrap starting.
I20260805 22:47:12.674685 18459 tablet_bootstrap.cc:492] T 45ed1104410e4a6d994dbd0928aa326d P 7bc375740395411da040a5c9111bb32d: No bootstrap required, opened a new log
I20260805 22:47:12.674731 18459 ts_tablet_manager.cc:1397] T 45ed1104410e4a6d994dbd0928aa326d P 7bc375740395411da040a5c9111bb32d: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260805 22:47:12.674815 18462 tablet_bootstrap.cc:654] T 45ed1104410e4a6d994dbd0928aa326d P d6b5267961ac4d66a44999b51395b345: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:12.674842 18459 raft_consensus.cc:348] T 45ed1104410e4a6d994dbd0928aa326d P 7bc375740395411da040a5c9111bb32d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6b5267961ac4d66a44999b51395b345" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42983 } } peers { permanent_uuid: "574de84d62eb4b68811043701d2301fd" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41497 } } peers { permanent_uuid: "7bc375740395411da040a5c9111bb32d" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46567 } }
I20260805 22:47:12.674918 18459 raft_consensus.cc:374] T 45ed1104410e4a6d994dbd0928aa326d P 7bc375740395411da040a5c9111bb32d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:12.674942 18459 raft_consensus.cc:729] T 45ed1104410e4a6d994dbd0928aa326d P 7bc375740395411da040a5c9111bb32d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bc375740395411da040a5c9111bb32d, State: Initialized, Role: FOLLOWER
I20260805 22:47:12.674993 18459 consensus_queue.cc:260] T 45ed1104410e4a6d994dbd0928aa326d P 7bc375740395411da040a5c9111bb32d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6b5267961ac4d66a44999b51395b345" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42983 } } peers { permanent_uuid: "574de84d62eb4b68811043701d2301fd" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41497 } } peers { permanent_uuid: "7bc375740395411da040a5c9111bb32d" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46567 } }
I20260805 22:47:12.675086 18459 ts_tablet_manager.cc:1428] T 45ed1104410e4a6d994dbd0928aa326d P 7bc375740395411da040a5c9111bb32d: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:12.675246 17590 catalog_manager.cc:4841] TS d6b5267961ac4d66a44999b51395b345 (127.14.224.129:42983): tablet 95e2f086514941e2a408a037ada417be (table test-table [id=3dbbfa0f0f9b4d1785882ac6ff7fbdb4]) successfully deleted
I20260805 22:47:12.675465 18462 tablet_bootstrap.cc:492] T 45ed1104410e4a6d994dbd0928aa326d P d6b5267961ac4d66a44999b51395b345: No bootstrap required, opened a new log
I20260805 22:47:12.675514 18462 ts_tablet_manager.cc:1397] T 45ed1104410e4a6d994dbd0928aa326d P d6b5267961ac4d66a44999b51395b345: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260805 22:47:12.675657 18462 raft_consensus.cc:348] T 45ed1104410e4a6d994dbd0928aa326d P d6b5267961ac4d66a44999b51395b345 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6b5267961ac4d66a44999b51395b345" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42983 } } peers { permanent_uuid: "574de84d62eb4b68811043701d2301fd" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41497 } } peers { permanent_uuid: "7bc375740395411da040a5c9111bb32d" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46567 } }
I20260805 22:47:12.675729 18462 raft_consensus.cc:374] T 45ed1104410e4a6d994dbd0928aa326d P d6b5267961ac4d66a44999b51395b345 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:12.675742 18462 raft_consensus.cc:729] T 45ed1104410e4a6d994dbd0928aa326d P d6b5267961ac4d66a44999b51395b345 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6b5267961ac4d66a44999b51395b345, State: Initialized, Role: FOLLOWER
I20260805 22:47:12.675774 18462 consensus_queue.cc:260] T 45ed1104410e4a6d994dbd0928aa326d P d6b5267961ac4d66a44999b51395b345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6b5267961ac4d66a44999b51395b345" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42983 } } peers { permanent_uuid: "574de84d62eb4b68811043701d2301fd" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41497 } } peers { permanent_uuid: "7bc375740395411da040a5c9111bb32d" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46567 } }
I20260805 22:47:12.675868 18462 ts_tablet_manager.cc:1428] T 45ed1104410e4a6d994dbd0928aa326d P d6b5267961ac4d66a44999b51395b345: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:12.675886 18461 tablet_bootstrap.cc:492] T 45ed1104410e4a6d994dbd0928aa326d P 574de84d62eb4b68811043701d2301fd: No bootstrap required, opened a new log
I20260805 22:47:12.675930 18461 ts_tablet_manager.cc:1397] T 45ed1104410e4a6d994dbd0928aa326d P 574de84d62eb4b68811043701d2301fd: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260805 22:47:12.676052 18461 raft_consensus.cc:348] T 45ed1104410e4a6d994dbd0928aa326d P 574de84d62eb4b68811043701d2301fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6b5267961ac4d66a44999b51395b345" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42983 } } peers { permanent_uuid: "574de84d62eb4b68811043701d2301fd" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41497 } } peers { permanent_uuid: "7bc375740395411da040a5c9111bb32d" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46567 } }
I20260805 22:47:12.676110 18428 raft_consensus.cc:482] T 45ed1104410e4a6d994dbd0928aa326d P 7bc375740395411da040a5c9111bb32d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:47:12.676138 18461 raft_consensus.cc:374] T 45ed1104410e4a6d994dbd0928aa326d P 574de84d62eb4b68811043701d2301fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:12.676158 18461 raft_consensus.cc:729] T 45ed1104410e4a6d994dbd0928aa326d P 574de84d62eb4b68811043701d2301fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 574de84d62eb4b68811043701d2301fd, State: Initialized, Role: FOLLOWER
I20260805 22:47:12.676159 18428 raft_consensus.cc:504] T 45ed1104410e4a6d994dbd0928aa326d P 7bc375740395411da040a5c9111bb32d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6b5267961ac4d66a44999b51395b345" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42983 } } peers { permanent_uuid: "574de84d62eb4b68811043701d2301fd" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41497 } } peers { permanent_uuid: "7bc375740395411da040a5c9111bb32d" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46567 } }
I20260805 22:47:12.676204 18461 consensus_queue.cc:260] T 45ed1104410e4a6d994dbd0928aa326d P 574de84d62eb4b68811043701d2301fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6b5267961ac4d66a44999b51395b345" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42983 } } peers { permanent_uuid: "574de84d62eb4b68811043701d2301fd" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41497 } } peers { permanent_uuid: "7bc375740395411da040a5c9111bb32d" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46567 } }
I20260805 22:47:12.676276 18428 leader_election.cc:288] T 45ed1104410e4a6d994dbd0928aa326d P 7bc375740395411da040a5c9111bb32d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d6b5267961ac4d66a44999b51395b345 (127.14.224.129:42983), 574de84d62eb4b68811043701d2301fd (127.14.224.130:41497)
I20260805 22:47:12.676292 18461 ts_tablet_manager.cc:1428] T 45ed1104410e4a6d994dbd0928aa326d P 574de84d62eb4b68811043701d2301fd: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:12.676462 18038 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45ed1104410e4a6d994dbd0928aa326d" candidate_uuid: "7bc375740395411da040a5c9111bb32d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "574de84d62eb4b68811043701d2301fd" is_pre_election: true
I20260805 22:47:12.676450 17842 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45ed1104410e4a6d994dbd0928aa326d" candidate_uuid: "7bc375740395411da040a5c9111bb32d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6b5267961ac4d66a44999b51395b345" is_pre_election: true
I20260805 22:47:12.676522 18038 raft_consensus.cc:2454] T 45ed1104410e4a6d994dbd0928aa326d P 574de84d62eb4b68811043701d2301fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7bc375740395411da040a5c9111bb32d in term 0.
I20260805 22:47:12.676527 17842 raft_consensus.cc:2454] T 45ed1104410e4a6d994dbd0928aa326d P d6b5267961ac4d66a44999b51395b345 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7bc375740395411da040a5c9111bb32d in term 0.
I20260805 22:47:12.676649 18142 leader_election.cc:302] T 45ed1104410e4a6d994dbd0928aa326d P 7bc375740395411da040a5c9111bb32d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 574de84d62eb4b68811043701d2301fd, 7bc375740395411da040a5c9111bb32d; no voters:
I20260805 22:47:12.676774 18428 raft_consensus.cc:2781] T 45ed1104410e4a6d994dbd0928aa326d P 7bc375740395411da040a5c9111bb32d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:47:12.676829 18428 raft_consensus.cc:482] T 45ed1104410e4a6d994dbd0928aa326d P 7bc375740395411da040a5c9111bb32d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:47:12.676851 18428 raft_consensus.cc:3037] T 45ed1104410e4a6d994dbd0928aa326d P 7bc375740395411da040a5c9111bb32d [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:12.677538 18428 raft_consensus.cc:504] T 45ed1104410e4a6d994dbd0928aa326d P 7bc375740395411da040a5c9111bb32d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6b5267961ac4d66a44999b51395b345" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42983 } } peers { permanent_uuid: "574de84d62eb4b68811043701d2301fd" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41497 } } peers { permanent_uuid: "7bc375740395411da040a5c9111bb32d" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46567 } }
I20260805 22:47:12.677673 18428 leader_election.cc:288] T 45ed1104410e4a6d994dbd0928aa326d P 7bc375740395411da040a5c9111bb32d [CANDIDATE]: Term 1 election: Requested vote from peers d6b5267961ac4d66a44999b51395b345 (127.14.224.129:42983), 574de84d62eb4b68811043701d2301fd (127.14.224.130:41497)
I20260805 22:47:12.677778 17842 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45ed1104410e4a6d994dbd0928aa326d" candidate_uuid: "7bc375740395411da040a5c9111bb32d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6b5267961ac4d66a44999b51395b345"
I20260805 22:47:12.677806 18038 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45ed1104410e4a6d994dbd0928aa326d" candidate_uuid: "7bc375740395411da040a5c9111bb32d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "574de84d62eb4b68811043701d2301fd"
I20260805 22:47:12.677850 17842 raft_consensus.cc:3037] T 45ed1104410e4a6d994dbd0928aa326d P d6b5267961ac4d66a44999b51395b345 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:12.677858 18038 raft_consensus.cc:3037] T 45ed1104410e4a6d994dbd0928aa326d P 574de84d62eb4b68811043701d2301fd [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:12.678517 17842 raft_consensus.cc:2454] T 45ed1104410e4a6d994dbd0928aa326d P d6b5267961ac4d66a44999b51395b345 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7bc375740395411da040a5c9111bb32d in term 1.
I20260805 22:47:12.678530 18038 raft_consensus.cc:2454] T 45ed1104410e4a6d994dbd0928aa326d P 574de84d62eb4b68811043701d2301fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7bc375740395411da040a5c9111bb32d in term 1.
I20260805 22:47:12.678689 18140 leader_election.cc:302] T 45ed1104410e4a6d994dbd0928aa326d P 7bc375740395411da040a5c9111bb32d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7bc375740395411da040a5c9111bb32d, d6b5267961ac4d66a44999b51395b345; no voters:
I20260805 22:47:12.678826 18428 raft_consensus.cc:2781] T 45ed1104410e4a6d994dbd0928aa326d P 7bc375740395411da040a5c9111bb32d [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:47:12.678879 18428 raft_consensus.cc:686] T 45ed1104410e4a6d994dbd0928aa326d P 7bc375740395411da040a5c9111bb32d [term 1 LEADER]: Becoming Leader. State: Replica: 7bc375740395411da040a5c9111bb32d, State: Running, Role: LEADER
I20260805 22:47:12.678928 18428 consensus_queue.cc:237] T 45ed1104410e4a6d994dbd0928aa326d P 7bc375740395411da040a5c9111bb32d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6b5267961ac4d66a44999b51395b345" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42983 } } peers { permanent_uuid: "574de84d62eb4b68811043701d2301fd" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41497 } } peers { permanent_uuid: "7bc375740395411da040a5c9111bb32d" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46567 } }
I20260805 22:47:12.679478 17617 catalog_manager.cc:5495] T 45ed1104410e4a6d994dbd0928aa326d P 7bc375740395411da040a5c9111bb32d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7bc375740395411da040a5c9111bb32d (127.14.224.131). New cstate: current_term: 1 leader_uuid: "7bc375740395411da040a5c9111bb32d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6b5267961ac4d66a44999b51395b345" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "574de84d62eb4b68811043701d2301fd" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7bc375740395411da040a5c9111bb32d" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46567 } health_report { overall_health: HEALTHY } } }
I20260805 22:47:12.687579 18038 raft_consensus.cc:1261] T 45ed1104410e4a6d994dbd0928aa326d P 574de84d62eb4b68811043701d2301fd [term 1 FOLLOWER]: Refusing update from remote peer 7bc375740395411da040a5c9111bb32d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:47:12.687611 17842 raft_consensus.cc:1261] T 45ed1104410e4a6d994dbd0928aa326d P d6b5267961ac4d66a44999b51395b345 [term 1 FOLLOWER]: Refusing update from remote peer 7bc375740395411da040a5c9111bb32d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:47:12.687819 18392 consensus_queue.cc:1035] T 45ed1104410e4a6d994dbd0928aa326d P 7bc375740395411da040a5c9111bb32d [LEADER]: Connected to new peer: Peer: permanent_uuid: "574de84d62eb4b68811043701d2301fd" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:47:12.687923 18428 consensus_queue.cc:1035] T 45ed1104410e4a6d994dbd0928aa326d P 7bc375740395411da040a5c9111bb32d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6b5267961ac4d66a44999b51395b345" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260805 22:47:12.692389 18419 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260805 22:47:14.209589 17615 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44444:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:47:14.209710 17615 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44444:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:47:14.210597 17615 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 24e02d789cd748848fdaef4d12844340: Sending DeleteTablet for 3 replicas of tablet 45ed1104410e4a6d994dbd0928aa326d
I20260805 22:47:14.210871 18206 tablet_service.cc:1514] Processing DeleteTablet for tablet 45ed1104410e4a6d994dbd0928aa326d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:47:14 UTC) from {username='kudu', principal='kudu/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:58294
I20260805 22:47:14.210898 17812 tablet_service.cc:1514] Processing DeleteTablet for tablet 45ed1104410e4a6d994dbd0928aa326d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:47:14 UTC) from {username='kudu', principal='kudu/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:46274
I20260805 22:47:14.210892 18010 tablet_service.cc:1514] Processing DeleteTablet for tablet 45ed1104410e4a6d994dbd0928aa326d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:47:14 UTC) from {username='kudu', principal='kudu/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:46562
I20260805 22:47:14.211017 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 17717
I20260805 22:47:14.220412 18529 tablet_replica.cc:330] T 45ed1104410e4a6d994dbd0928aa326d P 574de84d62eb4b68811043701d2301fd: stopping tablet replica
I20260805 22:47:14.220515 18529 raft_consensus.cc:2229] T 45ed1104410e4a6d994dbd0928aa326d P 574de84d62eb4b68811043701d2301fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:47:14.220562 18529 raft_consensus.cc:2258] T 45ed1104410e4a6d994dbd0928aa326d P 574de84d62eb4b68811043701d2301fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:47:14.220868 18529 ts_tablet_manager.cc:1905] T 45ed1104410e4a6d994dbd0928aa326d P 574de84d62eb4b68811043701d2301fd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:47:14.222498 18529 ts_tablet_manager.cc:1918] T 45ed1104410e4a6d994dbd0928aa326d P 574de84d62eb4b68811043701d2301fd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260805 22:47:14.222558 18529 log.cc:1196] T 45ed1104410e4a6d994dbd0928aa326d P 574de84d62eb4b68811043701d2301fd: Deleting WAL directory at /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/ts-1/wal/wals/45ed1104410e4a6d994dbd0928aa326d
I20260805 22:47:14.222779 18529 ts_tablet_manager.cc:1939] T 45ed1104410e4a6d994dbd0928aa326d P 574de84d62eb4b68811043701d2301fd: Deleting consensus metadata
I20260805 22:47:14.223129 17591 catalog_manager.cc:4841] TS 574de84d62eb4b68811043701d2301fd (127.14.224.130:41497): tablet 45ed1104410e4a6d994dbd0928aa326d (table test-table [id=c4358e449bed42ea866d952d1e7daa72]) successfully deleted
I20260805 22:47:14.223481 18527 tablet_replica.cc:330] T 45ed1104410e4a6d994dbd0928aa326d P 7bc375740395411da040a5c9111bb32d: stopping tablet replica
I20260805 22:47:14.223555 18527 raft_consensus.cc:2229] T 45ed1104410e4a6d994dbd0928aa326d P 7bc375740395411da040a5c9111bb32d [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:47:14.223644 18527 raft_consensus.cc:2258] T 45ed1104410e4a6d994dbd0928aa326d P 7bc375740395411da040a5c9111bb32d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:47:14.223871 18527 ts_tablet_manager.cc:1905] T 45ed1104410e4a6d994dbd0928aa326d P 7bc375740395411da040a5c9111bb32d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260805 22:47:14.224905 17590 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.224.129:42983 (error 108)
I20260805 22:47:14.225196 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 17914
I20260805 22:47:14.235566 18527 ts_tablet_manager.cc:1918] T 45ed1104410e4a6d994dbd0928aa326d P 7bc375740395411da040a5c9111bb32d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260805 22:47:14.235664 18527 log.cc:1196] T 45ed1104410e4a6d994dbd0928aa326d P 7bc375740395411da040a5c9111bb32d: Deleting WAL directory at /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970021300824-15234-0/minicluster-data/ts-2/wal/wals/45ed1104410e4a6d994dbd0928aa326d
I20260805 22:47:14.235890 18527 ts_tablet_manager.cc:1939] T 45ed1104410e4a6d994dbd0928aa326d P 7bc375740395411da040a5c9111bb32d: Deleting consensus metadata
I20260805 22:47:14.235980 18531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:14.225307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.129:42983 (local address 127.0.0.1:46280)
0805 22:47:14.235830 (+ 10523us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:14.235928 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.129:42983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":10481,"thread_start_us":63,"threads_started":1}
W20260805 22:47:14.236109 17590 catalog_manager.cc:4584] TS d6b5267961ac4d66a44999b51395b345 (127.14.224.129:42983): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 45ed1104410e4a6d994dbd0928aa326d: Network error: Client connection negotiation failed: client connection to 127.14.224.129:42983: connect: Connection refused (error 111)
I20260805 22:47:14.236788 17590 catalog_manager.cc:4841] TS 7bc375740395411da040a5c9111bb32d (127.14.224.131:46567): tablet 45ed1104410e4a6d994dbd0928aa326d (table test-table [id=c4358e449bed42ea866d952d1e7daa72]) successfully deleted
I20260805 22:47:14.240638 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 18115
I20260805 22:47:14.256305 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 17569
2026-08-05T22:47:14Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6126 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:47:14 dist-test-slave-gjrz krb5kdc[18537](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:47:14 dist-test-slave-gjrz krb5kdc[18537](info): set up 2 sockets
Aug 05 22:47:14 dist-test-slave-gjrz krb5kdc[18537](info): commencing operation
krb5kdc: starting...
W20260805 22:47:15.408718 15234 mini_kdc.cc:121] Time spent starting KDC: real 1.119s user 0.006s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Aug 05 22:47:15 dist-test-slave-gjrz krb5kdc[18537](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970035, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:47:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:47:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.224.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab.
Entry for principal kudu/127.14.224.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab.
I20260805 22:47:15.538144 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:36009
--webserver_interface=127.14.224.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:42935
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.224.190:36009
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:47:15.622150 18554 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:15.622377 18554 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:15.622408 18554 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:15.623659 18554 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:47:15.623708 18554 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:15.623728 18554 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:15.623744 18554 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:47:15.623761 18554 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:47:15.625555 18554 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:42935
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.224.190:36009
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:36009
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.224.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18554
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:15.625839 18554 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:15.626081 18554 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260805 22:47:15.631417 18554 server_base.cc:1034] running on GCE node
W20260805 22:47:15.631378 18561 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:15.631373 18563 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:15.631371 18565 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:15.631935 18554 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:15.632251 18554 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:15.633436 18554 hybrid_clock.cc:648] HybridClock initialized: now 1785970035633432 us; error 38 us; skew 500 ppm
Aug 05 22:47:15 dist-test-slave-gjrz krb5kdc[18537](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970035, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:15.636046 18554 init.cc:377] Logged in from keytab as kudu/127.14.224.190@KRBTEST.COM (short username kudu)
I20260805 22:47:15.636528 18554 webserver.cc:460] Webserver started at http://127.14.224.190:43035/ using document root <none> and password file <none>
I20260805 22:47:15.636754 18554 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:15.636803 18554 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:15.636936 18554 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:15.638051 18554 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/minicluster-data/master-0/data/instance:
uuid: "670b23485c7b4a33b5d3104fc3249b32"
format_stamp: "Formatted at 2026-08-05 22:47:15 on dist-test-slave-gjrz"
server_key: "8a6dec90e954d138ea18a536d9c93a18"
server_key_iv: "d26cc111bdc06b3e1f709bf77206c024"
server_key_version: "encryptionkey@0"
I20260805 22:47:15.638411 18554 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/minicluster-data/master-0/wal/instance:
uuid: "670b23485c7b4a33b5d3104fc3249b32"
format_stamp: "Formatted at 2026-08-05 22:47:15 on dist-test-slave-gjrz"
server_key: "8a6dec90e954d138ea18a536d9c93a18"
server_key_iv: "d26cc111bdc06b3e1f709bf77206c024"
server_key_version: "encryptionkey@0"
I20260805 22:47:15.639894 18554 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260805 22:47:15.640702 18577 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:15.640859 18554 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260805 22:47:15.640951 18554 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/minicluster-data/master-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/minicluster-data/master-0/wal
uuid: "670b23485c7b4a33b5d3104fc3249b32"
format_stamp: "Formatted at 2026-08-05 22:47:15 on dist-test-slave-gjrz"
server_key: "8a6dec90e954d138ea18a536d9c93a18"
server_key_iv: "d26cc111bdc06b3e1f709bf77206c024"
server_key_version: "encryptionkey@0"
I20260805 22:47:15.641021 18554 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:15.667616 18554 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:15.669579 18554 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:15.669730 18554 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:15.673758 18554 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.190:36009
I20260805 22:47:15.673805 18652 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.190:36009 every 8 connection(s)
I20260805 22:47:15.674185 18554 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
I20260805 22:47:15.675064 18653 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:15.677502 18653 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 670b23485c7b4a33b5d3104fc3249b32: Bootstrap starting.
I20260805 22:47:15.678100 18653 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 670b23485c7b4a33b5d3104fc3249b32: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:15.678365 18653 log.cc:824] T 00000000000000000000000000000000 P 670b23485c7b4a33b5d3104fc3249b32: Log is configured to *not* fsync() on all Append() calls
I20260805 22:47:15.679158 18653 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 670b23485c7b4a33b5d3104fc3249b32: No bootstrap required, opened a new log
I20260805 22:47:15.680868 18653 raft_consensus.cc:348] T 00000000000000000000000000000000 P 670b23485c7b4a33b5d3104fc3249b32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "670b23485c7b4a33b5d3104fc3249b32" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 36009 } }
I20260805 22:47:15.681031 18653 raft_consensus.cc:374] T 00000000000000000000000000000000 P 670b23485c7b4a33b5d3104fc3249b32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:15.681054 18653 raft_consensus.cc:729] T 00000000000000000000000000000000 P 670b23485c7b4a33b5d3104fc3249b32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 670b23485c7b4a33b5d3104fc3249b32, State: Initialized, Role: FOLLOWER
I20260805 22:47:15.681212 18653 consensus_queue.cc:260] T 00000000000000000000000000000000 P 670b23485c7b4a33b5d3104fc3249b32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "670b23485c7b4a33b5d3104fc3249b32" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 36009 } }
I20260805 22:47:15.681282 18653 raft_consensus.cc:388] T 00000000000000000000000000000000 P 670b23485c7b4a33b5d3104fc3249b32 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:47:15.681306 18653 raft_consensus.cc:482] T 00000000000000000000000000000000 P 670b23485c7b4a33b5d3104fc3249b32 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:47:15.681357 18653 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 670b23485c7b4a33b5d3104fc3249b32 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:15.681955 18653 raft_consensus.cc:504] T 00000000000000000000000000000000 P 670b23485c7b4a33b5d3104fc3249b32 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "670b23485c7b4a33b5d3104fc3249b32" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 36009 } }
I20260805 22:47:15.682056 18653 leader_election.cc:302] T 00000000000000000000000000000000 P 670b23485c7b4a33b5d3104fc3249b32 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 670b23485c7b4a33b5d3104fc3249b32; no voters:
I20260805 22:47:15.682230 18653 leader_election.cc:288] T 00000000000000000000000000000000 P 670b23485c7b4a33b5d3104fc3249b32 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:47:15.682281 18658 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 670b23485c7b4a33b5d3104fc3249b32 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:47:15.682444 18658 raft_consensus.cc:686] T 00000000000000000000000000000000 P 670b23485c7b4a33b5d3104fc3249b32 [term 1 LEADER]: Becoming Leader. State: Replica: 670b23485c7b4a33b5d3104fc3249b32, State: Running, Role: LEADER
I20260805 22:47:15.682530 18653 sys_catalog.cc:564] T 00000000000000000000000000000000 P 670b23485c7b4a33b5d3104fc3249b32 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:47:15.682547 18658 consensus_queue.cc:237] T 00000000000000000000000000000000 P 670b23485c7b4a33b5d3104fc3249b32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "670b23485c7b4a33b5d3104fc3249b32" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 36009 } }
I20260805 22:47:15.683122 18661 sys_catalog.cc:455] T 00000000000000000000000000000000 P 670b23485c7b4a33b5d3104fc3249b32 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 670b23485c7b4a33b5d3104fc3249b32. Latest consensus state: current_term: 1 leader_uuid: "670b23485c7b4a33b5d3104fc3249b32" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "670b23485c7b4a33b5d3104fc3249b32" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 36009 } } }
I20260805 22:47:15.683207 18661 sys_catalog.cc:458] T 00000000000000000000000000000000 P 670b23485c7b4a33b5d3104fc3249b32 [sys.catalog]: This master's current role is: LEADER
I20260805 22:47:15.683584 18660 sys_catalog.cc:455] T 00000000000000000000000000000000 P 670b23485c7b4a33b5d3104fc3249b32 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "670b23485c7b4a33b5d3104fc3249b32" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "670b23485c7b4a33b5d3104fc3249b32" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 36009 } } }
I20260805 22:47:15.683653 18672 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:47:15.683674 18660 sys_catalog.cc:458] T 00000000000000000000000000000000 P 670b23485c7b4a33b5d3104fc3249b32 [sys.catalog]: This master's current role is: LEADER
I20260805 22:47:15.684154 18672 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:47:15.684233 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 18554
I20260805 22:47:15.684330 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/minicluster-data/master-0/wal/instance
I20260805 22:47:15.684496 15234 external_mini_cluster.cc:1428] Setting key a047c6bac37efb12c0328f1cf3e31032
I20260805 22:47:15.686091 18672 catalog_manager.cc:1347] Generated new cluster ID: ca636941a66841c6b0543a398e794f5e
I20260805 22:47:15.686179 18672 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 05 22:47:15 dist-test-slave-gjrz krb5kdc[18537](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970035, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:47:15.694033 18687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:15.684982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56634 (local address 127.14.224.190:36009)
0805 22:47:15.685149 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:15.685159 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:15.685302 (+ 143us) server_negotiation.cc:407] Connection header received
0805 22:47:15.685466 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:15.685474 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:15.685533 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:15.685655 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:15.686294 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:15.687241 (+ 947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:15.687997 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:15.688466 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:15.688564 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:15.690846 (+ 2282us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:15.690850 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:15.690851 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:15.690864 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:15.692534 (+ 1670us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:15.692862 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:15.692865 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:15.692866 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:15.692979 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:15.693157 (+ 178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:15.693158 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:15.693158 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:15.693404 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:15.693556 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:15.693667 (+ 111us) server_negotiation.cc:299] Negotiation successful
0805 22:47:15.693826 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":95,"threads_started":1}
I20260805 22:47:15.696408 18672 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:47:15.696905 18672 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:47:15.703294 18672 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 670b23485c7b4a33b5d3104fc3249b32: Generated new TSK 0
I20260805 22:47:15.703475 18672 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.224.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab.
Entry for principal kudu/127.14.224.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab.
I20260805 22:47:15.734284 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.129:0
--local_ip_for_outbound_sockets=127.14.224.129
--webserver_interface=127.14.224.129
--webserver_port=0
--tserver_master_addrs=127.14.224.190:36009
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab
--principal=kudu/127.14.224.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:42935
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:47:15.842056 18691 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:15.842303 18691 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:15.842327 18691 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:15.843605 18691 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:15.843657 18691 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:15.843685 18691 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.129
I20260805 22:47:15.845240 18691 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:42935
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab
--principal=kudu/127.14.224.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.224.129
--webserver_port=0
--tserver_master_addrs=127.14.224.190:36009
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18691
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.129
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:15.845506 18691 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:15.845800 18691 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:15.851318 18699 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:15.851379 18691 server_base.cc:1034] running on GCE node
W20260805 22:47:15.851318 18701 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:15.851318 18703 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:15.851817 18691 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:15.852072 18691 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:15.853221 18691 hybrid_clock.cc:648] HybridClock initialized: now 1785970035853203 us; error 37 us; skew 500 ppm
Aug 05 22:47:15 dist-test-slave-gjrz krb5kdc[18537](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970035, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:15.855983 18691 init.cc:377] Logged in from keytab as kudu/127.14.224.129@KRBTEST.COM (short username kudu)
I20260805 22:47:15.856412 18691 webserver.cc:460] Webserver started at http://127.14.224.129:37979/ using document root <none> and password file <none>
I20260805 22:47:15.856600 18691 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:15.856648 18691 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:15.856743 18691 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:15.857863 18691 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-0/data/instance:
uuid: "76c11f640ec344d49472ad49ddef0ffc"
format_stamp: "Formatted at 2026-08-05 22:47:15 on dist-test-slave-gjrz"
server_key: "b59b2ff7510acb36579277e8836b487b"
server_key_iv: "d08523967da1d809521d42bf47bd50dc"
server_key_version: "encryptionkey@0"
I20260805 22:47:15.858176 18691 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-0/wal/instance:
uuid: "76c11f640ec344d49472ad49ddef0ffc"
format_stamp: "Formatted at 2026-08-05 22:47:15 on dist-test-slave-gjrz"
server_key: "b59b2ff7510acb36579277e8836b487b"
server_key_iv: "d08523967da1d809521d42bf47bd50dc"
server_key_version: "encryptionkey@0"
I20260805 22:47:15.859450 18691 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260805 22:47:15.860153 18713 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:15.860309 18691 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260805 22:47:15.860400 18691 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-0/wal
uuid: "76c11f640ec344d49472ad49ddef0ffc"
format_stamp: "Formatted at 2026-08-05 22:47:15 on dist-test-slave-gjrz"
server_key: "b59b2ff7510acb36579277e8836b487b"
server_key_iv: "d08523967da1d809521d42bf47bd50dc"
server_key_version: "encryptionkey@0"
I20260805 22:47:15.860467 18691 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:15.888688 18691 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:15.890595 18691 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:15.890743 18691 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:15.890988 18691 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:47:15.891325 18691 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:47:15.891371 18691 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:15.891402 18691 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:47:15.891419 18691 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:15.896915 18691 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.129:40523
I20260805 22:47:15.896965 18862 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.129:40523 every 8 connection(s)
I20260805 22:47:15.897295 18691 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
I20260805 22:47:15.901484 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 18691
I20260805 22:47:15.901585 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-0/wal/instance
I20260805 22:47:15.901753 15234 external_mini_cluster.cc:1428] Setting key 9fb105dd7b20e11c7db85dc2a9416251
Aug 05 22:47:15 dist-test-slave-gjrz krb5kdc[18537](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970035, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.129@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:47:15.907783 18687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:15.898099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.129:33293 (local address 127.14.224.190:36009)
0805 22:47:15.898188 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:15.898190 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:15.898407 (+ 217us) server_negotiation.cc:407] Connection header received
0805 22:47:15.898913 (+ 506us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:15.898914 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:15.898931 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:15.898991 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:15.900048 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:15.900574 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:15.901812 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:15.902075 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:15.902147 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:15.904718 (+ 2571us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:15.904720 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:15.904721 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:15.904728 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:15.906061 (+ 1333us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:15.906558 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:15.906559 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:15.906559 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:15.906617 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:15.906950 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:15.906952 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:15.906952 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:15.907124 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:15.907254 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:15.907627 (+ 373us) server_negotiation.cc:299] Negotiation successful
0805 22:47:15.907712 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260805 22:47:15.908054 18866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:15.898003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:36009 (local address 127.14.224.129:33293)
0805 22:47:15.898262 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:15.898301 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:15.898795 (+ 494us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:15.899058 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:15.899062 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:15.899703 (+ 641us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:15.899903 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:15.899909 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:15.900684 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:15.900686 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:15.901717 (+ 1031us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:15.901721 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:15.902343 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:15.902344 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:15.902480 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:15.903025 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:15.903033 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:15.904608 (+ 1575us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:15.906153 (+ 1545us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:15.906163 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:15.906165 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:15.906468 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:15.906689 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:15.906690 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:15.906690 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:15.906851 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:15.907248 (+ 397us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:15.907256 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:15.907470 (+ 214us) client_negotiation.cc:769] Sending connection context
0805 22:47:15.907606 (+ 136us) client_negotiation.cc:240] Negotiation successful
0805 22:47:15.907800 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":97,"threads_started":1}
I20260805 22:47:15.908624 18863 heartbeater.cc:347] Connected to a master server at 127.14.224.190:36009
I20260805 22:47:15.908740 18863 heartbeater.cc:464] Registering TS with master...
I20260805 22:47:15.908962 18863 heartbeater.cc:511] Master 127.14.224.190:36009 requested a full tablet report, sending...
I20260805 22:47:15.909509 18606 ts_manager.cc:194] Registered new tserver with Master: 76c11f640ec344d49472ad49ddef0ffc (127.14.224.129:40523)
I20260805 22:47:15.910111 18606 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.224.129@KRBTEST.COM'} at 127.14.224.129:33293
WARNING: no policy specified for kudu/127.14.224.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab.
Entry for principal kudu/127.14.224.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab.
I20260805 22:47:15.930838 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.130:0
--local_ip_for_outbound_sockets=127.14.224.130
--webserver_interface=127.14.224.130
--webserver_port=0
--tserver_master_addrs=127.14.224.190:36009
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab
--principal=kudu/127.14.224.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:42935
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:47:16.015569 18871 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:16.015805 18871 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:16.015830 18871 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:16.017096 18871 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:16.017148 18871 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:16.017176 18871 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.130
I20260805 22:47:16.018708 18871 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:42935
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab
--principal=kudu/127.14.224.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.224.130
--webserver_port=0
--tserver_master_addrs=127.14.224.190:36009
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18871
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.130
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:16.018957 18871 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:16.019184 18871 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:16.024247 18886 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:16.024250 18883 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:16.024258 18881 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:16.024436 18871 server_base.cc:1034] running on GCE node
I20260805 22:47:16.024828 18871 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:16.025130 18871 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:16.026302 18871 hybrid_clock.cc:648] HybridClock initialized: now 1785970036026266 us; error 54 us; skew 500 ppm
Aug 05 22:47:16 dist-test-slave-gjrz krb5kdc[18537](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970036, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:16.028868 18871 init.cc:377] Logged in from keytab as kudu/127.14.224.130@KRBTEST.COM (short username kudu)
I20260805 22:47:16.029330 18871 webserver.cc:460] Webserver started at http://127.14.224.130:41915/ using document root <none> and password file <none>
I20260805 22:47:16.029546 18871 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:16.029606 18871 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:16.029733 18871 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:16.030786 18871 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-1/data/instance:
uuid: "f9d13f03d9ae4c478b84435153b7029e"
format_stamp: "Formatted at 2026-08-05 22:47:16 on dist-test-slave-gjrz"
server_key: "b653ead0fa28114f8fc30b8bb917d9da"
server_key_iv: "7b15f29757255c2e4c7a47913ba46ea1"
server_key_version: "encryptionkey@0"
I20260805 22:47:16.031136 18871 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-1/wal/instance:
uuid: "f9d13f03d9ae4c478b84435153b7029e"
format_stamp: "Formatted at 2026-08-05 22:47:16 on dist-test-slave-gjrz"
server_key: "b653ead0fa28114f8fc30b8bb917d9da"
server_key_iv: "7b15f29757255c2e4c7a47913ba46ea1"
server_key_version: "encryptionkey@0"
I20260805 22:47:16.032549 18871 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:47:16.033368 18895 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:16.033526 18871 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:47:16.033618 18871 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-1/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-1/wal
uuid: "f9d13f03d9ae4c478b84435153b7029e"
format_stamp: "Formatted at 2026-08-05 22:47:16 on dist-test-slave-gjrz"
server_key: "b653ead0fa28114f8fc30b8bb917d9da"
server_key_iv: "7b15f29757255c2e4c7a47913ba46ea1"
server_key_version: "encryptionkey@0"
I20260805 22:47:16.033682 18871 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:16.058310 18871 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:16.060496 18871 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:16.060647 18871 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:16.060886 18871 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:47:16.061223 18871 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:47:16.061268 18871 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:16.061299 18871 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:47:16.061322 18871 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:16.067315 18871 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.130:45763
I20260805 22:47:16.067407 19050 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.130:45763 every 8 connection(s)
I20260805 22:47:16.067715 18871 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
Aug 05 22:47:16 dist-test-slave-gjrz krb5kdc[18537](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970036, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.130@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:47:16.077227 18687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:16.068499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:60197 (local address 127.14.224.190:36009)
0805 22:47:16.068568 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:16.068570 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:16.068774 (+ 204us) server_negotiation.cc:407] Connection header received
0805 22:47:16.069242 (+ 468us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:16.069243 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:16.069255 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:16.069318 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:16.070291 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:16.070799 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:16.071849 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:16.072054 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:16.072112 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:16.074368 (+ 2256us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:16.074369 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:16.074370 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:16.074376 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:16.075743 (+ 1367us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:16.076164 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:16.076165 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:16.076165 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:16.076216 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:16.076517 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:16.076518 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:16.076518 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:16.076643 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:16.076698 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:16.077042 (+ 344us) server_negotiation.cc:299] Negotiation successful
0805 22:47:16.077132 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260805 22:47:16.077400 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 18871
I20260805 22:47:16.077500 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-1/wal/instance
I20260805 22:47:16.077558 19054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:16.068449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:36009 (local address 127.14.224.130:60197)
0805 22:47:16.068612 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:16.068658 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:16.069155 (+ 497us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:16.069374 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:16.069378 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:16.069971 (+ 593us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:16.070187 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:16.070193 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:16.070890 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:16.070891 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:16.071756 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:16.071759 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:16.072141 (+ 382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:16.072142 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:16.072251 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:16.072784 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:16.072793 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:16.074250 (+ 1457us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:16.075825 (+ 1575us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:16.075833 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:16.075835 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:16.076097 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:16.076308 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:16.076309 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:16.076310 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:16.076434 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:16.076740 (+ 306us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:16.076747 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:16.076880 (+ 133us) client_negotiation.cc:769] Sending connection context
0805 22:47:16.076983 (+ 103us) client_negotiation.cc:240] Negotiation successful
0805 22:47:16.077221 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":90,"threads_started":1}
I20260805 22:47:16.077713 15234 external_mini_cluster.cc:1428] Setting key 9c79c0fad0023b65a5e921a1933df3f0
I20260805 22:47:16.078289 19051 heartbeater.cc:347] Connected to a master server at 127.14.224.190:36009
I20260805 22:47:16.078413 19051 heartbeater.cc:464] Registering TS with master...
I20260805 22:47:16.078604 19051 heartbeater.cc:511] Master 127.14.224.190:36009 requested a full tablet report, sending...
I20260805 22:47:16.079023 18606 ts_manager.cc:194] Registered new tserver with Master: f9d13f03d9ae4c478b84435153b7029e (127.14.224.130:45763)
I20260805 22:47:16.079464 18606 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.224.130@KRBTEST.COM'} at 127.14.224.130:60197
WARNING: no policy specified for kudu/127.14.224.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab.
Entry for principal kudu/127.14.224.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab.
I20260805 22:47:16.106376 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.131:0
--local_ip_for_outbound_sockets=127.14.224.131
--webserver_interface=127.14.224.131
--webserver_port=0
--tserver_master_addrs=127.14.224.190:36009
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab
--principal=kudu/127.14.224.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:42935
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:47:16.191035 19058 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:16.191256 19058 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:16.191303 19058 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:16.192519 19058 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:16.192569 19058 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:16.192595 19058 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.131
I20260805 22:47:16.194082 19058 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:42935
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab
--principal=kudu/127.14.224.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.224.131
--webserver_port=0
--tserver_master_addrs=127.14.224.190:36009
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19058
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.131
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:16.194320 19058 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:16.194551 19058 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:16.199595 19067 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:16.199601 19066 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:16.199608 19070 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:16.199620 19058 server_base.cc:1034] running on GCE node
I20260805 22:47:16.199999 19058 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:16.200248 19058 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:16.201406 19058 hybrid_clock.cc:648] HybridClock initialized: now 1785970036201390 us; error 28 us; skew 500 ppm
Aug 05 22:47:16 dist-test-slave-gjrz krb5kdc[18537](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970036, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:16.203867 19058 init.cc:377] Logged in from keytab as kudu/127.14.224.131@KRBTEST.COM (short username kudu)
I20260805 22:47:16.204321 19058 webserver.cc:460] Webserver started at http://127.14.224.131:35087/ using document root <none> and password file <none>
I20260805 22:47:16.204514 19058 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:16.204555 19058 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:16.204648 19058 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:16.205664 19058 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-2/data/instance:
uuid: "229706385b7247c6a67231a3149edfe3"
format_stamp: "Formatted at 2026-08-05 22:47:16 on dist-test-slave-gjrz"
server_key: "a4ffb982e8ae1661fd9536c80e6b60a6"
server_key_iv: "b0019f4ad1c6cb6e13dc4a80ab6285ad"
server_key_version: "encryptionkey@0"
I20260805 22:47:16.205960 19058 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-2/wal/instance:
uuid: "229706385b7247c6a67231a3149edfe3"
format_stamp: "Formatted at 2026-08-05 22:47:16 on dist-test-slave-gjrz"
server_key: "a4ffb982e8ae1661fd9536c80e6b60a6"
server_key_iv: "b0019f4ad1c6cb6e13dc4a80ab6285ad"
server_key_version: "encryptionkey@0"
I20260805 22:47:16.207242 19058 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260805 22:47:16.208017 19080 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:16.208174 19058 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260805 22:47:16.208266 19058 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-2/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-2/wal
uuid: "229706385b7247c6a67231a3149edfe3"
format_stamp: "Formatted at 2026-08-05 22:47:16 on dist-test-slave-gjrz"
server_key: "a4ffb982e8ae1661fd9536c80e6b60a6"
server_key_iv: "b0019f4ad1c6cb6e13dc4a80ab6285ad"
server_key_version: "encryptionkey@0"
I20260805 22:47:16.208328 19058 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:16.232497 19058 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:16.234493 19058 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:16.234634 19058 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:16.234870 19058 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:47:16.235183 19058 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:47:16.235217 19058 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:16.235246 19058 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:47:16.235286 19058 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:16.241127 19058 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.131:41747
I20260805 22:47:16.241186 19232 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.131:41747 every 8 connection(s)
I20260805 22:47:16.241519 19058 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
I20260805 22:47:16.242511 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 19058
I20260805 22:47:16.242601 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-2/wal/instance
I20260805 22:47:16.242782 15234 external_mini_cluster.cc:1428] Setting key 8ed593a8c2843c4bd7bf1ce224414a8c
Aug 05 22:47:16 dist-test-slave-gjrz krb5kdc[18537](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970036, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.131@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:47:16.250443 18687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:16.242242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:49365 (local address 127.14.224.190:36009)
0805 22:47:16.242326 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:16.242328 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:16.242550 (+ 222us) server_negotiation.cc:407] Connection header received
0805 22:47:16.243281 (+ 731us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:16.243283 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:16.243294 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:16.243366 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:16.244364 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:16.244872 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:16.245858 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:16.246061 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:16.246124 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:16.248228 (+ 2104us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:16.248230 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:16.248230 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:16.248237 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:16.249353 (+ 1116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:16.249735 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:16.249736 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:16.249736 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:16.249783 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:16.249963 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:16.249964 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:16.249964 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:16.250059 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:16.250103 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:16.250317 (+ 214us) server_negotiation.cc:299] Negotiation successful
0805 22:47:16.250376 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260805 22:47:16.250638 19237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:16.242211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:36009 (local address 127.14.224.131:49365)
0805 22:47:16.242401 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:16.242455 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:16.243116 (+ 661us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:16.243446 (+ 330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:16.243451 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:16.244039 (+ 588us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:16.244278 (+ 239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:16.244284 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:16.244960 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:16.244961 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:16.245772 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:16.245774 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:16.246132 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:16.246133 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:16.246257 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:16.246743 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:16.246751 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:16.248131 (+ 1380us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:16.249446 (+ 1315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:16.249452 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:16.249454 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:16.249676 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:16.249825 (+ 149us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:16.249826 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:16.249826 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:16.249919 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:16.250100 (+ 181us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:16.250103 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:16.250219 (+ 116us) client_negotiation.cc:769] Sending connection context
0805 22:47:16.250297 (+ 78us) client_negotiation.cc:240] Negotiation successful
0805 22:47:16.250419 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":79,"threads_started":1}
I20260805 22:47:16.251087 19235 heartbeater.cc:347] Connected to a master server at 127.14.224.190:36009
I20260805 22:47:16.251192 19235 heartbeater.cc:464] Registering TS with master...
I20260805 22:47:16.251406 19235 heartbeater.cc:511] Master 127.14.224.190:36009 requested a full tablet report, sending...
I20260805 22:47:16.251770 18606 ts_manager.cc:194] Registered new tserver with Master: 229706385b7247c6a67231a3149edfe3 (127.14.224.131:41747)
I20260805 22:47:16.252132 18606 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.224.131@KRBTEST.COM'} at 127.14.224.131:49365
I20260805 22:47:16.254470 15234 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260805 22:47:16.266690 18687 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:47:16.265748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56650 (local address 127.14.224.190:36009)
0805 22:47:16.265812 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:16.265814 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:16.265907 (+ 93us) server_negotiation.cc:407] Connection header received
0805 22:47:16.265993 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:16.265995 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:16.266005 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:16.266055 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:16.266599 (+ 544us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56650: BlockingRecv error: recv got EOF from 127.0.0.1:56650 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
I20260805 22:47:16.267653 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 18691
I20260805 22:47:16.282953 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 18871
I20260805 22:47:16.289040 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 19058
I20260805 22:47:16.322800 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 18554
2026-08-05T22:47:16Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2062 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970021300824-15234-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:47:16 dist-test-slave-gjrz krb5kdc[19249](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:47:16 dist-test-slave-gjrz krb5kdc[19249](info): set up 2 sockets
Aug 05 22:47:16 dist-test-slave-gjrz krb5kdc[19249](info): commencing operation
krb5kdc: starting...
W20260805 22:47:17.461958 15234 mini_kdc.cc:121] Time spent starting KDC: real 1.109s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Aug 05 22:47:17 dist-test-slave-gjrz krb5kdc[19249](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970037, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:47:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:47:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.224.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab.
Entry for principal kudu/127.14.224.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab.
I20260805 22:47:17.594921 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970021300824-15234-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970021300824-15234-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970021300824-15234-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:40019
--webserver_interface=127.14.224.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:45883
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.224.190:40019
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:47:17.681492 19270 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:17.681737 19270 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:17.681774 19270 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:17.683058 19270 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:47:17.683116 19270 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:17.683135 19270 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:17.683151 19270 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:47:17.683166 19270 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:47:17.684861 19270 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:45883
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970021300824-15234-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970021300824-15234-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.224.190:40019
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:40019
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.224.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19270
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970021300824-15234-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:17.685158 19270 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:17.685391 19270 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:17.690428 19282 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:17.690424 19280 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:17.690428 19276 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:17.690514 19270 server_base.cc:1034] running on GCE node
I20260805 22:47:17.690987 19270 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:17.691313 19270 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:17.692473 19270 hybrid_clock.cc:648] HybridClock initialized: now 1785970037692455 us; error 37 us; skew 500 ppm
Aug 05 22:47:17 dist-test-slave-gjrz krb5kdc[19249](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970037, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:17.698148 19270 init.cc:377] Logged in from keytab as kudu/127.14.224.190@KRBTEST.COM (short username kudu)
I20260805 22:47:17.698668 19270 webserver.cc:460] Webserver started at http://127.14.224.190:38505/ using document root <none> and password file <none>
I20260805 22:47:17.698887 19270 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:17.698942 19270 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:17.699090 19270 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:17.700299 19270 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970021300824-15234-0/minicluster-data/master-0/data/instance:
uuid: "e597d0c7226c45259e2e1a7f096ded6b"
format_stamp: "Formatted at 2026-08-05 22:47:17 on dist-test-slave-gjrz"
server_key: "f0894fea106eb8d71775e9059cedf538"
server_key_iv: "067db3ee8b21e3c08ee658d1c002b974"
server_key_version: "encryptionkey@0"
I20260805 22:47:17.700675 19270 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970021300824-15234-0/minicluster-data/master-0/wal/instance:
uuid: "e597d0c7226c45259e2e1a7f096ded6b"
format_stamp: "Formatted at 2026-08-05 22:47:17 on dist-test-slave-gjrz"
server_key: "f0894fea106eb8d71775e9059cedf538"
server_key_iv: "067db3ee8b21e3c08ee658d1c002b974"
server_key_version: "encryptionkey@0"
I20260805 22:47:17.702191 19270 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260805 22:47:17.702987 19290 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:17.703188 19270 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:47:17.703311 19270 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970021300824-15234-0/minicluster-data/master-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970021300824-15234-0/minicluster-data/master-0/wal
uuid: "e597d0c7226c45259e2e1a7f096ded6b"
format_stamp: "Formatted at 2026-08-05 22:47:17 on dist-test-slave-gjrz"
server_key: "f0894fea106eb8d71775e9059cedf538"
server_key_iv: "067db3ee8b21e3c08ee658d1c002b974"
server_key_version: "encryptionkey@0"
I20260805 22:47:17.703392 19270 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970021300824-15234-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970021300824-15234-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970021300824-15234-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:17.715245 19270 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:17.717689 19270 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:17.717859 19270 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:17.722177 19270 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.190:40019
I20260805 22:47:17.722213 19369 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.190:40019 every 8 connection(s)
I20260805 22:47:17.722826 19270 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
I20260805 22:47:17.723584 19370 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:17.726087 19370 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e597d0c7226c45259e2e1a7f096ded6b: Bootstrap starting.
I20260805 22:47:17.726733 19370 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e597d0c7226c45259e2e1a7f096ded6b: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:17.727015 19370 log.cc:824] T 00000000000000000000000000000000 P e597d0c7226c45259e2e1a7f096ded6b: Log is configured to *not* fsync() on all Append() calls
I20260805 22:47:17.727777 19370 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e597d0c7226c45259e2e1a7f096ded6b: No bootstrap required, opened a new log
I20260805 22:47:17.729414 19370 raft_consensus.cc:348] T 00000000000000000000000000000000 P e597d0c7226c45259e2e1a7f096ded6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e597d0c7226c45259e2e1a7f096ded6b" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 40019 } }
I20260805 22:47:17.729571 19370 raft_consensus.cc:374] T 00000000000000000000000000000000 P e597d0c7226c45259e2e1a7f096ded6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:17.729594 19370 raft_consensus.cc:729] T 00000000000000000000000000000000 P e597d0c7226c45259e2e1a7f096ded6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e597d0c7226c45259e2e1a7f096ded6b, State: Initialized, Role: FOLLOWER
I20260805 22:47:17.729743 19370 consensus_queue.cc:260] T 00000000000000000000000000000000 P e597d0c7226c45259e2e1a7f096ded6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e597d0c7226c45259e2e1a7f096ded6b" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 40019 } }
I20260805 22:47:17.729820 19370 raft_consensus.cc:388] T 00000000000000000000000000000000 P e597d0c7226c45259e2e1a7f096ded6b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:47:17.729853 19370 raft_consensus.cc:482] T 00000000000000000000000000000000 P e597d0c7226c45259e2e1a7f096ded6b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:47:17.729900 19370 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e597d0c7226c45259e2e1a7f096ded6b [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:17.730885 19370 raft_consensus.cc:504] T 00000000000000000000000000000000 P e597d0c7226c45259e2e1a7f096ded6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e597d0c7226c45259e2e1a7f096ded6b" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 40019 } }
I20260805 22:47:17.730991 19370 leader_election.cc:302] T 00000000000000000000000000000000 P e597d0c7226c45259e2e1a7f096ded6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e597d0c7226c45259e2e1a7f096ded6b; no voters:
I20260805 22:47:17.731174 19370 leader_election.cc:288] T 00000000000000000000000000000000 P e597d0c7226c45259e2e1a7f096ded6b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:47:17.731225 19373 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e597d0c7226c45259e2e1a7f096ded6b [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:47:17.731426 19373 raft_consensus.cc:686] T 00000000000000000000000000000000 P e597d0c7226c45259e2e1a7f096ded6b [term 1 LEADER]: Becoming Leader. State: Replica: e597d0c7226c45259e2e1a7f096ded6b, State: Running, Role: LEADER
I20260805 22:47:17.731475 19370 sys_catalog.cc:564] T 00000000000000000000000000000000 P e597d0c7226c45259e2e1a7f096ded6b [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:47:17.731604 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 19270
I20260805 22:47:17.731601 19373 consensus_queue.cc:237] T 00000000000000000000000000000000 P e597d0c7226c45259e2e1a7f096ded6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e597d0c7226c45259e2e1a7f096ded6b" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 40019 } }
I20260805 22:47:17.731698 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970021300824-15234-0/minicluster-data/master-0/wal/instance
I20260805 22:47:17.731878 15234 external_mini_cluster.cc:1428] Setting key daa365c03a4492fd3d5fc32fb6c7df12
I20260805 22:47:17.732008 19375 sys_catalog.cc:455] T 00000000000000000000000000000000 P e597d0c7226c45259e2e1a7f096ded6b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e597d0c7226c45259e2e1a7f096ded6b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e597d0c7226c45259e2e1a7f096ded6b" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 40019 } } }
I20260805 22:47:17.732107 19375 sys_catalog.cc:458] T 00000000000000000000000000000000 P e597d0c7226c45259e2e1a7f096ded6b [sys.catalog]: This master's current role is: LEADER
I20260805 22:47:17.732272 19379 sys_catalog.cc:455] T 00000000000000000000000000000000 P e597d0c7226c45259e2e1a7f096ded6b [sys.catalog]: SysCatalogTable state changed. Reason: New leader e597d0c7226c45259e2e1a7f096ded6b. Latest consensus state: current_term: 1 leader_uuid: "e597d0c7226c45259e2e1a7f096ded6b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e597d0c7226c45259e2e1a7f096ded6b" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 40019 } } }
I20260805 22:47:17.732327 19379 sys_catalog.cc:458] T 00000000000000000000000000000000 P e597d0c7226c45259e2e1a7f096ded6b [sys.catalog]: This master's current role is: LEADER
I20260805 22:47:17.732643 19389 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:47:17.733176 19389 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:47:17.734869 19389 catalog_manager.cc:1347] Generated new cluster ID: 48da879825aa4def930577597dad80a3
I20260805 22:47:17.734925 19389 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 05 22:47:17 dist-test-slave-gjrz krb5kdc[19249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970037, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:47:17.742920 19389 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:47:17.743623 19389 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:47:17.744553 19397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:17.732507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35480 (local address 127.14.224.190:40019)
0805 22:47:17.732886 (+ 379us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:17.732896 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:17.733035 (+ 139us) server_negotiation.cc:407] Connection header received
0805 22:47:17.733166 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:17.733174 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:17.733236 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:17.734160 (+ 924us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:17.734260 (+ 100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:17.735700 (+ 1440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:17.736787 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:17.737463 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:17.737573 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:17.740474 (+ 2901us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:17.740478 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:17.740479 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:17.740494 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:17.742531 (+ 2037us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:17.742978 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:17.742981 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:17.742982 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:17.743097 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:17.743362 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:17.743363 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:17.743364 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:17.743670 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:17.743855 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:17.744120 (+ 265us) server_negotiation.cc:299] Negotiation successful
0805 22:47:17.744302 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":317,"thread_start_us":96,"threads_started":1}
I20260805 22:47:17.745855 15234 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:47:17.750335 19389 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e597d0c7226c45259e2e1a7f096ded6b: Generated new TSK 0
I20260805 22:47:17.750558 19389 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:47:17.763094 19397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:17.759158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35490 (local address 127.14.224.190:40019)
0805 22:47:17.759221 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:17.759223 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:17.759332 (+ 109us) server_negotiation.cc:407] Connection header received
0805 22:47:17.759429 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:17.759430 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:17.759443 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:17.759500 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:17.759868 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:17.760727 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:17.761439 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:17.761801 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:17.761870 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:17.762550 (+ 680us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:17.762551 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:17.762552 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:47:17.762817 (+ 265us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:17.762838 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:47:17.762846 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:17.762909 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:17.762972 (+ 63us) server_negotiation.cc:299] Negotiation successful
0805 22:47:17.763003 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260805 22:47:17.765501 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 19270
2026-08-05T22:47:17Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1449 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:47:17 dist-test-slave-gjrz krb5kdc[19423](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:47:17 dist-test-slave-gjrz krb5kdc[19423](info): set up 2 sockets
Aug 05 22:47:17 dist-test-slave-gjrz krb5kdc[19423](info): commencing operation
krb5kdc: starting...
W20260805 22:47:18.913370 15234 mini_kdc.cc:121] Time spent starting KDC: real 1.110s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Aug 05 22:47:19 dist-test-slave-gjrz krb5kdc[19423](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970039, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:47:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:47:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.224.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab.
Entry for principal kudu/127.14.224.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab.
I20260805 22:47:19.043040 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:39365
--webserver_interface=127.14.224.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:44973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.224.190:39365
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:47:19.127130 19442 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:19.127411 19442 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:19.127446 19442 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:19.128711 19442 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:47:19.128764 19442 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:19.128785 19442 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:19.128800 19442 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:47:19.128816 19442 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:47:19.130497 19442 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:44973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.224.190:39365
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:39365
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.224.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19442
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:19.130777 19442 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:19.131016 19442 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:19.136109 19450 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:19.136193 19442 server_base.cc:1034] running on GCE node
W20260805 22:47:19.136116 19448 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:19.136116 19454 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:19.136610 19442 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:19.136909 19442 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:19.138053 19442 hybrid_clock.cc:648] HybridClock initialized: now 1785970039138038 us; error 33 us; skew 500 ppm
Aug 05 22:47:19 dist-test-slave-gjrz krb5kdc[19423](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970039, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:19.140609 19442 init.cc:377] Logged in from keytab as kudu/127.14.224.190@KRBTEST.COM (short username kudu)
I20260805 22:47:19.141050 19442 webserver.cc:460] Webserver started at http://127.14.224.190:40697/ using document root <none> and password file <none>
I20260805 22:47:19.141286 19442 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:19.141337 19442 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:19.141469 19442 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:19.142602 19442 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/minicluster-data/master-0/data/instance:
uuid: "0ef939a9321b490bb696a4a5ffee4420"
format_stamp: "Formatted at 2026-08-05 22:47:19 on dist-test-slave-gjrz"
server_key: "d98b486218374c6dd43a5e11d2541042"
server_key_iv: "833438521ecc9547417b79d771894876"
server_key_version: "encryptionkey@0"
I20260805 22:47:19.142961 19442 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/minicluster-data/master-0/wal/instance:
uuid: "0ef939a9321b490bb696a4a5ffee4420"
format_stamp: "Formatted at 2026-08-05 22:47:19 on dist-test-slave-gjrz"
server_key: "d98b486218374c6dd43a5e11d2541042"
server_key_iv: "833438521ecc9547417b79d771894876"
server_key_version: "encryptionkey@0"
I20260805 22:47:19.144395 19442 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260805 22:47:19.145164 19466 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:19.145328 19442 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260805 22:47:19.145407 19442 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/minicluster-data/master-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/minicluster-data/master-0/wal
uuid: "0ef939a9321b490bb696a4a5ffee4420"
format_stamp: "Formatted at 2026-08-05 22:47:19 on dist-test-slave-gjrz"
server_key: "d98b486218374c6dd43a5e11d2541042"
server_key_iv: "833438521ecc9547417b79d771894876"
server_key_version: "encryptionkey@0"
I20260805 22:47:19.145473 19442 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:19.159946 19442 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:19.161805 19442 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:19.161960 19442 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:19.166028 19442 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.190:39365
I20260805 22:47:19.166121 19541 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.190:39365 every 8 connection(s)
I20260805 22:47:19.166430 19442 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
I20260805 22:47:19.167505 19543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:19.168927 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 19442
I20260805 22:47:19.169052 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/minicluster-data/master-0/wal/instance
I20260805 22:47:19.169232 15234 external_mini_cluster.cc:1428] Setting key f3a16248321d6647fe10743bf87e3a68
I20260805 22:47:19.170220 19543 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ef939a9321b490bb696a4a5ffee4420: Bootstrap starting.
I20260805 22:47:19.170817 19543 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0ef939a9321b490bb696a4a5ffee4420: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:19.171082 19543 log.cc:824] T 00000000000000000000000000000000 P 0ef939a9321b490bb696a4a5ffee4420: Log is configured to *not* fsync() on all Append() calls
I20260805 22:47:19.171752 19543 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ef939a9321b490bb696a4a5ffee4420: No bootstrap required, opened a new log
I20260805 22:47:19.173525 19543 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0ef939a9321b490bb696a4a5ffee4420 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ef939a9321b490bb696a4a5ffee4420" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 39365 } }
I20260805 22:47:19.173669 19543 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0ef939a9321b490bb696a4a5ffee4420 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:19.173702 19543 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0ef939a9321b490bb696a4a5ffee4420 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ef939a9321b490bb696a4a5ffee4420, State: Initialized, Role: FOLLOWER
I20260805 22:47:19.173835 19543 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0ef939a9321b490bb696a4a5ffee4420 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ef939a9321b490bb696a4a5ffee4420" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 39365 } }
I20260805 22:47:19.173936 19543 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0ef939a9321b490bb696a4a5ffee4420 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:47:19.173969 19543 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0ef939a9321b490bb696a4a5ffee4420 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:47:19.174019 19543 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0ef939a9321b490bb696a4a5ffee4420 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:19.174625 19543 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0ef939a9321b490bb696a4a5ffee4420 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ef939a9321b490bb696a4a5ffee4420" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 39365 } }
I20260805 22:47:19.174732 19543 leader_election.cc:302] T 00000000000000000000000000000000 P 0ef939a9321b490bb696a4a5ffee4420 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0ef939a9321b490bb696a4a5ffee4420; no voters:
I20260805 22:47:19.174911 19543 leader_election.cc:288] T 00000000000000000000000000000000 P 0ef939a9321b490bb696a4a5ffee4420 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:47:19.174955 19551 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0ef939a9321b490bb696a4a5ffee4420 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:47:19.175071 19551 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0ef939a9321b490bb696a4a5ffee4420 [term 1 LEADER]: Becoming Leader. State: Replica: 0ef939a9321b490bb696a4a5ffee4420, State: Running, Role: LEADER
I20260805 22:47:19.175195 19543 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0ef939a9321b490bb696a4a5ffee4420 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:47:19.175216 19551 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0ef939a9321b490bb696a4a5ffee4420 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ef939a9321b490bb696a4a5ffee4420" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 39365 } }
Aug 05 22:47:19 dist-test-slave-gjrz krb5kdc[19423](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970039, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:47:19.175642 19551 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ef939a9321b490bb696a4a5ffee4420 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0ef939a9321b490bb696a4a5ffee4420. Latest consensus state: current_term: 1 leader_uuid: "0ef939a9321b490bb696a4a5ffee4420" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ef939a9321b490bb696a4a5ffee4420" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 39365 } } }
I20260805 22:47:19.175652 19553 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ef939a9321b490bb696a4a5ffee4420 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0ef939a9321b490bb696a4a5ffee4420" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ef939a9321b490bb696a4a5ffee4420" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 39365 } } }
I20260805 22:47:19.175732 19551 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ef939a9321b490bb696a4a5ffee4420 [sys.catalog]: This master's current role is: LEADER
I20260805 22:47:19.175786 19553 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ef939a9321b490bb696a4a5ffee4420 [sys.catalog]: This master's current role is: LEADER
I20260805 22:47:19.175993 19559 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:47:19.176574 19559 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:47:19.179374 19559 catalog_manager.cc:1347] Generated new cluster ID: 9a7a1051a9ea483583858335fe2f27cf
I20260805 22:47:19.179481 19559 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:47:19.179840 19549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:19.169799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40650 (local address 127.14.224.190:39365)
0805 22:47:19.170007 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:19.170017 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:19.170044 (+ 27us) server_negotiation.cc:407] Connection header received
0805 22:47:19.170489 (+ 445us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:19.170497 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:19.170547 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:19.170679 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:19.171378 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:19.172323 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:19.173084 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:19.173487 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:19.173587 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:19.176287 (+ 2700us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:19.176291 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:19.176292 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:19.176305 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:19.178059 (+ 1754us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:19.178472 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:19.178476 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:19.178476 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:19.178591 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:19.178806 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:19.178808 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:19.178808 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:19.179144 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:19.179322 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:19.179484 (+ 162us) server_negotiation.cc:299] Negotiation successful
0805 22:47:19.179639 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":93,"threads_started":1}
I20260805 22:47:19.188014 19559 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:47:19.188552 19559 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:47:19.196357 19559 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0ef939a9321b490bb696a4a5ffee4420: Generated new TSK 0
I20260805 22:47:19.196568 19559 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.224.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab.
Entry for principal kudu/127.14.224.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab.
I20260805 22:47:19.230142 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.129:0
--local_ip_for_outbound_sockets=127.14.224.129
--webserver_interface=127.14.224.129
--webserver_port=0
--tserver_master_addrs=127.14.224.190:39365
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab
--principal=kudu/127.14.224.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:44973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:47:19.317595 19583 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:19.317836 19583 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:19.317862 19583 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:19.319245 19583 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:19.319669 19583 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:19.319764 19583 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.129
I20260805 22:47:19.321642 19583 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:44973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab
--principal=kudu/127.14.224.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.224.129
--webserver_port=0
--tserver_master_addrs=127.14.224.190:39365
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19583
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.129
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:19.321929 19583 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:19.322193 19583 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:19.327477 19592 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:19.327623 19583 server_base.cc:1034] running on GCE node
W20260805 22:47:19.327554 19591 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:19.327482 19594 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:19.327979 19583 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:19.328274 19583 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:19.329422 19583 hybrid_clock.cc:648] HybridClock initialized: now 1785970039329416 us; error 32 us; skew 500 ppm
Aug 05 22:47:19 dist-test-slave-gjrz krb5kdc[19423](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970039, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:19.332093 19583 init.cc:377] Logged in from keytab as kudu/127.14.224.129@KRBTEST.COM (short username kudu)
I20260805 22:47:19.332602 19583 webserver.cc:460] Webserver started at http://127.14.224.129:45579/ using document root <none> and password file <none>
I20260805 22:47:19.332803 19583 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:19.332851 19583 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:19.332952 19583 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:19.334014 19583 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-0/data/instance:
uuid: "6e47e79339ab4bed911eb32276105bf2"
format_stamp: "Formatted at 2026-08-05 22:47:19 on dist-test-slave-gjrz"
server_key: "8b5847c629cb545e458894280bfb22b3"
server_key_iv: "24a60b1cfbe366fa027224028f5024c4"
server_key_version: "encryptionkey@0"
I20260805 22:47:19.334342 19583 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-0/wal/instance:
uuid: "6e47e79339ab4bed911eb32276105bf2"
format_stamp: "Formatted at 2026-08-05 22:47:19 on dist-test-slave-gjrz"
server_key: "8b5847c629cb545e458894280bfb22b3"
server_key_iv: "24a60b1cfbe366fa027224028f5024c4"
server_key_version: "encryptionkey@0"
I20260805 22:47:19.335819 19583 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260805 22:47:19.336525 19602 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:19.336714 19583 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260805 22:47:19.336807 19583 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-0/wal
uuid: "6e47e79339ab4bed911eb32276105bf2"
format_stamp: "Formatted at 2026-08-05 22:47:19 on dist-test-slave-gjrz"
server_key: "8b5847c629cb545e458894280bfb22b3"
server_key_iv: "24a60b1cfbe366fa027224028f5024c4"
server_key_version: "encryptionkey@0"
I20260805 22:47:19.336880 19583 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:19.352144 19583 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:19.354372 19583 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:19.354506 19583 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:19.354754 19583 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:47:19.355077 19583 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:47:19.355113 19583 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:19.355135 19583 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:47:19.355147 19583 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:19.360934 19583 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.129:33441
I20260805 22:47:19.360977 19777 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.129:33441 every 8 connection(s)
I20260805 22:47:19.361313 19583 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
I20260805 22:47:19.367290 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 19583
Aug 05 22:47:19 dist-test-slave-gjrz krb5kdc[19423](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970039, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.129@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:47:19.367403 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-0/wal/instance
I20260805 22:47:19.367597 15234 external_mini_cluster.cc:1428] Setting key a1726dec03e17e746fa2be0221d10899
I20260805 22:47:19.370790 19549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:19.362055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.129:56659 (local address 127.14.224.190:39365)
0805 22:47:19.362118 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:19.362120 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:19.362322 (+ 202us) server_negotiation.cc:407] Connection header received
0805 22:47:19.362859 (+ 537us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:19.362860 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:19.362869 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:19.362908 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:19.363885 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:19.364395 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:19.365403 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:19.365602 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:19.365650 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:19.367859 (+ 2209us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:19.367862 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:19.367862 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:19.367872 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:19.369226 (+ 1354us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:19.369757 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:19.369757 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:19.369758 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:19.369837 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:19.370105 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:19.370105 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:19.370106 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:19.370259 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:19.370328 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:19.370575 (+ 247us) server_negotiation.cc:299] Negotiation successful
0805 22:47:19.370689 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260805 22:47:19.370883 19782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:19.362021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:39365 (local address 127.14.224.129:56659)
0805 22:47:19.362196 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:19.362240 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:19.362754 (+ 514us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:19.362974 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:19.362978 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:19.363604 (+ 626us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:19.363812 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:19.363817 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:19.364472 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:19.364473 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:19.365332 (+ 859us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:19.365335 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:19.365664 (+ 329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:19.365664 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:19.365771 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:19.366255 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:19.366263 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:19.367743 (+ 1480us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:19.369322 (+ 1579us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:19.369333 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:19.369336 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:19.369680 (+ 344us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:19.369908 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:19.369909 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:19.369910 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:19.370047 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:19.370320 (+ 273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:19.370324 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:19.370457 (+ 133us) client_negotiation.cc:769] Sending connection context
0805 22:47:19.370549 (+ 92us) client_negotiation.cc:240] Negotiation successful
0805 22:47:19.370693 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":101,"threads_started":1}
I20260805 22:47:19.371430 19778 heartbeater.cc:347] Connected to a master server at 127.14.224.190:39365
I20260805 22:47:19.371551 19778 heartbeater.cc:464] Registering TS with master...
I20260805 22:47:19.371767 19778 heartbeater.cc:511] Master 127.14.224.190:39365 requested a full tablet report, sending...
I20260805 22:47:19.372342 19495 ts_manager.cc:194] Registered new tserver with Master: 6e47e79339ab4bed911eb32276105bf2 (127.14.224.129:33441)
I20260805 22:47:19.372993 19495 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.224.129@KRBTEST.COM'} at 127.14.224.129:56659
WARNING: no policy specified for kudu/127.14.224.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab.
Entry for principal kudu/127.14.224.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab.
I20260805 22:47:19.398476 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.130:0
--local_ip_for_outbound_sockets=127.14.224.130
--webserver_interface=127.14.224.130
--webserver_port=0
--tserver_master_addrs=127.14.224.190:39365
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab
--principal=kudu/127.14.224.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:44973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:47:19.485836 19788 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:19.486070 19788 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:19.486095 19788 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:19.487357 19788 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:19.487406 19788 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:19.487433 19788 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.130
I20260805 22:47:19.488972 19788 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:44973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab
--principal=kudu/127.14.224.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.224.130
--webserver_port=0
--tserver_master_addrs=127.14.224.190:39365
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19788
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.130
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:19.489225 19788 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:19.489455 19788 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:19.495074 19796 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:19.495247 19798 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:19.495316 19795 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:19.495771 19788 server_base.cc:1034] running on GCE node
I20260805 22:47:19.496018 19788 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:19.496304 19788 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:19.497418 19788 hybrid_clock.cc:648] HybridClock initialized: now 1785970039497402 us; error 30 us; skew 500 ppm
Aug 05 22:47:19 dist-test-slave-gjrz krb5kdc[19423](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970039, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:19.500902 19788 init.cc:377] Logged in from keytab as kudu/127.14.224.130@KRBTEST.COM (short username kudu)
I20260805 22:47:19.501389 19788 webserver.cc:460] Webserver started at http://127.14.224.130:46599/ using document root <none> and password file <none>
I20260805 22:47:19.501639 19788 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:19.501694 19788 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:19.501827 19788 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:19.502978 19788 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-1/data/instance:
uuid: "e2ac84aa52114162ac2aa915f5520a98"
format_stamp: "Formatted at 2026-08-05 22:47:19 on dist-test-slave-gjrz"
server_key: "08a3942c1ad90142221524b99dd8cdac"
server_key_iv: "1c6c577cd74c55240ba1836cb806fba6"
server_key_version: "encryptionkey@0"
I20260805 22:47:19.503383 19788 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-1/wal/instance:
uuid: "e2ac84aa52114162ac2aa915f5520a98"
format_stamp: "Formatted at 2026-08-05 22:47:19 on dist-test-slave-gjrz"
server_key: "08a3942c1ad90142221524b99dd8cdac"
server_key_iv: "1c6c577cd74c55240ba1836cb806fba6"
server_key_version: "encryptionkey@0"
I20260805 22:47:19.504920 19788 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:47:19.505807 19807 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:19.506006 19788 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:47:19.506095 19788 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-1/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-1/wal
uuid: "e2ac84aa52114162ac2aa915f5520a98"
format_stamp: "Formatted at 2026-08-05 22:47:19 on dist-test-slave-gjrz"
server_key: "08a3942c1ad90142221524b99dd8cdac"
server_key_iv: "1c6c577cd74c55240ba1836cb806fba6"
server_key_version: "encryptionkey@0"
I20260805 22:47:19.506171 19788 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:19.515085 19788 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:19.516932 19788 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:19.517096 19788 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:19.517339 19788 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:47:19.517660 19788 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:47:19.517696 19788 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:19.517727 19788 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:47:19.517751 19788 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:19.523667 19788 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.130:43421
I20260805 22:47:19.523713 19969 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.130:43421 every 8 connection(s)
I20260805 22:47:19.524080 19788 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
I20260805 22:47:19.524734 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 19788
I20260805 22:47:19.524834 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-1/wal/instance
I20260805 22:47:19.525058 15234 external_mini_cluster.cc:1428] Setting key 2289be0630f32b68083f0e93b7f2e786
Aug 05 22:47:19 dist-test-slave-gjrz krb5kdc[19423](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970039, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.130@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.14.224.131@KRBTEST.COM; defaulting to no policy
I20260805 22:47:19.534893 19549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:19.524852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:51531 (local address 127.14.224.190:39365)
0805 22:47:19.524905 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:19.524907 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:19.525160 (+ 253us) server_negotiation.cc:407] Connection header received
0805 22:47:19.525685 (+ 525us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:19.525686 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:19.525697 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:19.525745 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:19.526728 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:19.527458 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:19.528926 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:19.529121 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:19.529170 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:19.531821 (+ 2651us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:19.531823 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:19.531823 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:19.531832 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:19.533216 (+ 1384us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:19.533729 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:19.533730 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:19.533730 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:19.533784 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:19.534076 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:19.534076 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:19.534077 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:19.534190 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:19.534237 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:19.534620 (+ 383us) server_negotiation.cc:299] Negotiation successful
0805 22:47:19.534805 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260805 22:47:19.535049 19972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:19.524811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:39365 (local address 127.14.224.130:51531)
0805 22:47:19.525001 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:19.525055 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:19.525589 (+ 534us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:19.525832 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:19.525835 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:19.526420 (+ 585us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:19.526628 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:19.526633 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:19.527582 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:19.527583 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:19.528830 (+ 1247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:19.528834 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:19.529200 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:19.529202 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:19.529345 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:19.529897 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:19.529908 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:19.531706 (+ 1798us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:19.533316 (+ 1610us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:19.533326 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:19.533329 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:19.533653 (+ 324us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:19.533846 (+ 193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:19.533847 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:19.533847 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:19.534011 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:19.534251 (+ 240us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:19.534259 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:19.534461 (+ 202us) client_negotiation.cc:769] Sending connection context
0805 22:47:19.534582 (+ 121us) client_negotiation.cc:240] Negotiation successful
0805 22:47:19.534777 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":91,"threads_started":1}
I20260805 22:47:19.535590 19970 heartbeater.cc:347] Connected to a master server at 127.14.224.190:39365
I20260805 22:47:19.535697 19970 heartbeater.cc:464] Registering TS with master...
I20260805 22:47:19.535900 19970 heartbeater.cc:511] Master 127.14.224.190:39365 requested a full tablet report, sending...
I20260805 22:47:19.536299 19495 ts_manager.cc:194] Registered new tserver with Master: e2ac84aa52114162ac2aa915f5520a98 (127.14.224.130:43421)
I20260805 22:47:19.536671 19495 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.224.130@KRBTEST.COM'} at 127.14.224.130:51531
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab.
Entry for principal kudu/127.14.224.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab.
I20260805 22:47:19.555001 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.131:0
--local_ip_for_outbound_sockets=127.14.224.131
--webserver_interface=127.14.224.131
--webserver_port=0
--tserver_master_addrs=127.14.224.190:39365
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab
--principal=kudu/127.14.224.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:44973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:47:19.639093 19976 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:19.639350 19976 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:19.639377 19976 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:19.640791 19976 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:19.640849 19976 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:19.640878 19976 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.131
I20260805 22:47:19.642431 19976 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:44973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab
--principal=kudu/127.14.224.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.224.131
--webserver_port=0
--tserver_master_addrs=127.14.224.190:39365
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19976
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.131
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:19.642661 19976 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:19.642866 19976 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:19.648067 19982 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:19.648118 19986 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:19.648129 19976 server_base.cc:1034] running on GCE node
W20260805 22:47:19.648059 19984 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:19.648454 19976 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:19.648743 19976 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:19.649896 19976 hybrid_clock.cc:648] HybridClock initialized: now 1785970039649879 us; error 31 us; skew 500 ppm
Aug 05 22:47:19 dist-test-slave-gjrz krb5kdc[19423](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970039, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:19.652575 19976 init.cc:377] Logged in from keytab as kudu/127.14.224.131@KRBTEST.COM (short username kudu)
I20260805 22:47:19.653064 19976 webserver.cc:460] Webserver started at http://127.14.224.131:37623/ using document root <none> and password file <none>
I20260805 22:47:19.653306 19976 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:19.653357 19976 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:19.653517 19976 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:19.654606 19976 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-2/data/instance:
uuid: "d6600cf30bef431fb2e2f8bdfcc7ce76"
format_stamp: "Formatted at 2026-08-05 22:47:19 on dist-test-slave-gjrz"
server_key: "0e198af9de11b72cceea60434ea1dede"
server_key_iv: "923658235dfd4f62d2f7b9a549beda76"
server_key_version: "encryptionkey@0"
I20260805 22:47:19.654963 19976 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-2/wal/instance:
uuid: "d6600cf30bef431fb2e2f8bdfcc7ce76"
format_stamp: "Formatted at 2026-08-05 22:47:19 on dist-test-slave-gjrz"
server_key: "0e198af9de11b72cceea60434ea1dede"
server_key_iv: "923658235dfd4f62d2f7b9a549beda76"
server_key_version: "encryptionkey@0"
I20260805 22:47:19.656402 19976 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260805 22:47:19.657193 19997 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:19.657379 19976 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:47:19.657476 19976 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-2/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-2/wal
uuid: "d6600cf30bef431fb2e2f8bdfcc7ce76"
format_stamp: "Formatted at 2026-08-05 22:47:19 on dist-test-slave-gjrz"
server_key: "0e198af9de11b72cceea60434ea1dede"
server_key_iv: "923658235dfd4f62d2f7b9a549beda76"
server_key_version: "encryptionkey@0"
I20260805 22:47:19.657553 19976 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:19.669126 19976 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:19.670962 19976 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:19.671113 19976 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:19.671430 19976 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:47:19.671762 19976 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:47:19.671798 19976 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:19.671828 19976 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:47:19.671852 19976 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:19.677917 19976 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.131:40951
I20260805 22:47:19.677966 20154 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.131:40951 every 8 connection(s)
I20260805 22:47:19.678306 19976 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
I20260805 22:47:19.681169 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 19976
I20260805 22:47:19.681262 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970021300824-15234-0/minicluster-data/ts-2/wal/instance
I20260805 22:47:19.681465 15234 external_mini_cluster.cc:1428] Setting key 2433a0d3f43b9d06e4c04a69648bf4f4
Aug 05 22:47:19 dist-test-slave-gjrz krb5kdc[19423](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970039, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.131@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:47:19.688555 19549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:19.678999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:48273 (local address 127.14.224.190:39365)
0805 22:47:19.679076 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:19.679079 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:19.679292 (+ 213us) server_negotiation.cc:407] Connection header received
0805 22:47:19.679813 (+ 521us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:19.679815 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:19.679830 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:19.679907 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:19.680943 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:19.681671 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:19.682950 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:19.683142 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:19.683199 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:19.685730 (+ 2531us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:19.685732 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:19.685732 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:19.685742 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:19.687104 (+ 1362us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:19.687566 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:19.687567 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:19.687568 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:19.687630 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:19.687888 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:19.687889 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:19.687890 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:19.688023 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:19.688079 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:19.688371 (+ 292us) server_negotiation.cc:299] Negotiation successful
0805 22:47:19.688461 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260805 22:47:19.688797 20157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:19.678996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:39365 (local address 127.14.224.131:48273)
0805 22:47:19.679160 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:19.679199 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:19.679716 (+ 517us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:19.679963 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:19.679966 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:19.680591 (+ 625us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:19.680795 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:19.680801 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:19.681770 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:19.681771 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:19.682845 (+ 1074us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:19.682849 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:19.683212 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:19.683212 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:19.683372 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:19.683878 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:19.683888 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:19.685633 (+ 1745us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:19.687199 (+ 1566us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:19.687207 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:19.687210 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:19.687493 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:19.687689 (+ 196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:19.687690 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:19.687690 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:19.687820 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:19.688080 (+ 260us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:19.688087 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:19.688237 (+ 150us) client_negotiation.cc:769] Sending connection context
0805 22:47:19.688326 (+ 89us) client_negotiation.cc:240] Negotiation successful
0805 22:47:19.688503 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":92,"threads_started":1}
I20260805 22:47:19.689275 20155 heartbeater.cc:347] Connected to a master server at 127.14.224.190:39365
I20260805 22:47:19.689384 20155 heartbeater.cc:464] Registering TS with master...
I20260805 22:47:19.689572 20155 heartbeater.cc:511] Master 127.14.224.190:39365 requested a full tablet report, sending...
I20260805 22:47:19.689929 19495 ts_manager.cc:194] Registered new tserver with Master: d6600cf30bef431fb2e2f8bdfcc7ce76 (127.14.224.131:40951)
I20260805 22:47:19.690291 19495 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.224.131@KRBTEST.COM'} at 127.14.224.131:48273
I20260805 22:47:19.693095 15234 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 05 22:47:19 dist-test-slave-gjrz krb5kdc[19423](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970039, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 05 22:47:19 dist-test-slave-gjrz krb5kdc[19423](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970039, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:47:19.716741 19549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:19.709727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46136 (local address 127.14.224.190:39365)
0805 22:47:19.709799 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:19.709802 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:19.709911 (+ 109us) server_negotiation.cc:407] Connection header received
0805 22:47:19.710026 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:19.710027 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:19.710038 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:19.710082 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:19.710717 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:19.711225 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:19.711978 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:19.712169 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:19.712225 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:19.714458 (+ 2233us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:19.714459 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:19.714459 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:19.714467 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:19.715633 (+ 1166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:19.715981 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:19.715982 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:19.715983 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:19.716041 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:19.716212 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:19.716212 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:19.716213 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:19.716369 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:19.716468 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:19.716566 (+ 98us) server_negotiation.cc:299] Negotiation successful
0805 22:47:19.716648 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
W20260805 22:47:19.717003 19495 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:46136
I20260805 22:47:19.717459 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 19583
I20260805 22:47:19.732651 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 19788
I20260805 22:47:19.748312 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 19976
I20260805 22:47:19.762574 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 19442
2026-08-05T22:47:19Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (1985 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:47:19 dist-test-slave-gjrz krb5kdc[20176](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:47:19 dist-test-slave-gjrz krb5kdc[20176](info): set up 2 sockets
Aug 05 22:47:19 dist-test-slave-gjrz krb5kdc[20176](info): commencing operation
krb5kdc: starting...
W20260805 22:47:20.896392 15234 mini_kdc.cc:121] Time spent starting KDC: real 1.108s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Aug 05 22:47:20 dist-test-slave-gjrz krb5kdc[20176](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970040, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:47:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:47:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.224.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab.
Entry for principal kudu/127.14.224.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab.
I20260805 22:47:21.022596 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:34881
--webserver_interface=127.14.224.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:36681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.224.190:34881
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:47:21.105589 20191 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:21.105844 20191 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:21.105867 20191 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:21.107050 20191 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:47:21.107095 20191 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:21.107108 20191 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:21.107120 20191 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:47:21.107131 20191 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:47:21.108768 20191 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:36681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.224.190:34881
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:34881
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.224.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20191
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:21.108997 20191 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:21.109191 20191 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:21.114220 20197 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:21.114324 20191 server_base.cc:1034] running on GCE node
W20260805 22:47:21.114234 20196 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:21.114235 20201 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:21.114676 20191 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:21.114986 20191 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:21.116132 20191 hybrid_clock.cc:648] HybridClock initialized: now 1785970041116114 us; error 32 us; skew 500 ppm
Aug 05 22:47:21 dist-test-slave-gjrz krb5kdc[20176](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970041, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:21.118721 20191 init.cc:377] Logged in from keytab as kudu/127.14.224.190@KRBTEST.COM (short username kudu)
I20260805 22:47:21.119218 20191 webserver.cc:460] Webserver started at http://127.14.224.190:43619/ using document root <none> and password file <none>
I20260805 22:47:21.119453 20191 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:21.119501 20191 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:21.119634 20191 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:21.120711 20191 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/minicluster-data/master-0/data/instance:
uuid: "bbf5ad8b330c4fddbbd91aed02002fc6"
format_stamp: "Formatted at 2026-08-05 22:47:21 on dist-test-slave-gjrz"
server_key: "421311fb5bfd84aad8f8fcc973db4a1a"
server_key_iv: "2b2b76d0c9839546b9e107155592f118"
server_key_version: "encryptionkey@0"
I20260805 22:47:21.121053 20191 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/minicluster-data/master-0/wal/instance:
uuid: "bbf5ad8b330c4fddbbd91aed02002fc6"
format_stamp: "Formatted at 2026-08-05 22:47:21 on dist-test-slave-gjrz"
server_key: "421311fb5bfd84aad8f8fcc973db4a1a"
server_key_iv: "2b2b76d0c9839546b9e107155592f118"
server_key_version: "encryptionkey@0"
I20260805 22:47:21.122402 20191 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260805 22:47:21.123363 20212 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:21.123571 20191 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:47:21.123672 20191 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/minicluster-data/master-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/minicluster-data/master-0/wal
uuid: "bbf5ad8b330c4fddbbd91aed02002fc6"
format_stamp: "Formatted at 2026-08-05 22:47:21 on dist-test-slave-gjrz"
server_key: "421311fb5bfd84aad8f8fcc973db4a1a"
server_key_iv: "2b2b76d0c9839546b9e107155592f118"
server_key_version: "encryptionkey@0"
I20260805 22:47:21.123746 20191 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:21.136016 20191 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:21.138279 20191 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:21.138428 20191 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:21.142488 20191 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.190:34881
I20260805 22:47:21.142529 20285 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.190:34881 every 8 connection(s)
I20260805 22:47:21.143040 20191 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
I20260805 22:47:21.143750 20287 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:21.146231 20287 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bbf5ad8b330c4fddbbd91aed02002fc6: Bootstrap starting.
I20260805 22:47:21.146885 20287 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bbf5ad8b330c4fddbbd91aed02002fc6: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:21.147174 20287 log.cc:824] T 00000000000000000000000000000000 P bbf5ad8b330c4fddbbd91aed02002fc6: Log is configured to *not* fsync() on all Append() calls
I20260805 22:47:21.148018 20287 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bbf5ad8b330c4fddbbd91aed02002fc6: No bootstrap required, opened a new log
I20260805 22:47:21.148394 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 20191
I20260805 22:47:21.148492 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/minicluster-data/master-0/wal/instance
I20260805 22:47:21.148671 15234 external_mini_cluster.cc:1428] Setting key 68393bd171d7ae80f2d2d6e359f16030
I20260805 22:47:21.150621 20287 raft_consensus.cc:348] T 00000000000000000000000000000000 P bbf5ad8b330c4fddbbd91aed02002fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbf5ad8b330c4fddbbd91aed02002fc6" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 34881 } }
I20260805 22:47:21.150810 20287 raft_consensus.cc:374] T 00000000000000000000000000000000 P bbf5ad8b330c4fddbbd91aed02002fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:21.150846 20287 raft_consensus.cc:729] T 00000000000000000000000000000000 P bbf5ad8b330c4fddbbd91aed02002fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbf5ad8b330c4fddbbd91aed02002fc6, State: Initialized, Role: FOLLOWER
I20260805 22:47:21.151024 20287 consensus_queue.cc:260] T 00000000000000000000000000000000 P bbf5ad8b330c4fddbbd91aed02002fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbf5ad8b330c4fddbbd91aed02002fc6" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 34881 } }
I20260805 22:47:21.151111 20287 raft_consensus.cc:388] T 00000000000000000000000000000000 P bbf5ad8b330c4fddbbd91aed02002fc6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:47:21.151134 20287 raft_consensus.cc:482] T 00000000000000000000000000000000 P bbf5ad8b330c4fddbbd91aed02002fc6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:47:21.151181 20287 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bbf5ad8b330c4fddbbd91aed02002fc6 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:21.151909 20287 raft_consensus.cc:504] T 00000000000000000000000000000000 P bbf5ad8b330c4fddbbd91aed02002fc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbf5ad8b330c4fddbbd91aed02002fc6" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 34881 } }
I20260805 22:47:21.152024 20287 leader_election.cc:302] T 00000000000000000000000000000000 P bbf5ad8b330c4fddbbd91aed02002fc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bbf5ad8b330c4fddbbd91aed02002fc6; no voters:
I20260805 22:47:21.152185 20287 leader_election.cc:288] T 00000000000000000000000000000000 P bbf5ad8b330c4fddbbd91aed02002fc6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:47:21.152227 20293 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bbf5ad8b330c4fddbbd91aed02002fc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:47:21.152443 20287 sys_catalog.cc:564] T 00000000000000000000000000000000 P bbf5ad8b330c4fddbbd91aed02002fc6 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:47:21.152446 20293 raft_consensus.cc:686] T 00000000000000000000000000000000 P bbf5ad8b330c4fddbbd91aed02002fc6 [term 1 LEADER]: Becoming Leader. State: Replica: bbf5ad8b330c4fddbbd91aed02002fc6, State: Running, Role: LEADER
I20260805 22:47:21.152655 20293 consensus_queue.cc:237] T 00000000000000000000000000000000 P bbf5ad8b330c4fddbbd91aed02002fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbf5ad8b330c4fddbbd91aed02002fc6" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 34881 } }
I20260805 22:47:21.153052 20294 sys_catalog.cc:455] T 00000000000000000000000000000000 P bbf5ad8b330c4fddbbd91aed02002fc6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bbf5ad8b330c4fddbbd91aed02002fc6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbf5ad8b330c4fddbbd91aed02002fc6" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 34881 } } }
I20260805 22:47:21.153142 20294 sys_catalog.cc:458] T 00000000000000000000000000000000 P bbf5ad8b330c4fddbbd91aed02002fc6 [sys.catalog]: This master's current role is: LEADER
I20260805 22:47:21.153383 20297 sys_catalog.cc:455] T 00000000000000000000000000000000 P bbf5ad8b330c4fddbbd91aed02002fc6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bbf5ad8b330c4fddbbd91aed02002fc6. Latest consensus state: current_term: 1 leader_uuid: "bbf5ad8b330c4fddbbd91aed02002fc6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbf5ad8b330c4fddbbd91aed02002fc6" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 34881 } } }
I20260805 22:47:21.153685 20297 sys_catalog.cc:458] T 00000000000000000000000000000000 P bbf5ad8b330c4fddbbd91aed02002fc6 [sys.catalog]: This master's current role is: LEADER
W20260805 22:47:21.154286 20323 catalog_manager.cc:1558] T 00000000000000000000000000000000 P bbf5ad8b330c4fddbbd91aed02002fc6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260805 22:47:21.154803 20323 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260805 22:47:21.154894 20312 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:47:21.155074 20312 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 05 22:47:21 dist-test-slave-gjrz krb5kdc[20176](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970040, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:47:21.156792 20312 catalog_manager.cc:1347] Generated new cluster ID: 0ef3cb3aec764c0dad3110cad3fccbc2
I20260805 22:47:21.156838 20312 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:47:21.161130 20292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:21.149213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45686 (local address 127.14.224.190:34881)
0805 22:47:21.149432 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:21.149442 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:21.149479 (+ 37us) server_negotiation.cc:407] Connection header received
0805 22:47:21.150583 (+ 1104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:21.150593 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:21.150663 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:21.150822 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:21.151629 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:21.152980 (+ 1351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:21.154069 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:21.154498 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:21.154594 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:21.157288 (+ 2694us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:21.157292 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:21.157293 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:21.157306 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:21.159457 (+ 2151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:21.159835 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:21.159838 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:21.159838 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:21.159979 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:21.160183 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:21.160184 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:21.160185 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:21.160514 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:21.160682 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:21.160756 (+ 74us) server_negotiation.cc:299] Negotiation successful
0805 22:47:21.160903 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":105,"threads_started":1}
I20260805 22:47:21.187757 20312 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:47:21.188649 20312 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:47:21.195856 20312 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bbf5ad8b330c4fddbbd91aed02002fc6: Generated new TSK 0
I20260805 22:47:21.196077 20312 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.224.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab.
Entry for principal kudu/127.14.224.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab.
I20260805 22:47:21.226670 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.129:0
--local_ip_for_outbound_sockets=127.14.224.129
--webserver_interface=127.14.224.129
--webserver_port=0
--tserver_master_addrs=127.14.224.190:34881
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab
--principal=kudu/127.14.224.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:36681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:47:21.311908 20334 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:21.312150 20334 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:21.312186 20334 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:21.313481 20334 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:21.313537 20334 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:21.313576 20334 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.129
I20260805 22:47:21.315224 20334 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:36681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab
--principal=kudu/127.14.224.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.224.129
--webserver_port=0
--tserver_master_addrs=127.14.224.190:34881
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20334
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.129
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:21.315538 20334 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:21.315769 20334 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:21.321182 20340 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:21.321187 20341 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:21.321187 20344 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:21.321321 20334 server_base.cc:1034] running on GCE node
I20260805 22:47:21.321695 20334 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:21.321962 20334 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:21.323143 20334 hybrid_clock.cc:648] HybridClock initialized: now 1785970041323121 us; error 38 us; skew 500 ppm
Aug 05 22:47:21 dist-test-slave-gjrz krb5kdc[20176](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970041, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:21.326350 20334 init.cc:377] Logged in from keytab as kudu/127.14.224.129@KRBTEST.COM (short username kudu)
I20260805 22:47:21.326858 20334 webserver.cc:460] Webserver started at http://127.14.224.129:43941/ using document root <none> and password file <none>
I20260805 22:47:21.327076 20334 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:21.327122 20334 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:21.327216 20334 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:21.328346 20334 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/minicluster-data/ts-0/data/instance:
uuid: "f242b14fa32e46af8a3ff0a9915b231a"
format_stamp: "Formatted at 2026-08-05 22:47:21 on dist-test-slave-gjrz"
server_key: "6d91461410ddebf03eefc1c45cefeb89"
server_key_iv: "f90d977246cfd522ad38f80678737d6e"
server_key_version: "encryptionkey@0"
I20260805 22:47:21.328665 20334 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/minicluster-data/ts-0/wal/instance:
uuid: "f242b14fa32e46af8a3ff0a9915b231a"
format_stamp: "Formatted at 2026-08-05 22:47:21 on dist-test-slave-gjrz"
server_key: "6d91461410ddebf03eefc1c45cefeb89"
server_key_iv: "f90d977246cfd522ad38f80678737d6e"
server_key_version: "encryptionkey@0"
I20260805 22:47:21.329991 20334 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260805 22:47:21.330770 20351 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:21.330943 20334 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260805 22:47:21.331032 20334 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/minicluster-data/ts-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/minicluster-data/ts-0/wal
uuid: "f242b14fa32e46af8a3ff0a9915b231a"
format_stamp: "Formatted at 2026-08-05 22:47:21 on dist-test-slave-gjrz"
server_key: "6d91461410ddebf03eefc1c45cefeb89"
server_key_iv: "f90d977246cfd522ad38f80678737d6e"
server_key_version: "encryptionkey@0"
I20260805 22:47:21.331102 20334 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:21.357052 20334 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:21.359306 20334 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:21.359447 20334 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:21.359660 20334 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:47:21.359987 20334 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:47:21.360025 20334 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:21.360049 20334 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:47:21.360071 20334 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:21.365788 20334 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.129:45737
I20260805 22:47:21.365837 20516 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.129:45737 every 8 connection(s)
I20260805 22:47:21.366194 20334 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
Aug 05 22:47:21 dist-test-slave-gjrz krb5kdc[20176](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970041, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.129@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:47:21.373238 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 20334
I20260805 22:47:21.373347 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/minicluster-data/ts-0/wal/instance
I20260805 22:47:21.373561 15234 external_mini_cluster.cc:1428] Setting key 47bb6c3e3af7c1da14c5ebee76c5c1a3
I20260805 22:47:21.375731 20292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:21.366991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.129:38371 (local address 127.14.224.190:34881)
0805 22:47:21.367054 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:21.367057 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:21.367250 (+ 193us) server_negotiation.cc:407] Connection header received
0805 22:47:21.368189 (+ 939us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:21.368190 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:21.368200 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:21.368252 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:21.368880 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:21.369413 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:21.370390 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:21.370610 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:21.370666 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:21.372753 (+ 2087us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:21.372755 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:21.372755 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:21.372762 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:21.374349 (+ 1587us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:21.374752 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:21.374753 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:21.374754 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:21.374817 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:21.375051 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:21.375051 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:21.375052 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:21.375170 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:21.375228 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:21.375538 (+ 310us) server_negotiation.cc:299] Negotiation successful
0805 22:47:21.375632 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260805 22:47:21.375912 20520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:21.366959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:34881 (local address 127.14.224.129:38371)
0805 22:47:21.367129 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:21.367169 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:21.368100 (+ 931us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:21.368325 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:21.368328 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:21.368603 (+ 275us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:21.368799 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:21.368803 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:21.369485 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:21.369485 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:21.370302 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:21.370305 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:21.370676 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:21.370677 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:21.370777 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:21.371226 (+ 449us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:21.371234 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:21.372640 (+ 1406us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:21.374424 (+ 1784us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:21.374434 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:21.374437 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:21.374680 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:21.374872 (+ 192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:21.374873 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:21.374873 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:21.374984 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:21.375229 (+ 245us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:21.375237 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:21.375410 (+ 173us) client_negotiation.cc:769] Sending connection context
0805 22:47:21.375505 (+ 95us) client_negotiation.cc:240] Negotiation successful
0805 22:47:21.375680 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":87,"threads_started":1}
I20260805 22:47:21.376488 20518 heartbeater.cc:347] Connected to a master server at 127.14.224.190:34881
I20260805 22:47:21.376590 20518 heartbeater.cc:464] Registering TS with master...
I20260805 22:47:21.376778 20518 heartbeater.cc:511] Master 127.14.224.190:34881 requested a full tablet report, sending...
I20260805 22:47:21.377288 20236 ts_manager.cc:194] Registered new tserver with Master: f242b14fa32e46af8a3ff0a9915b231a (127.14.224.129:45737)
I20260805 22:47:21.377899 20236 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.224.129@KRBTEST.COM'} at 127.14.224.129:38371
WARNING: no policy specified for kudu/127.14.224.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab.
Entry for principal kudu/127.14.224.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab.
I20260805 22:47:21.402789 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.130:0
--local_ip_for_outbound_sockets=127.14.224.130
--webserver_interface=127.14.224.130
--webserver_port=0
--tserver_master_addrs=127.14.224.190:34881
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab
--principal=kudu/127.14.224.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:36681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:47:21.489565 20524 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:21.489796 20524 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:21.489831 20524 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:21.491231 20524 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:21.491318 20524 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:21.491361 20524 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.130
I20260805 22:47:21.493844 20524 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:36681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab
--principal=kudu/127.14.224.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.224.130
--webserver_port=0
--tserver_master_addrs=127.14.224.190:34881
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20524
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.130
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:21.494163 20524 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:21.494477 20524 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:21.500608 20531 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:21.500577 20535 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:21.500731 20524 server_base.cc:1034] running on GCE node
W20260805 22:47:21.500578 20529 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:21.501037 20524 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:21.501295 20524 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:21.502456 20524 hybrid_clock.cc:648] HybridClock initialized: now 1785970041502437 us; error 28 us; skew 500 ppm
Aug 05 22:47:21 dist-test-slave-gjrz krb5kdc[20176](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970041, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:21.505046 20524 init.cc:377] Logged in from keytab as kudu/127.14.224.130@KRBTEST.COM (short username kudu)
I20260805 22:47:21.505530 20524 webserver.cc:460] Webserver started at http://127.14.224.130:46589/ using document root <none> and password file <none>
I20260805 22:47:21.505757 20524 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:21.505805 20524 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:21.505934 20524 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:21.507026 20524 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/minicluster-data/ts-1/data/instance:
uuid: "80fdf0dd6de64cb5a138f2f8642e6d86"
format_stamp: "Formatted at 2026-08-05 22:47:21 on dist-test-slave-gjrz"
server_key: "ad5f598641ee1581d5fbb1a37b60a8c6"
server_key_iv: "475089bcc46d48793f948185e7372de2"
server_key_version: "encryptionkey@0"
I20260805 22:47:21.507396 20524 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/minicluster-data/ts-1/wal/instance:
uuid: "80fdf0dd6de64cb5a138f2f8642e6d86"
format_stamp: "Formatted at 2026-08-05 22:47:21 on dist-test-slave-gjrz"
server_key: "ad5f598641ee1581d5fbb1a37b60a8c6"
server_key_iv: "475089bcc46d48793f948185e7372de2"
server_key_version: "encryptionkey@0"
I20260805 22:47:21.508831 20524 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:47:21.509629 20549 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:21.509800 20524 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:47:21.509891 20524 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/minicluster-data/ts-1/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/minicluster-data/ts-1/wal
uuid: "80fdf0dd6de64cb5a138f2f8642e6d86"
format_stamp: "Formatted at 2026-08-05 22:47:21 on dist-test-slave-gjrz"
server_key: "ad5f598641ee1581d5fbb1a37b60a8c6"
server_key_iv: "475089bcc46d48793f948185e7372de2"
server_key_version: "encryptionkey@0"
I20260805 22:47:21.509989 20524 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:21.518121 20524 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:21.520195 20524 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:21.520342 20524 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:21.520571 20524 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:47:21.520879 20524 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:47:21.520921 20524 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:21.520951 20524 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:47:21.520975 20524 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:21.526991 20524 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.130:34995
I20260805 22:47:21.527051 20716 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.130:34995 every 8 connection(s)
I20260805 22:47:21.527489 20524 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
I20260805 22:47:21.528672 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 20524
I20260805 22:47:21.528784 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/minicluster-data/ts-1/wal/instance
I20260805 22:47:21.528976 15234 external_mini_cluster.cc:1428] Setting key 877573ac6bc43fabffd19b89514a82ec
Aug 05 22:47:21 dist-test-slave-gjrz krb5kdc[20176](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970041, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.130@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:47:21.538100 20292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:21.528274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:57243 (local address 127.14.224.190:34881)
0805 22:47:21.528352 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:21.528354 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:21.528520 (+ 166us) server_negotiation.cc:407] Connection header received
0805 22:47:21.529764 (+ 1244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:21.529764 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:21.529775 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:21.529812 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:21.530642 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:21.531143 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:21.532263 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:21.532552 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:21.532625 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:21.534980 (+ 2355us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:21.534982 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:21.534983 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:21.534992 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:21.536545 (+ 1553us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:21.537025 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:21.537027 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:21.537027 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:21.537100 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:21.537337 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:21.537338 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:21.537338 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:21.537499 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:21.537573 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:21.537897 (+ 324us) server_negotiation.cc:299] Negotiation successful
0805 22:47:21.537997 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260805 22:47:21.538200 20719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:21.528238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:34881 (local address 127.14.224.130:57243)
0805 22:47:21.528392 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:21.528436 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:21.529657 (+ 1221us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:21.529910 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:21.529916 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:21.530254 (+ 338us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:21.530544 (+ 290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:21.530551 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:21.531233 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:21.531235 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:21.532163 (+ 928us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:21.532166 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:21.532638 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:21.532638 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:21.532741 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:21.533279 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:21.533287 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:21.534868 (+ 1581us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:21.536664 (+ 1796us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:21.536672 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:21.536674 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:21.536921 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:21.537165 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:21.537166 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:21.537166 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:21.537277 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:21.537591 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:21.537598 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:21.537741 (+ 143us) client_negotiation.cc:769] Sending connection context
0805 22:47:21.537845 (+ 104us) client_negotiation.cc:240] Negotiation successful
0805 22:47:21.538005 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":69,"threads_started":1}
WARNING: no policy specified for kudu/127.14.224.131@KRBTEST.COM; defaulting to no policy
I20260805 22:47:21.538712 20717 heartbeater.cc:347] Connected to a master server at 127.14.224.190:34881
I20260805 22:47:21.538803 20717 heartbeater.cc:464] Registering TS with master...
I20260805 22:47:21.539007 20717 heartbeater.cc:511] Master 127.14.224.190:34881 requested a full tablet report, sending...
I20260805 22:47:21.539448 20236 ts_manager.cc:194] Registered new tserver with Master: 80fdf0dd6de64cb5a138f2f8642e6d86 (127.14.224.130:34995)
I20260805 22:47:21.539834 20236 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.224.130@KRBTEST.COM'} at 127.14.224.130:57243
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab.
Entry for principal kudu/127.14.224.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab.
I20260805 22:47:21.557855 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.131:0
--local_ip_for_outbound_sockets=127.14.224.131
--webserver_interface=127.14.224.131
--webserver_port=0
--tserver_master_addrs=127.14.224.190:34881
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab
--principal=kudu/127.14.224.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:36681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:47:21.641462 20722 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:21.641717 20722 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:21.641754 20722 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:21.643046 20722 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:21.643100 20722 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:21.643128 20722 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.131
I20260805 22:47:21.644909 20722 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:36681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab
--principal=kudu/127.14.224.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.224.131
--webserver_port=0
--tserver_master_addrs=127.14.224.190:34881
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20722
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.131
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:21.645171 20722 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:21.645406 20722 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:21.650547 20727 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:21.650535 20730 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:21.650555 20722 server_base.cc:1034] running on GCE node
W20260805 22:47:21.650520 20728 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:21.650964 20722 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:21.651183 20722 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:21.652362 20722 hybrid_clock.cc:648] HybridClock initialized: now 1785970041652357 us; error 41 us; skew 500 ppm
Aug 05 22:47:21 dist-test-slave-gjrz krb5kdc[20176](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970041, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:21.655032 20722 init.cc:377] Logged in from keytab as kudu/127.14.224.131@KRBTEST.COM (short username kudu)
I20260805 22:47:21.655509 20722 webserver.cc:460] Webserver started at http://127.14.224.131:41025/ using document root <none> and password file <none>
I20260805 22:47:21.655696 20722 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:21.655736 20722 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:21.655838 20722 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:21.656865 20722 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/minicluster-data/ts-2/data/instance:
uuid: "f23d8f5caf9c4fd09e99b75d68772014"
format_stamp: "Formatted at 2026-08-05 22:47:21 on dist-test-slave-gjrz"
server_key: "c8ea62ca3ad2824b7a736fb9626fd13d"
server_key_iv: "8a6eea594a5eafdc1dc23a856b31e254"
server_key_version: "encryptionkey@0"
I20260805 22:47:21.657196 20722 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/minicluster-data/ts-2/wal/instance:
uuid: "f23d8f5caf9c4fd09e99b75d68772014"
format_stamp: "Formatted at 2026-08-05 22:47:21 on dist-test-slave-gjrz"
server_key: "c8ea62ca3ad2824b7a736fb9626fd13d"
server_key_iv: "8a6eea594a5eafdc1dc23a856b31e254"
server_key_version: "encryptionkey@0"
I20260805 22:47:21.658448 20722 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260805 22:47:21.659103 20744 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:21.659307 20722 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260805 22:47:21.659405 20722 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/minicluster-data/ts-2/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/minicluster-data/ts-2/wal
uuid: "f23d8f5caf9c4fd09e99b75d68772014"
format_stamp: "Formatted at 2026-08-05 22:47:21 on dist-test-slave-gjrz"
server_key: "c8ea62ca3ad2824b7a736fb9626fd13d"
server_key_iv: "8a6eea594a5eafdc1dc23a856b31e254"
server_key_version: "encryptionkey@0"
I20260805 22:47:21.659479 20722 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:21.669329 20722 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:21.671118 20722 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:21.671254 20722 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:21.671545 20722 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:47:21.671885 20722 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:47:21.671921 20722 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:21.671945 20722 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:47:21.671968 20722 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:21.677597 20722 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.131:36929
I20260805 22:47:21.677667 20907 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.131:36929 every 8 connection(s)
I20260805 22:47:21.677973 20722 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
I20260805 22:47:21.683722 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 20722
I20260805 22:47:21.683820 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970021300824-15234-0/minicluster-data/ts-2/wal/instance
I20260805 22:47:21.683990 15234 external_mini_cluster.cc:1428] Setting key e2c048e010f8a861505945934845fb17
Aug 05 22:47:21 dist-test-slave-gjrz krb5kdc[20176](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970041, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.131@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:47:21.686932 20292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:21.678685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:58625 (local address 127.14.224.190:34881)
0805 22:47:21.678735 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:21.678737 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:21.678942 (+ 205us) server_negotiation.cc:407] Connection header received
0805 22:47:21.679922 (+ 980us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:21.679923 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:21.679935 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:21.679991 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:21.680597 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:21.681093 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:21.682080 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:21.682274 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:21.682319 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:21.684545 (+ 2226us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:21.684547 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:21.684547 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:21.684556 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:21.685789 (+ 1233us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:21.686179 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:21.686179 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:21.686180 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:21.686232 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:21.686428 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:21.686429 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:21.686429 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:21.686533 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:21.686580 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:21.686798 (+ 218us) server_negotiation.cc:299] Negotiation successful
0805 22:47:21.686865 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260805 22:47:21.687167 20910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:21.678664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:34881 (local address 127.14.224.131:58625)
0805 22:47:21.678817 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:21.678856 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:21.679825 (+ 969us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:21.680053 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:21.680056 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:21.680325 (+ 269us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:21.680531 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:21.680536 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:21.681186 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:21.681187 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:21.682007 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:21.682011 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:21.682331 (+ 320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:21.682332 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:21.682434 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:21.682907 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:21.682916 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:21.684460 (+ 1544us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:21.685865 (+ 1405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:21.685873 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:21.685875 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:21.686118 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:21.686279 (+ 161us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:21.686279 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:21.686280 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:21.686381 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:21.686576 (+ 195us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:21.686580 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:21.686700 (+ 120us) client_negotiation.cc:769] Sending connection context
0805 22:47:21.686781 (+ 81us) client_negotiation.cc:240] Negotiation successful
0805 22:47:21.686912 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":83,"threads_started":1}
I20260805 22:47:21.687630 20908 heartbeater.cc:347] Connected to a master server at 127.14.224.190:34881
I20260805 22:47:21.687721 20908 heartbeater.cc:464] Registering TS with master...
I20260805 22:47:21.687881 20908 heartbeater.cc:511] Master 127.14.224.190:34881 requested a full tablet report, sending...
I20260805 22:47:21.688247 20236 ts_manager.cc:194] Registered new tserver with Master: f23d8f5caf9c4fd09e99b75d68772014 (127.14.224.131:36929)
I20260805 22:47:21.688603 20236 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.224.131@KRBTEST.COM'} at 127.14.224.131:58625
I20260805 22:47:21.695849 15234 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 05 22:47:21 dist-test-slave-gjrz krb5kdc[20176](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970041, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 05 22:47:21 dist-test-slave-gjrz krb5kdc[20176](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970041, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.224.129@KRBTEST.COM
I20260805 22:47:21.719933 20915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:21.712208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33506 (local address 127.14.224.129:45737)
0805 22:47:21.712392 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:21.712397 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:21.712408 (+ 11us) server_negotiation.cc:407] Connection header received
0805 22:47:21.712437 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:21.712440 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:21.712454 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:21.712521 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:21.713163 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:21.713939 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:21.714721 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:21.715077 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:21.715166 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:21.717374 (+ 2208us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:21.717385 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:21.717386 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:21.717394 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:21.718884 (+ 1490us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:21.719193 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:21.719195 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:21.719196 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:21.719248 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:21.719480 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:21.719481 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:21.719481 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:21.719624 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:21.719730 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:21.719782 (+ 52us) server_negotiation.cc:299] Negotiation successful
0805 22:47:21.719846 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":93,"threads_started":1}
Aug 05 22:47:21 dist-test-slave-gjrz krb5kdc[20176](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970041, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:47:21.727602 20292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:21.721113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45698 (local address 127.14.224.190:34881)
0805 22:47:21.721201 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:21.721203 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:21.721210 (+ 7us) server_negotiation.cc:407] Connection header received
0805 22:47:21.721234 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:21.721235 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:21.721246 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:21.721295 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:21.721730 (+ 435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:21.722252 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:21.722900 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:21.723102 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:21.723158 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:21.725264 (+ 2106us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:21.725266 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:21.725267 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:21.725276 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:21.726442 (+ 1166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:21.726761 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:21.726762 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:21.726763 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:21.726818 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:21.727004 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:21.727005 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:21.727006 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:21.727166 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:21.727255 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:21.727421 (+ 166us) server_negotiation.cc:299] Negotiation successful
0805 22:47:21.727505 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
W20260805 22:47:21.727842 20236 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45698
I20260805 22:47:21.728163 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 20334
I20260805 22:47:21.741209 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 20524
I20260805 22:47:21.750741 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 20722
I20260805 22:47:21.769124 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 20191
2026-08-05T22:47:21Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2005 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:47:21 dist-test-slave-gjrz krb5kdc[20924](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:47:21 dist-test-slave-gjrz krb5kdc[20924](info): set up 2 sockets
Aug 05 22:47:21 dist-test-slave-gjrz krb5kdc[20924](info): commencing operation
krb5kdc: starting...
W20260805 22:47:22.902797 15234 mini_kdc.cc:121] Time spent starting KDC: real 1.109s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Aug 05 22:47:22 dist-test-slave-gjrz krb5kdc[20924](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970042, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:47:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:47:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.224.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab.
Entry for principal kudu/127.14.224.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab.
I20260805 22:47:23.031219 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:43409
--webserver_interface=127.14.224.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:37617
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.224.190:43409
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:47:23.115819 20949 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:23.116088 20949 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:23.116128 20949 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:23.117467 20949 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:47:23.117528 20949 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:23.117548 20949 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:23.117565 20949 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:47:23.117580 20949 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:47:23.119366 20949 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:37617
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.224.190:43409
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:43409
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.224.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20949
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:23.119664 20949 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:23.119901 20949 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:23.125026 20954 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:23.125170 20949 server_base.cc:1034] running on GCE node
W20260805 22:47:23.125051 20958 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:23.125064 20956 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:23.125559 20949 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:23.125859 20949 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:23.127005 20949 hybrid_clock.cc:648] HybridClock initialized: now 1785970043126985 us; error 37 us; skew 500 ppm
Aug 05 22:47:23 dist-test-slave-gjrz krb5kdc[20924](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970043, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:23.132881 20949 init.cc:377] Logged in from keytab as kudu/127.14.224.190@KRBTEST.COM (short username kudu)
I20260805 22:47:23.133279 20949 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:23.133329 20949 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:23.133455 20949 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:23.134591 20949 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/minicluster-data/master-0/data/instance:
uuid: "3ac1d095cf2c4d0ebde67e14b8814085"
format_stamp: "Formatted at 2026-08-05 22:47:23 on dist-test-slave-gjrz"
server_key: "9f2e5e0d3a12fcb1cf1c341b74413b20"
server_key_iv: "edc2f043636ac9f9d9e25e1943e9fe8a"
server_key_version: "encryptionkey@0"
I20260805 22:47:23.134945 20949 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/minicluster-data/master-0/wal/instance:
uuid: "3ac1d095cf2c4d0ebde67e14b8814085"
format_stamp: "Formatted at 2026-08-05 22:47:23 on dist-test-slave-gjrz"
server_key: "9f2e5e0d3a12fcb1cf1c341b74413b20"
server_key_iv: "edc2f043636ac9f9d9e25e1943e9fe8a"
server_key_version: "encryptionkey@0"
I20260805 22:47:23.136381 20949 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260805 22:47:23.137178 20967 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:23.137339 20949 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260805 22:47:23.137429 20949 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/minicluster-data/master-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/minicluster-data/master-0/wal
uuid: "3ac1d095cf2c4d0ebde67e14b8814085"
format_stamp: "Formatted at 2026-08-05 22:47:23 on dist-test-slave-gjrz"
server_key: "9f2e5e0d3a12fcb1cf1c341b74413b20"
server_key_iv: "edc2f043636ac9f9d9e25e1943e9fe8a"
server_key_version: "encryptionkey@0"
I20260805 22:47:23.137504 20949 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:23.147176 20949 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:23.149343 20949 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:23.149474 20949 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:23.153512 20949 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.190:43409
I20260805 22:47:23.153548 21046 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.190:43409 every 8 connection(s)
I20260805 22:47:23.153849 20949 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
I20260805 22:47:23.155015 21050 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:23.157071 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 20949
I20260805 22:47:23.157186 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/minicluster-data/master-0/wal/instance
I20260805 22:47:23.157346 15234 external_mini_cluster.cc:1428] Setting key b50474271038d69be5361e315e6b110a
I20260805 22:47:23.157766 21050 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ac1d095cf2c4d0ebde67e14b8814085: Bootstrap starting.
I20260805 22:47:23.158473 21050 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3ac1d095cf2c4d0ebde67e14b8814085: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:23.158747 21050 log.cc:824] T 00000000000000000000000000000000 P 3ac1d095cf2c4d0ebde67e14b8814085: Log is configured to *not* fsync() on all Append() calls
I20260805 22:47:23.159479 21050 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ac1d095cf2c4d0ebde67e14b8814085: No bootstrap required, opened a new log
I20260805 22:47:23.161238 21050 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3ac1d095cf2c4d0ebde67e14b8814085 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ac1d095cf2c4d0ebde67e14b8814085" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 43409 } }
I20260805 22:47:23.161387 21050 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3ac1d095cf2c4d0ebde67e14b8814085 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:23.161419 21050 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3ac1d095cf2c4d0ebde67e14b8814085 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ac1d095cf2c4d0ebde67e14b8814085, State: Initialized, Role: FOLLOWER
I20260805 22:47:23.161557 21050 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3ac1d095cf2c4d0ebde67e14b8814085 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ac1d095cf2c4d0ebde67e14b8814085" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 43409 } }
I20260805 22:47:23.161633 21050 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3ac1d095cf2c4d0ebde67e14b8814085 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:47:23.161674 21050 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3ac1d095cf2c4d0ebde67e14b8814085 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:47:23.161746 21050 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3ac1d095cf2c4d0ebde67e14b8814085 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:23.162513 21050 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3ac1d095cf2c4d0ebde67e14b8814085 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ac1d095cf2c4d0ebde67e14b8814085" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 43409 } }
I20260805 22:47:23.162637 21050 leader_election.cc:302] T 00000000000000000000000000000000 P 3ac1d095cf2c4d0ebde67e14b8814085 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3ac1d095cf2c4d0ebde67e14b8814085; no voters:
I20260805 22:47:23.162827 21050 leader_election.cc:288] T 00000000000000000000000000000000 P 3ac1d095cf2c4d0ebde67e14b8814085 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:47:23.162868 21056 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3ac1d095cf2c4d0ebde67e14b8814085 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:47:23.163040 21056 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3ac1d095cf2c4d0ebde67e14b8814085 [term 1 LEADER]: Becoming Leader. State: Replica: 3ac1d095cf2c4d0ebde67e14b8814085, State: Running, Role: LEADER
I20260805 22:47:23.163108 21050 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3ac1d095cf2c4d0ebde67e14b8814085 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:47:23.163180 21056 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3ac1d095cf2c4d0ebde67e14b8814085 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ac1d095cf2c4d0ebde67e14b8814085" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 43409 } }
I20260805 22:47:23.163599 21056 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ac1d095cf2c4d0ebde67e14b8814085 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3ac1d095cf2c4d0ebde67e14b8814085. Latest consensus state: current_term: 1 leader_uuid: "3ac1d095cf2c4d0ebde67e14b8814085" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ac1d095cf2c4d0ebde67e14b8814085" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 43409 } } }
I20260805 22:47:23.163669 21056 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ac1d095cf2c4d0ebde67e14b8814085 [sys.catalog]: This master's current role is: LEADER
I20260805 22:47:23.163889 21064 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Aug 05 22:47:23 dist-test-slave-gjrz krb5kdc[20924](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970042, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:47:23.164461 21058 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ac1d095cf2c4d0ebde67e14b8814085 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3ac1d095cf2c4d0ebde67e14b8814085" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ac1d095cf2c4d0ebde67e14b8814085" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 43409 } } }
I20260805 22:47:23.164597 21058 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ac1d095cf2c4d0ebde67e14b8814085 [sys.catalog]: This master's current role is: LEADER
I20260805 22:47:23.164645 21064 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:47:23.166272 21064 catalog_manager.cc:1347] Generated new cluster ID: 13061f314e854c3aae275344ea19743d
I20260805 22:47:23.166329 21064 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:47:23.168908 21054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:23.157894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51280 (local address 127.14.224.190:43409)
0805 22:47:23.158093 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:23.158101 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:23.158127 (+ 26us) server_negotiation.cc:407] Connection header received
0805 22:47:23.158599 (+ 472us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:23.158609 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:23.158674 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:23.158805 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:23.159481 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:23.160398 (+ 917us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:23.161149 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:23.161651 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:23.161754 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:23.164688 (+ 2934us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:23.164692 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:23.164693 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:23.164707 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:23.166908 (+ 2201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:23.167450 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:23.167454 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:23.167454 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:23.167569 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:23.167762 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:23.167762 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:23.167763 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:23.168106 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:23.168263 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:23.168535 (+ 272us) server_negotiation.cc:299] Negotiation successful
0805 22:47:23.168685 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":102,"threads_started":1}
I20260805 22:47:23.172380 21064 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:47:23.172907 21064 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:47:23.181313 21064 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3ac1d095cf2c4d0ebde67e14b8814085: Generated new TSK 0
I20260805 22:47:23.181514 21064 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.224.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab.
Entry for principal kudu/127.14.224.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab.
I20260805 22:47:23.214396 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.129:0
--local_ip_for_outbound_sockets=127.14.224.129
--webserver_interface=127.14.224.129
--webserver_port=0
--tserver_master_addrs=127.14.224.190:43409
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab
--principal=kudu/127.14.224.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:37617
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:47:23.298122 21082 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:23.298354 21082 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:23.298380 21082 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:23.299636 21082 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:23.299688 21082 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:23.299717 21082 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.129
I20260805 22:47:23.301260 21082 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:37617
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab
--principal=kudu/127.14.224.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.224.129
--webserver_port=0
--tserver_master_addrs=127.14.224.190:43409
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21082
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.129
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:23.301505 21082 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:23.301728 21082 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:23.306830 21094 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:23.306813 21092 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:23.306826 21091 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:23.307116 21082 server_base.cc:1034] running on GCE node
I20260805 22:47:23.307369 21082 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:23.307603 21082 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:23.308744 21082 hybrid_clock.cc:648] HybridClock initialized: now 1785970043308728 us; error 30 us; skew 500 ppm
Aug 05 22:47:23 dist-test-slave-gjrz krb5kdc[20924](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970043, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:23.311348 21082 init.cc:377] Logged in from keytab as kudu/127.14.224.129@KRBTEST.COM (short username kudu)
I20260805 22:47:23.311784 21082 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:23.311849 21082 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:23.311960 21082 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:23.313058 21082 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/minicluster-data/ts-0/data/instance:
uuid: "edb08a48db7e453185f529862d636d69"
format_stamp: "Formatted at 2026-08-05 22:47:23 on dist-test-slave-gjrz"
server_key: "a8efc110b505e6545466846f537e71f8"
server_key_iv: "a374cbb668a7dbdbf367903f6bed5c45"
server_key_version: "encryptionkey@0"
I20260805 22:47:23.313458 21082 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/minicluster-data/ts-0/wal/instance:
uuid: "edb08a48db7e453185f529862d636d69"
format_stamp: "Formatted at 2026-08-05 22:47:23 on dist-test-slave-gjrz"
server_key: "a8efc110b505e6545466846f537e71f8"
server_key_iv: "a374cbb668a7dbdbf367903f6bed5c45"
server_key_version: "encryptionkey@0"
I20260805 22:47:23.314785 21082 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260805 22:47:23.315598 21101 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:23.315828 21082 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:47:23.315915 21082 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/minicluster-data/ts-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/minicluster-data/ts-0/wal
uuid: "edb08a48db7e453185f529862d636d69"
format_stamp: "Formatted at 2026-08-05 22:47:23 on dist-test-slave-gjrz"
server_key: "a8efc110b505e6545466846f537e71f8"
server_key_iv: "a374cbb668a7dbdbf367903f6bed5c45"
server_key_version: "encryptionkey@0"
I20260805 22:47:23.315992 21082 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:23.338052 21082 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:23.340234 21082 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:23.340376 21082 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:23.340622 21082 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:47:23.340953 21082 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:47:23.340987 21082 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:23.341010 21082 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:47:23.341041 21082 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:23.347221 21082 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.129:45133
I20260805 22:47:23.347254 21272 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.129:45133 every 8 connection(s)
I20260805 22:47:23.347612 21082 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
I20260805 22:47:23.350497 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 21082
I20260805 22:47:23.350620 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/minicluster-data/ts-0/wal/instance
I20260805 22:47:23.350806 15234 external_mini_cluster.cc:1428] Setting key 82c5eb3a9f2fcc7e7e4cae4579545bd2
Aug 05 22:47:23 dist-test-slave-gjrz krb5kdc[20924](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970043, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.129@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:47:23.357870 21054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:23.348509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.129:51785 (local address 127.14.224.190:43409)
0805 22:47:23.348580 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:23.348582 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:23.348737 (+ 155us) server_negotiation.cc:407] Connection header received
0805 22:47:23.349257 (+ 520us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:23.349258 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:23.349269 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:23.349322 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:23.350382 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:23.351010 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:23.352162 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:23.352380 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:23.352441 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:23.354828 (+ 2387us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:23.354830 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:23.354830 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:23.354839 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:23.356427 (+ 1588us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:23.356864 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:23.356865 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:23.356866 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:23.356943 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:23.357174 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:23.357175 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:23.357175 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:23.357332 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:23.357408 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:23.357670 (+ 262us) server_negotiation.cc:299] Negotiation successful
0805 22:47:23.357771 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260805 22:47:23.357954 21280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:23.348404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:43409 (local address 127.14.224.129:51785)
0805 22:47:23.348608 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:23.348650 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:23.349148 (+ 498us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:23.349400 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:23.349404 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:23.349699 (+ 295us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:23.350246 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:23.350253 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:23.351116 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:23.351117 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:23.352068 (+ 951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:23.352072 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:23.352472 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:23.352472 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:23.352600 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:23.353129 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:23.353141 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:23.354722 (+ 1581us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:23.356521 (+ 1799us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:23.356529 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:23.356532 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:23.356788 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:23.357005 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:23.357006 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:23.357006 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:23.357116 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:23.357394 (+ 278us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:23.357398 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:23.357531 (+ 133us) client_negotiation.cc:769] Sending connection context
0805 22:47:23.357630 (+ 99us) client_negotiation.cc:240] Negotiation successful
0805 22:47:23.357771 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":99,"threads_started":1}
I20260805 22:47:23.358572 21275 heartbeater.cc:347] Connected to a master server at 127.14.224.190:43409
I20260805 22:47:23.358693 21275 heartbeater.cc:464] Registering TS with master...
I20260805 22:47:23.358876 21275 heartbeater.cc:511] Master 127.14.224.190:43409 requested a full tablet report, sending...
I20260805 22:47:23.359496 20996 ts_manager.cc:194] Registered new tserver with Master: edb08a48db7e453185f529862d636d69 (127.14.224.129:45133)
WARNING: no policy specified for kudu/127.14.224.130@KRBTEST.COM; defaulting to no policy
I20260805 22:47:23.360126 20996 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.224.129@KRBTEST.COM'} at 127.14.224.129:51785
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab.
Entry for principal kudu/127.14.224.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab.
I20260805 22:47:23.380347 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.130:0
--local_ip_for_outbound_sockets=127.14.224.130
--webserver_interface=127.14.224.130
--webserver_port=0
--tserver_master_addrs=127.14.224.190:43409
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab
--principal=kudu/127.14.224.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:37617
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:47:23.462956 21283 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:23.463223 21283 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:23.463253 21283 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:23.464632 21283 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:23.464684 21283 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:23.464713 21283 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.130
I20260805 22:47:23.466331 21283 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:37617
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab
--principal=kudu/127.14.224.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.224.130
--webserver_port=0
--tserver_master_addrs=127.14.224.190:43409
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21283
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.130
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:23.466552 21283 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:23.466753 21283 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260805 22:47:23.472029 21283 server_base.cc:1034] running on GCE node
W20260805 22:47:23.471993 21290 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:23.471999 21291 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:23.471969 21293 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:23.472384 21283 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:23.472638 21283 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:23.473798 21283 hybrid_clock.cc:648] HybridClock initialized: now 1785970043473781 us; error 32 us; skew 500 ppm
Aug 05 22:47:23 dist-test-slave-gjrz krb5kdc[20924](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970043, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:23.476473 21283 init.cc:377] Logged in from keytab as kudu/127.14.224.130@KRBTEST.COM (short username kudu)
I20260805 22:47:23.476861 21283 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:23.476920 21283 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:23.477049 21283 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:23.478124 21283 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/minicluster-data/ts-1/data/instance:
uuid: "5507cd8d4f0f4f87ad1ab5dcf9d112f0"
format_stamp: "Formatted at 2026-08-05 22:47:23 on dist-test-slave-gjrz"
server_key: "6527e545e324ca5c9a7bf66bb1439963"
server_key_iv: "1c5e4c94ddca1ec8d1bfe9e4956886cc"
server_key_version: "encryptionkey@0"
I20260805 22:47:23.478464 21283 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/minicluster-data/ts-1/wal/instance:
uuid: "5507cd8d4f0f4f87ad1ab5dcf9d112f0"
format_stamp: "Formatted at 2026-08-05 22:47:23 on dist-test-slave-gjrz"
server_key: "6527e545e324ca5c9a7bf66bb1439963"
server_key_iv: "1c5e4c94ddca1ec8d1bfe9e4956886cc"
server_key_version: "encryptionkey@0"
I20260805 22:47:23.479794 21283 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260805 22:47:23.480494 21304 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:23.480644 21283 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260805 22:47:23.480729 21283 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/minicluster-data/ts-1/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/minicluster-data/ts-1/wal
uuid: "5507cd8d4f0f4f87ad1ab5dcf9d112f0"
format_stamp: "Formatted at 2026-08-05 22:47:23 on dist-test-slave-gjrz"
server_key: "6527e545e324ca5c9a7bf66bb1439963"
server_key_iv: "1c5e4c94ddca1ec8d1bfe9e4956886cc"
server_key_version: "encryptionkey@0"
I20260805 22:47:23.480792 21283 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:23.498488 21283 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:23.500809 21283 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:23.500924 21283 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:23.501132 21283 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:47:23.501435 21283 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:47:23.501469 21283 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:23.501509 21283 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:47:23.501533 21283 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:23.507283 21283 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.130:42407
I20260805 22:47:23.507325 21474 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.130:42407 every 8 connection(s)
I20260805 22:47:23.507606 21283 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
Aug 05 22:47:23 dist-test-slave-gjrz krb5kdc[20924](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970043, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.130@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:47:23.516320 21054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:23.508283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:46821 (local address 127.14.224.190:43409)
0805 22:47:23.508362 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:23.508365 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:23.508521 (+ 156us) server_negotiation.cc:407] Connection header received
0805 22:47:23.508990 (+ 469us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:23.508991 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:23.509001 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:23.509053 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:23.509988 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:23.510491 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:23.511556 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:23.511746 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:23.511807 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:23.513910 (+ 2103us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:23.513911 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:23.513912 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:23.513920 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:23.515100 (+ 1180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:23.515519 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:23.515520 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:23.515520 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:23.515583 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:23.515780 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:23.515781 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:23.515781 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:23.515896 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:23.515941 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:23.516181 (+ 240us) server_negotiation.cc:299] Negotiation successful
0805 22:47:23.516250 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260805 22:47:23.516419 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 21283
I20260805 22:47:23.516522 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/minicluster-data/ts-1/wal/instance
I20260805 22:47:23.516571 21477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:23.508254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:43409 (local address 127.14.224.130:46821)
0805 22:47:23.508405 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:23.508443 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:23.508914 (+ 471us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:23.509124 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:23.509128 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:23.509394 (+ 266us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:23.509896 (+ 502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:23.509901 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:23.510571 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:23.510572 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:23.511456 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:23.511460 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:23.511820 (+ 360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:23.511821 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:23.511923 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:23.512434 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:23.512443 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:23.513813 (+ 1370us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:23.515186 (+ 1373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:23.515192 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:23.515194 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:23.515449 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:23.515644 (+ 195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:23.515645 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:23.515645 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:23.515742 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:23.515938 (+ 196us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:23.515941 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:23.516079 (+ 138us) client_negotiation.cc:769] Sending connection context
0805 22:47:23.516163 (+ 84us) client_negotiation.cc:240] Negotiation successful
0805 22:47:23.516323 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":78,"threads_started":1}
I20260805 22:47:23.516749 15234 external_mini_cluster.cc:1428] Setting key 4f0dcf6fc90ee076b051dc419b69b349
I20260805 22:47:23.517095 21475 heartbeater.cc:347] Connected to a master server at 127.14.224.190:43409
I20260805 22:47:23.517185 21475 heartbeater.cc:464] Registering TS with master...
I20260805 22:47:23.517346 21475 heartbeater.cc:511] Master 127.14.224.190:43409 requested a full tablet report, sending...
I20260805 22:47:23.517745 20996 ts_manager.cc:194] Registered new tserver with Master: 5507cd8d4f0f4f87ad1ab5dcf9d112f0 (127.14.224.130:42407)
I20260805 22:47:23.518113 20996 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.224.130@KRBTEST.COM'} at 127.14.224.130:46821
WARNING: no policy specified for kudu/127.14.224.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab.
Entry for principal kudu/127.14.224.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab.
I20260805 22:47:23.545872 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.131:0
--local_ip_for_outbound_sockets=127.14.224.131
--webserver_interface=127.14.224.131
--webserver_port=0
--tserver_master_addrs=127.14.224.190:43409
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab
--principal=kudu/127.14.224.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:37617
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:47:23.628734 21481 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:23.628978 21481 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:23.629005 21481 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:23.630398 21481 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:23.630451 21481 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:23.630481 21481 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.131
I20260805 22:47:23.632236 21481 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:37617
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab
--principal=kudu/127.14.224.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.224.131
--webserver_port=0
--tserver_master_addrs=127.14.224.190:43409
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21481
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.131
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:23.632472 21481 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:23.632676 21481 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:23.637691 21490 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:23.637701 21491 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:23.637774 21481 server_base.cc:1034] running on GCE node
W20260805 22:47:23.637787 21493 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:23.638154 21481 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:23.638415 21481 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:23.639564 21481 hybrid_clock.cc:648] HybridClock initialized: now 1785970043639547 us; error 30 us; skew 500 ppm
Aug 05 22:47:23 dist-test-slave-gjrz krb5kdc[20924](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970043, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:23.642249 21481 init.cc:377] Logged in from keytab as kudu/127.14.224.131@KRBTEST.COM (short username kudu)
I20260805 22:47:23.642596 21481 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:23.642650 21481 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:23.642781 21481 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:23.643890 21481 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/minicluster-data/ts-2/data/instance:
uuid: "d8ad65c86c924275a5cb447b77e2f643"
format_stamp: "Formatted at 2026-08-05 22:47:23 on dist-test-slave-gjrz"
server_key: "e95086f4dcdf1ae6f350ae90099ece08"
server_key_iv: "4881a0ced55f000d6baaaff9a3b67288"
server_key_version: "encryptionkey@0"
I20260805 22:47:23.644241 21481 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/minicluster-data/ts-2/wal/instance:
uuid: "d8ad65c86c924275a5cb447b77e2f643"
format_stamp: "Formatted at 2026-08-05 22:47:23 on dist-test-slave-gjrz"
server_key: "e95086f4dcdf1ae6f350ae90099ece08"
server_key_iv: "4881a0ced55f000d6baaaff9a3b67288"
server_key_version: "encryptionkey@0"
I20260805 22:47:23.645485 21481 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260805 22:47:23.646260 21500 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:23.646417 21481 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:47:23.646508 21481 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/minicluster-data/ts-2/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/minicluster-data/ts-2/wal
uuid: "d8ad65c86c924275a5cb447b77e2f643"
format_stamp: "Formatted at 2026-08-05 22:47:23 on dist-test-slave-gjrz"
server_key: "e95086f4dcdf1ae6f350ae90099ece08"
server_key_iv: "4881a0ced55f000d6baaaff9a3b67288"
server_key_version: "encryptionkey@0"
I20260805 22:47:23.646572 21481 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:23.657460 21481 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:23.659768 21481 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:23.659917 21481 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:23.660158 21481 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:47:23.660481 21481 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:47:23.660518 21481 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:23.660549 21481 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:47:23.660567 21481 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:23.666659 21481 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.131:36853
I20260805 22:47:23.666702 21673 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.131:36853 every 8 connection(s)
I20260805 22:47:23.666980 21481 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
I20260805 22:47:23.671669 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 21481
I20260805 22:47:23.672050 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/minicluster-data/ts-2/wal/instance
I20260805 22:47:23.672300 15234 external_mini_cluster.cc:1428] Setting key c37aacdef6f530ccd97a84ba23b4e422
Aug 05 22:47:23 dist-test-slave-gjrz krb5kdc[20924](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970043, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.131@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:47:23.676002 21054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:23.667744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:38507 (local address 127.14.224.190:43409)
0805 22:47:23.667823 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:23.667826 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:23.668001 (+ 175us) server_negotiation.cc:407] Connection header received
0805 22:47:23.668586 (+ 585us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:23.668588 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:23.668599 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:23.668655 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:23.669608 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:23.670128 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:23.671095 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:23.671326 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:23.671391 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:23.673787 (+ 2396us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:23.673788 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:23.673789 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:23.673797 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:23.674857 (+ 1060us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:23.675213 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:23.675214 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:23.675214 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:23.675289 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:23.675488 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:23.675488 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:23.675489 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:23.675597 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:23.675645 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:23.675871 (+ 226us) server_negotiation.cc:299] Negotiation successful
0805 22:47:23.675933 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260805 22:47:23.676208 21680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:23.667715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:43409 (local address 127.14.224.131:38507)
0805 22:47:23.667880 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:23.667920 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:23.668470 (+ 550us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:23.668714 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:23.668718 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:23.668987 (+ 269us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:23.669497 (+ 510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:23.669503 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:23.670205 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:23.670205 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:23.671006 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:23.671008 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:23.671402 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:23.671403 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:23.671535 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:23.672109 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:23.672121 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:23.673702 (+ 1581us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:23.674924 (+ 1222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:23.674930 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:23.674932 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:23.675156 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:23.675340 (+ 184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:23.675341 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:23.675341 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:23.675442 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:23.675642 (+ 200us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:23.675645 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:23.675768 (+ 123us) client_negotiation.cc:769] Sending connection context
0805 22:47:23.675852 (+ 84us) client_negotiation.cc:240] Negotiation successful
0805 22:47:23.675979 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":85,"threads_started":1}
I20260805 22:47:23.676687 21677 heartbeater.cc:347] Connected to a master server at 127.14.224.190:43409
I20260805 22:47:23.676785 21677 heartbeater.cc:464] Registering TS with master...
I20260805 22:47:23.676942 21677 heartbeater.cc:511] Master 127.14.224.190:43409 requested a full tablet report, sending...
I20260805 22:47:23.677323 20996 ts_manager.cc:194] Registered new tserver with Master: d8ad65c86c924275a5cb447b77e2f643 (127.14.224.131:36853)
I20260805 22:47:23.677697 20996 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.224.131@KRBTEST.COM'} at 127.14.224.131:38507
I20260805 22:47:23.684208 15234 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 22:47:23.691061 21054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:23.685589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51296 (local address 127.14.224.190:43409)
0805 22:47:23.685658 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:23.685660 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:23.685708 (+ 48us) server_negotiation.cc:407] Connection header received
0805 22:47:23.685775 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:23.685775 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:23.685785 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:23.685831 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:23.686388 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:23.686884 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:23.687670 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:23.687863 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:23.687931 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:23.689075 (+ 1144us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:23.689077 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:23.689077 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:23.689084 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:23.690179 (+ 1095us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:23.690471 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:23.690472 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:23.690472 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:23.690518 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:23.690645 (+ 127us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:23.690645 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:23.690646 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:23.690788 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:23.690861 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:23.690928 (+ 67us) server_negotiation.cc:299] Negotiation successful
0805 22:47:23.690993 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260805 22:47:23.692689 20996 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51296:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:47:23.694218 20996 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:47:23.700464 21704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:23.696687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59142 (local address 127.14.224.131:36853)
0805 22:47:23.696979 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:23.696984 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:23.696994 (+ 10us) server_negotiation.cc:407] Connection header received
0805 22:47:23.697033 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:23.697047 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:23.697062 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:23.697134 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:47:23.697298 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:23.698098 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:23.699434 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:23.700076 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:23.700142 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:23.700201 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:23.700333 (+ 132us) server_negotiation.cc:299] Negotiation successful
0805 22:47:23.700373 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":250,"thread_start_us":110,"threads_started":1}
I20260805 22:47:23.700453 21701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:23.696479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.131:36853 (local address 127.0.0.1:59142)
0805 22:47:23.696619 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:23.696660 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:23.696727 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:23.697132 (+ 405us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:23.697132 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:23.697134 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:47:23.697216 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:23.697218 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:23.698182 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:23.698183 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:23.699358 (+ 1175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:23.699361 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:23.700149 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:23.700151 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:23.700232 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:23.700246 (+ 14us) client_negotiation.cc:769] Sending connection context
0805 22:47:23.700312 (+ 66us) client_negotiation.cc:240] Negotiation successful
0805 22:47:23.700369 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"mutex_wait_us":1,"thread_start_us":92,"threads_started":1}
I20260805 22:47:23.700774 21702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:23.696480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.130:42407 (local address 127.0.0.1:55236)
0805 22:47:23.696886 (+ 406us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:23.696897 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:23.696954 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:23.697125 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:23.697128 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:23.697242 (+ 114us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:47:23.697292 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:23.697295 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:23.698589 (+ 1294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:23.698591 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:23.699609 (+ 1018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:23.699611 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:23.700543 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:23.700545 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:23.700607 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:23.700611 (+ 4us) client_negotiation.cc:769] Sending connection context
0805 22:47:23.700657 (+ 46us) client_negotiation.cc:240] Negotiation successful
0805 22:47:23.700698 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":384,"mutex_wait_us":27,"thread_start_us":119,"threads_started":1}
I20260805 22:47:23.700852 21703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:23.696480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.129:45133 (local address 127.0.0.1:57578)
0805 22:47:23.696944 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:23.696956 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:23.697010 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:23.697478 (+ 468us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:23.697479 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:23.697481 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:47:23.697532 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:23.697534 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:23.698736 (+ 1202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:23.698737 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:23.699740 (+ 1003us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:23.699743 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:23.700646 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:23.700647 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:23.700710 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:23.700713 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:47:23.700763 (+ 50us) client_negotiation.cc:240] Negotiation successful
0805 22:47:23.700798 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":441,"mutex_wait_us":8,"thread_start_us":88,"threads_started":1}
I20260805 22:47:23.701072 21705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:23.696770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55236 (local address 127.14.224.130:42407)
0805 22:47:23.696945 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:23.696950 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:23.696962 (+ 12us) server_negotiation.cc:407] Connection header received
0805 22:47:23.697020 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:23.697022 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:23.697038 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:23.697107 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:47:23.697370 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:23.698485 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:23.699681 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:23.700380 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:23.700454 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:23.700505 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:23.700953 (+ 448us) server_negotiation.cc:299] Negotiation successful
0805 22:47:23.701001 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":84,"threads_started":1}
I20260805 22:47:23.701437 21572 tablet_service.cc:1467] Processing CreateTablet for tablet 44233c3a47674948964d706ccec2299c (DEFAULT_TABLE table=test-table [id=f50344856bbe45e7bdbd920fda1e14b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:47:23.701650 21381 tablet_service.cc:1467] Processing CreateTablet for tablet 44233c3a47674948964d706ccec2299c (DEFAULT_TABLE table=test-table [id=f50344856bbe45e7bdbd920fda1e14b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:47:23.701835 21572 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 44233c3a47674948964d706ccec2299c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:23.702001 21381 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 44233c3a47674948964d706ccec2299c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:23.703449 21706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:23.696770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57578 (local address 127.14.224.129:45133)
0805 22:47:23.697269 (+ 499us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:23.697273 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:23.697282 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:47:23.697315 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:23.697317 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:23.697332 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:23.697396 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:47:23.697614 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:23.698645 (+ 1031us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:23.699820 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:23.700493 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:23.700565 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:23.700615 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:23.700795 (+ 180us) server_negotiation.cc:299] Negotiation successful
0805 22:47:23.703354 (+ 2559us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":465,"thread_start_us":92,"threads_started":1}
I20260805 22:47:23.704856 21707 tablet_bootstrap.cc:492] T 44233c3a47674948964d706ccec2299c P 5507cd8d4f0f4f87ad1ab5dcf9d112f0: Bootstrap starting.
I20260805 22:47:23.705214 21175 tablet_service.cc:1467] Processing CreateTablet for tablet 44233c3a47674948964d706ccec2299c (DEFAULT_TABLE table=test-table [id=f50344856bbe45e7bdbd920fda1e14b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:47:23.705415 21707 tablet_bootstrap.cc:654] T 44233c3a47674948964d706ccec2299c P 5507cd8d4f0f4f87ad1ab5dcf9d112f0: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:23.705541 21175 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 44233c3a47674948964d706ccec2299c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:23.705864 21707 log.cc:824] T 44233c3a47674948964d706ccec2299c P 5507cd8d4f0f4f87ad1ab5dcf9d112f0: Log is configured to *not* fsync() on all Append() calls
I20260805 22:47:23.706189 21708 tablet_bootstrap.cc:492] T 44233c3a47674948964d706ccec2299c P d8ad65c86c924275a5cb447b77e2f643: Bootstrap starting.
I20260805 22:47:23.706625 21707 tablet_bootstrap.cc:492] T 44233c3a47674948964d706ccec2299c P 5507cd8d4f0f4f87ad1ab5dcf9d112f0: No bootstrap required, opened a new log
I20260805 22:47:23.706699 21707 ts_tablet_manager.cc:1397] T 44233c3a47674948964d706ccec2299c P 5507cd8d4f0f4f87ad1ab5dcf9d112f0: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260805 22:47:23.706843 21708 tablet_bootstrap.cc:654] T 44233c3a47674948964d706ccec2299c P d8ad65c86c924275a5cb447b77e2f643: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:23.707442 21708 log.cc:824] T 44233c3a47674948964d706ccec2299c P d8ad65c86c924275a5cb447b77e2f643: Log is configured to *not* fsync() on all Append() calls
I20260805 22:47:23.708276 21708 tablet_bootstrap.cc:492] T 44233c3a47674948964d706ccec2299c P d8ad65c86c924275a5cb447b77e2f643: No bootstrap required, opened a new log
I20260805 22:47:23.708353 21708 ts_tablet_manager.cc:1397] T 44233c3a47674948964d706ccec2299c P d8ad65c86c924275a5cb447b77e2f643: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260805 22:47:23.708448 21712 tablet_bootstrap.cc:492] T 44233c3a47674948964d706ccec2299c P edb08a48db7e453185f529862d636d69: Bootstrap starting.
I20260805 22:47:23.708709 21707 raft_consensus.cc:348] T 44233c3a47674948964d706ccec2299c P 5507cd8d4f0f4f87ad1ab5dcf9d112f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ad65c86c924275a5cb447b77e2f643" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 36853 } } peers { permanent_uuid: "edb08a48db7e453185f529862d636d69" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 45133 } } peers { permanent_uuid: "5507cd8d4f0f4f87ad1ab5dcf9d112f0" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 42407 } }
I20260805 22:47:23.708894 21707 raft_consensus.cc:374] T 44233c3a47674948964d706ccec2299c P 5507cd8d4f0f4f87ad1ab5dcf9d112f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:23.708932 21707 raft_consensus.cc:729] T 44233c3a47674948964d706ccec2299c P 5507cd8d4f0f4f87ad1ab5dcf9d112f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5507cd8d4f0f4f87ad1ab5dcf9d112f0, State: Initialized, Role: FOLLOWER
I20260805 22:47:23.709115 21712 tablet_bootstrap.cc:654] T 44233c3a47674948964d706ccec2299c P edb08a48db7e453185f529862d636d69: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:23.709081 21707 consensus_queue.cc:260] T 44233c3a47674948964d706ccec2299c P 5507cd8d4f0f4f87ad1ab5dcf9d112f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ad65c86c924275a5cb447b77e2f643" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 36853 } } peers { permanent_uuid: "edb08a48db7e453185f529862d636d69" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 45133 } } peers { permanent_uuid: "5507cd8d4f0f4f87ad1ab5dcf9d112f0" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 42407 } }
I20260805 22:47:23.709350 21707 ts_tablet_manager.cc:1428] T 44233c3a47674948964d706ccec2299c P 5507cd8d4f0f4f87ad1ab5dcf9d112f0: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260805 22:47:23.709514 21475 heartbeater.cc:503] Master 127.14.224.190:43409 was elected leader, sending a full tablet report...
I20260805 22:47:23.709656 21712 log.cc:824] T 44233c3a47674948964d706ccec2299c P edb08a48db7e453185f529862d636d69: Log is configured to *not* fsync() on all Append() calls
I20260805 22:47:23.710247 21708 raft_consensus.cc:348] T 44233c3a47674948964d706ccec2299c P d8ad65c86c924275a5cb447b77e2f643 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ad65c86c924275a5cb447b77e2f643" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 36853 } } peers { permanent_uuid: "edb08a48db7e453185f529862d636d69" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 45133 } } peers { permanent_uuid: "5507cd8d4f0f4f87ad1ab5dcf9d112f0" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 42407 } }
I20260805 22:47:23.710415 21708 raft_consensus.cc:374] T 44233c3a47674948964d706ccec2299c P d8ad65c86c924275a5cb447b77e2f643 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:23.710456 21708 raft_consensus.cc:729] T 44233c3a47674948964d706ccec2299c P d8ad65c86c924275a5cb447b77e2f643 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8ad65c86c924275a5cb447b77e2f643, State: Initialized, Role: FOLLOWER
I20260805 22:47:23.710461 21712 tablet_bootstrap.cc:492] T 44233c3a47674948964d706ccec2299c P edb08a48db7e453185f529862d636d69: No bootstrap required, opened a new log
I20260805 22:47:23.710520 21712 ts_tablet_manager.cc:1397] T 44233c3a47674948964d706ccec2299c P edb08a48db7e453185f529862d636d69: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260805 22:47:23.710583 21708 consensus_queue.cc:260] T 44233c3a47674948964d706ccec2299c P d8ad65c86c924275a5cb447b77e2f643 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ad65c86c924275a5cb447b77e2f643" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 36853 } } peers { permanent_uuid: "edb08a48db7e453185f529862d636d69" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 45133 } } peers { permanent_uuid: "5507cd8d4f0f4f87ad1ab5dcf9d112f0" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 42407 } }
I20260805 22:47:23.710861 21708 ts_tablet_manager.cc:1428] T 44233c3a47674948964d706ccec2299c P d8ad65c86c924275a5cb447b77e2f643: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260805 22:47:23.711004 21677 heartbeater.cc:503] Master 127.14.224.190:43409 was elected leader, sending a full tablet report...
I20260805 22:47:23.712325 21712 raft_consensus.cc:348] T 44233c3a47674948964d706ccec2299c P edb08a48db7e453185f529862d636d69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ad65c86c924275a5cb447b77e2f643" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 36853 } } peers { permanent_uuid: "edb08a48db7e453185f529862d636d69" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 45133 } } peers { permanent_uuid: "5507cd8d4f0f4f87ad1ab5dcf9d112f0" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 42407 } }
I20260805 22:47:23.712459 21712 raft_consensus.cc:374] T 44233c3a47674948964d706ccec2299c P edb08a48db7e453185f529862d636d69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:23.712491 21712 raft_consensus.cc:729] T 44233c3a47674948964d706ccec2299c P edb08a48db7e453185f529862d636d69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edb08a48db7e453185f529862d636d69, State: Initialized, Role: FOLLOWER
I20260805 22:47:23.712607 21712 consensus_queue.cc:260] T 44233c3a47674948964d706ccec2299c P edb08a48db7e453185f529862d636d69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ad65c86c924275a5cb447b77e2f643" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 36853 } } peers { permanent_uuid: "edb08a48db7e453185f529862d636d69" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 45133 } } peers { permanent_uuid: "5507cd8d4f0f4f87ad1ab5dcf9d112f0" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 42407 } }
I20260805 22:47:23.712862 21712 ts_tablet_manager.cc:1428] T 44233c3a47674948964d706ccec2299c P edb08a48db7e453185f529862d636d69: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260805 22:47:23.712978 21275 heartbeater.cc:503] Master 127.14.224.190:43409 was elected leader, sending a full tablet report...
W20260805 22:47:23.758147 21476 tablet.cc:2369] T 44233c3a47674948964d706ccec2299c P 5507cd8d4f0f4f87ad1ab5dcf9d112f0: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260805 22:47:23.848415 21276 tablet.cc:2369] T 44233c3a47674948964d706ccec2299c P edb08a48db7e453185f529862d636d69: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:47:23.907739 21716 raft_consensus.cc:482] T 44233c3a47674948964d706ccec2299c P edb08a48db7e453185f529862d636d69 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:47:23.907876 21716 raft_consensus.cc:504] T 44233c3a47674948964d706ccec2299c P edb08a48db7e453185f529862d636d69 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ad65c86c924275a5cb447b77e2f643" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 36853 } } peers { permanent_uuid: "edb08a48db7e453185f529862d636d69" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 45133 } } peers { permanent_uuid: "5507cd8d4f0f4f87ad1ab5dcf9d112f0" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 42407 } }
I20260805 22:47:23.908241 21716 leader_election.cc:288] T 44233c3a47674948964d706ccec2299c P edb08a48db7e453185f529862d636d69 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8ad65c86c924275a5cb447b77e2f643 (127.14.224.131:36853), 5507cd8d4f0f4f87ad1ab5dcf9d112f0 (127.14.224.130:42407)
I20260805 22:47:23.912443 21704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:23.908544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.129:40507 (local address 127.14.224.131:36853)
0805 22:47:23.908600 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:23.908603 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:23.908658 (+ 55us) server_negotiation.cc:407] Connection header received
0805 22:47:23.908728 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:23.908729 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:23.908751 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:23.908816 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:47:23.909034 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:23.909774 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:23.911420 (+ 1646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:23.912063 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:23.912127 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:23.912134 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:23.912322 (+ 188us) server_negotiation.cc:299] Negotiation successful
0805 22:47:23.912363 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260805 22:47:23.912443 21705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:23.908550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.129:46137 (local address 127.14.224.130:42407)
0805 22:47:23.908600 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:23.908603 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:23.908660 (+ 57us) server_negotiation.cc:407] Connection header received
0805 22:47:23.908728 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:23.908729 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:23.908739 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:23.908811 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:47:23.909034 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:23.909812 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:23.911416 (+ 1604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:23.912027 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:23.912120 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:23.912131 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:23.912322 (+ 191us) server_negotiation.cc:299] Negotiation successful
0805 22:47:23.912363 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260805 22:47:23.912478 21719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:23.908453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.131:36853 (local address 127.14.224.129:40507)
0805 22:47:23.908589 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:23.908601 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:23.908669 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:23.908830 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:23.908831 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:23.908834 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:47:23.908912 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:23.908914 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:23.909875 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:23.909876 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:23.911314 (+ 1438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:23.911319 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:23.912149 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:23.912150 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:23.912226 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:23.912233 (+ 7us) client_negotiation.cc:769] Sending connection context
0805 22:47:23.912297 (+ 64us) client_negotiation.cc:240] Negotiation successful
0805 22:47:23.912358 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"mutex_wait_us":105,"thread_start_us":72,"threads_started":1}
I20260805 22:47:23.912479 21721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:23.908451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.130:42407 (local address 127.14.224.129:46137)
0805 22:47:23.908589 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:23.908601 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:23.908669 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:23.908830 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:23.908831 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:23.908833 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:47:23.908932 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:23.908933 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:23.909880 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:23.909880 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:23.911314 (+ 1434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:23.911319 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:23.912146 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:23.912148 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:23.912235 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:23.912237 (+ 2us) client_negotiation.cc:769] Sending connection context
0805 22:47:23.912297 (+ 60us) client_negotiation.cc:240] Negotiation successful
0805 22:47:23.912358 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"mutex_wait_us":96,"thread_start_us":60,"threads_started":1}
I20260805 22:47:23.912839 21604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44233c3a47674948964d706ccec2299c" candidate_uuid: "edb08a48db7e453185f529862d636d69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8ad65c86c924275a5cb447b77e2f643" is_pre_election: true
I20260805 22:47:23.912995 21412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44233c3a47674948964d706ccec2299c" candidate_uuid: "edb08a48db7e453185f529862d636d69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5507cd8d4f0f4f87ad1ab5dcf9d112f0" is_pre_election: true
I20260805 22:47:23.913056 21604 raft_consensus.cc:2454] T 44233c3a47674948964d706ccec2299c P d8ad65c86c924275a5cb447b77e2f643 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edb08a48db7e453185f529862d636d69 in term 0.
I20260805 22:47:23.913131 21412 raft_consensus.cc:2454] T 44233c3a47674948964d706ccec2299c P 5507cd8d4f0f4f87ad1ab5dcf9d112f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edb08a48db7e453185f529862d636d69 in term 0.
I20260805 22:47:23.913308 21104 leader_election.cc:302] T 44233c3a47674948964d706ccec2299c P edb08a48db7e453185f529862d636d69 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d8ad65c86c924275a5cb447b77e2f643, edb08a48db7e453185f529862d636d69; no voters:
I20260805 22:47:23.913461 21716 raft_consensus.cc:2781] T 44233c3a47674948964d706ccec2299c P edb08a48db7e453185f529862d636d69 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:47:23.913524 21716 raft_consensus.cc:482] T 44233c3a47674948964d706ccec2299c P edb08a48db7e453185f529862d636d69 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:47:23.913553 21716 raft_consensus.cc:3037] T 44233c3a47674948964d706ccec2299c P edb08a48db7e453185f529862d636d69 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:23.914203 21716 raft_consensus.cc:504] T 44233c3a47674948964d706ccec2299c P edb08a48db7e453185f529862d636d69 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ad65c86c924275a5cb447b77e2f643" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 36853 } } peers { permanent_uuid: "edb08a48db7e453185f529862d636d69" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 45133 } } peers { permanent_uuid: "5507cd8d4f0f4f87ad1ab5dcf9d112f0" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 42407 } }
I20260805 22:47:23.914333 21716 leader_election.cc:288] T 44233c3a47674948964d706ccec2299c P edb08a48db7e453185f529862d636d69 [CANDIDATE]: Term 1 election: Requested vote from peers d8ad65c86c924275a5cb447b77e2f643 (127.14.224.131:36853), 5507cd8d4f0f4f87ad1ab5dcf9d112f0 (127.14.224.130:42407)
I20260805 22:47:23.914518 21412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44233c3a47674948964d706ccec2299c" candidate_uuid: "edb08a48db7e453185f529862d636d69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5507cd8d4f0f4f87ad1ab5dcf9d112f0"
I20260805 22:47:23.914590 21604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44233c3a47674948964d706ccec2299c" candidate_uuid: "edb08a48db7e453185f529862d636d69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8ad65c86c924275a5cb447b77e2f643"
I20260805 22:47:23.914609 21412 raft_consensus.cc:3037] T 44233c3a47674948964d706ccec2299c P 5507cd8d4f0f4f87ad1ab5dcf9d112f0 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:23.914666 21604 raft_consensus.cc:3037] T 44233c3a47674948964d706ccec2299c P d8ad65c86c924275a5cb447b77e2f643 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:23.915563 21412 raft_consensus.cc:2454] T 44233c3a47674948964d706ccec2299c P 5507cd8d4f0f4f87ad1ab5dcf9d112f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edb08a48db7e453185f529862d636d69 in term 1.
I20260805 22:47:23.915563 21604 raft_consensus.cc:2454] T 44233c3a47674948964d706ccec2299c P d8ad65c86c924275a5cb447b77e2f643 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edb08a48db7e453185f529862d636d69 in term 1.
I20260805 22:47:23.915762 21104 leader_election.cc:302] T 44233c3a47674948964d706ccec2299c P edb08a48db7e453185f529862d636d69 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d8ad65c86c924275a5cb447b77e2f643, edb08a48db7e453185f529862d636d69; no voters:
I20260805 22:47:23.915889 21716 raft_consensus.cc:2781] T 44233c3a47674948964d706ccec2299c P edb08a48db7e453185f529862d636d69 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:47:23.916069 21716 raft_consensus.cc:686] T 44233c3a47674948964d706ccec2299c P edb08a48db7e453185f529862d636d69 [term 1 LEADER]: Becoming Leader. State: Replica: edb08a48db7e453185f529862d636d69, State: Running, Role: LEADER
I20260805 22:47:23.916172 21716 consensus_queue.cc:237] T 44233c3a47674948964d706ccec2299c P edb08a48db7e453185f529862d636d69 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ad65c86c924275a5cb447b77e2f643" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 36853 } } peers { permanent_uuid: "edb08a48db7e453185f529862d636d69" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 45133 } } peers { permanent_uuid: "5507cd8d4f0f4f87ad1ab5dcf9d112f0" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 42407 } }
I20260805 22:47:23.917019 20996 catalog_manager.cc:5495] T 44233c3a47674948964d706ccec2299c P edb08a48db7e453185f529862d636d69 reported cstate change: term changed from 0 to 1, leader changed from <none> to edb08a48db7e453185f529862d636d69 (127.14.224.129). New cstate: current_term: 1 leader_uuid: "edb08a48db7e453185f529862d636d69" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ad65c86c924275a5cb447b77e2f643" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 36853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edb08a48db7e453185f529862d636d69" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 45133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5507cd8d4f0f4f87ad1ab5dcf9d112f0" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 42407 } health_report { overall_health: UNKNOWN } } }
W20260805 22:47:23.917701 21679 tablet.cc:2369] T 44233c3a47674948964d706ccec2299c P d8ad65c86c924275a5cb447b77e2f643: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:47:23.927227 21706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:23.925186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57588 (local address 127.14.224.129:45133)
0805 22:47:23.925238 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:23.925240 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:23.925247 (+ 7us) server_negotiation.cc:407] Connection header received
0805 22:47:23.925280 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:23.925281 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:23.925299 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:23.925355 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:47:23.925453 (+ 98us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:23.925920 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:23.926603 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:23.926779 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:23.926822 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:23.926943 (+ 121us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:47:23.927063 (+ 120us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:47:23.927123 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:23.927135 (+ 12us) server_negotiation.cc:299] Negotiation successful
0805 22:47:23.927153 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260805 22:47:23.929095 21412 raft_consensus.cc:1261] T 44233c3a47674948964d706ccec2299c P 5507cd8d4f0f4f87ad1ab5dcf9d112f0 [term 1 FOLLOWER]: Refusing update from remote peer edb08a48db7e453185f529862d636d69: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:47:23.929138 21604 raft_consensus.cc:1261] T 44233c3a47674948964d706ccec2299c P d8ad65c86c924275a5cb447b77e2f643 [term 1 FOLLOWER]: Refusing update from remote peer edb08a48db7e453185f529862d636d69: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:47:23.929430 21716 consensus_queue.cc:1035] T 44233c3a47674948964d706ccec2299c P edb08a48db7e453185f529862d636d69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5507cd8d4f0f4f87ad1ab5dcf9d112f0" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 42407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:47:23.929658 21725 consensus_queue.cc:1035] T 44233c3a47674948964d706ccec2299c P edb08a48db7e453185f529862d636d69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8ad65c86c924275a5cb447b77e2f643" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 36853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:47:23.932322 21730 mvcc.cc:205] Tried to move back new op lower bound from 7315333299930898432 to 7315333299881275392. Current Snapshot: MvccSnapshot[applied={T|T < 7315333299930898432}]
I20260805 22:47:23.934358 20996 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51296:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:47:23.934468 20996 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51296:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:47:23.935197 20996 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3ac1d095cf2c4d0ebde67e14b8814085: Sending DeleteTablet for 3 replicas of tablet 44233c3a47674948964d706ccec2299c
I20260805 22:47:23.935540 21175 tablet_service.cc:1514] Processing DeleteTablet for tablet 44233c3a47674948964d706ccec2299c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:47:23 UTC) from {username='kudu', principal='kudu/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:57578
I20260805 22:47:23.935549 21572 tablet_service.cc:1514] Processing DeleteTablet for tablet 44233c3a47674948964d706ccec2299c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:47:23 UTC) from {username='kudu', principal='kudu/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:59142
I20260805 22:47:23.935788 21381 tablet_service.cc:1514] Processing DeleteTablet for tablet 44233c3a47674948964d706ccec2299c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:47:23 UTC) from {username='kudu', principal='kudu/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:55236
I20260805 22:47:23.935896 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 21082
I20260805 22:47:23.936043 21751 tablet_replica.cc:330] T 44233c3a47674948964d706ccec2299c P 5507cd8d4f0f4f87ad1ab5dcf9d112f0: stopping tablet replica
I20260805 22:47:23.936189 21751 raft_consensus.cc:2229] T 44233c3a47674948964d706ccec2299c P 5507cd8d4f0f4f87ad1ab5dcf9d112f0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:47:23.936404 21751 raft_consensus.cc:2258] T 44233c3a47674948964d706ccec2299c P 5507cd8d4f0f4f87ad1ab5dcf9d112f0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:47:23.938719 21751 ts_tablet_manager.cc:1905] T 44233c3a47674948964d706ccec2299c P 5507cd8d4f0f4f87ad1ab5dcf9d112f0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:47:23.940634 21749 tablet_replica.cc:330] T 44233c3a47674948964d706ccec2299c P d8ad65c86c924275a5cb447b77e2f643: stopping tablet replica
I20260805 22:47:23.940783 21749 raft_consensus.cc:2229] T 44233c3a47674948964d706ccec2299c P d8ad65c86c924275a5cb447b77e2f643 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:47:23.940937 21749 raft_consensus.cc:2258] T 44233c3a47674948964d706ccec2299c P d8ad65c86c924275a5cb447b77e2f643 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:47:23.942679 21749 ts_tablet_manager.cc:1905] T 44233c3a47674948964d706ccec2299c P d8ad65c86c924275a5cb447b77e2f643: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:47:23.942760 21751 ts_tablet_manager.cc:1918] T 44233c3a47674948964d706ccec2299c P 5507cd8d4f0f4f87ad1ab5dcf9d112f0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:47:23.942919 21751 log.cc:1196] T 44233c3a47674948964d706ccec2299c P 5507cd8d4f0f4f87ad1ab5dcf9d112f0: Deleting WAL directory at /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/minicluster-data/ts-1/wal/wals/44233c3a47674948964d706ccec2299c
I20260805 22:47:23.943363 21751 ts_tablet_manager.cc:1939] T 44233c3a47674948964d706ccec2299c P 5507cd8d4f0f4f87ad1ab5dcf9d112f0: Deleting consensus metadata
I20260805 22:47:23.944336 21749 ts_tablet_manager.cc:1918] T 44233c3a47674948964d706ccec2299c P d8ad65c86c924275a5cb447b77e2f643: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:47:23.944423 21749 log.cc:1196] T 44233c3a47674948964d706ccec2299c P d8ad65c86c924275a5cb447b77e2f643: Deleting WAL directory at /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970021300824-15234-0/minicluster-data/ts-2/wal/wals/44233c3a47674948964d706ccec2299c
I20260805 22:47:23.944516 20969 catalog_manager.cc:4841] TS 5507cd8d4f0f4f87ad1ab5dcf9d112f0 (127.14.224.130:42407): tablet 44233c3a47674948964d706ccec2299c (table test-table [id=f50344856bbe45e7bdbd920fda1e14b0]) successfully deleted
I20260805 22:47:23.944756 21749 ts_tablet_manager.cc:1939] T 44233c3a47674948964d706ccec2299c P d8ad65c86c924275a5cb447b77e2f643: Deleting consensus metadata
I20260805 22:47:23.945155 20968 catalog_manager.cc:4841] TS d8ad65c86c924275a5cb447b77e2f643 (127.14.224.131:36853): tablet 44233c3a47674948964d706ccec2299c (table test-table [id=f50344856bbe45e7bdbd920fda1e14b0]) successfully deleted
W20260805 22:47:23.949965 20971 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.224.129:45133 (error 108)
I20260805 22:47:23.950615 21702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:23.950446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.129:45133 (local address 127.0.0.1:57596)
0805 22:47:23.950510 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:23.950558 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.129:45133: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260805 22:47:23.950649 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 21283
W20260805 22:47:23.950755 20971 catalog_manager.cc:4584] TS edb08a48db7e453185f529862d636d69 (127.14.224.129:45133): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 44233c3a47674948964d706ccec2299c: Network error: Client connection negotiation failed: client connection to 127.14.224.129:45133: connect: Connection refused (error 111)
I20260805 22:47:23.965056 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 21481
I20260805 22:47:23.999946 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 20949
2026-08-05T22:47:24Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2238 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-05T22:47:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:47:24Z Disabled control of system clock
I20260805 22:47:24.040601 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970021300824-15234-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970021300824-15234-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970021300824-15234-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:39095
--webserver_interface=127.14.224.190
--webserver_port=0
--builtin_ntp_servers=127.14.224.148:44095
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.224.190:39095
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260805 22:47:24.124647 21756 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:24.124929 21756 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:24.124959 21756 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:24.126211 21756 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:47:24.126271 21756 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:24.126282 21756 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:24.126293 21756 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:47:24.126304 21756 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:47:24.128062 21756 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:44095
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970021300824-15234-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970021300824-15234-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.224.190:39095
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:39095
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.224.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21756
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970021300824-15234-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:24.128378 21756 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:24.128717 21756 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:24.134085 21769 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:24.134188 21765 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:24.134078 21764 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:24.134167 21756 server_base.cc:1034] running on GCE node
I20260805 22:47:24.134589 21756 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:24.134912 21756 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:24.136103 21756 hybrid_clock.cc:648] HybridClock initialized: now 1785970044136089 us; error 34 us; skew 500 ppm
I20260805 22:47:24.137403 21756 webserver.cc:460] Webserver started at http://127.14.224.190:46675/ using document root <none> and password file <none>
I20260805 22:47:24.137637 21756 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:24.137682 21756 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:24.137775 21756 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:24.138842 21756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970021300824-15234-0/minicluster-data/master-0/data/instance:
uuid: "79e7ea37854d4ee8a23bb334c5d64dca"
format_stamp: "Formatted at 2026-08-05 22:47:24 on dist-test-slave-gjrz"
server_key: "724831969598a7a8d019118103fa2217"
server_key_iv: "83964b548269d8a67b528800b2a7962c"
server_key_version: "encryptionkey@0"
I20260805 22:47:24.139164 21756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970021300824-15234-0/minicluster-data/master-0/wal/instance:
uuid: "79e7ea37854d4ee8a23bb334c5d64dca"
format_stamp: "Formatted at 2026-08-05 22:47:24 on dist-test-slave-gjrz"
server_key: "724831969598a7a8d019118103fa2217"
server_key_iv: "83964b548269d8a67b528800b2a7962c"
server_key_version: "encryptionkey@0"
I20260805 22:47:24.140570 21756 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:47:24.141390 21776 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:24.141575 21756 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:47:24.141670 21756 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970021300824-15234-0/minicluster-data/master-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970021300824-15234-0/minicluster-data/master-0/wal
uuid: "79e7ea37854d4ee8a23bb334c5d64dca"
format_stamp: "Formatted at 2026-08-05 22:47:24 on dist-test-slave-gjrz"
server_key: "724831969598a7a8d019118103fa2217"
server_key_iv: "83964b548269d8a67b528800b2a7962c"
server_key_version: "encryptionkey@0"
I20260805 22:47:24.141739 21756 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970021300824-15234-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970021300824-15234-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970021300824-15234-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:24.145255 21756 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:24.145541 21756 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:24.145666 21756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:24.149475 21756 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.190:39095
I20260805 22:47:24.149511 21861 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.190:39095 every 8 connection(s)
I20260805 22:47:24.149896 21756 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
I20260805 22:47:24.150594 21862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:24.153817 21862 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 79e7ea37854d4ee8a23bb334c5d64dca: Bootstrap starting.
I20260805 22:47:24.154462 21862 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 79e7ea37854d4ee8a23bb334c5d64dca: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:24.154765 21862 log.cc:824] T 00000000000000000000000000000000 P 79e7ea37854d4ee8a23bb334c5d64dca: Log is configured to *not* fsync() on all Append() calls
I20260805 22:47:24.155493 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 21756
I20260805 22:47:24.155615 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970021300824-15234-0/minicluster-data/master-0/wal/instance
I20260805 22:47:24.155684 21862 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 79e7ea37854d4ee8a23bb334c5d64dca: No bootstrap required, opened a new log
I20260805 22:47:24.155812 15234 external_mini_cluster.cc:1428] Setting key 58621bbcbfb28d82fa333bab29d0083d
I20260805 22:47:24.158070 21862 raft_consensus.cc:348] T 00000000000000000000000000000000 P 79e7ea37854d4ee8a23bb334c5d64dca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79e7ea37854d4ee8a23bb334c5d64dca" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 39095 } }
I20260805 22:47:24.158268 21862 raft_consensus.cc:374] T 00000000000000000000000000000000 P 79e7ea37854d4ee8a23bb334c5d64dca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:24.158334 21862 raft_consensus.cc:729] T 00000000000000000000000000000000 P 79e7ea37854d4ee8a23bb334c5d64dca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79e7ea37854d4ee8a23bb334c5d64dca, State: Initialized, Role: FOLLOWER
I20260805 22:47:24.158443 21869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:24.156418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40094 (local address 127.14.224.190:39095)
0805 22:47:24.156622 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:24.156631 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:24.156658 (+ 27us) server_negotiation.cc:407] Connection header received
0805 22:47:24.157120 (+ 462us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:24.157127 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:24.157169 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:24.157292 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:24.157976 (+ 684us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:24.157979 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:24.157979 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:47:24.157983 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:24.158025 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:47:24.158035 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:24.158097 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:24.158177 (+ 80us) server_negotiation.cc:299] Negotiation successful
0805 22:47:24.158228 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":74,"threads_started":1}
I20260805 22:47:24.158506 21862 consensus_queue.cc:260] T 00000000000000000000000000000000 P 79e7ea37854d4ee8a23bb334c5d64dca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79e7ea37854d4ee8a23bb334c5d64dca" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 39095 } }
I20260805 22:47:24.158617 21862 raft_consensus.cc:388] T 00000000000000000000000000000000 P 79e7ea37854d4ee8a23bb334c5d64dca [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:47:24.158651 21862 raft_consensus.cc:482] T 00000000000000000000000000000000 P 79e7ea37854d4ee8a23bb334c5d64dca [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:47:24.158699 21862 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 79e7ea37854d4ee8a23bb334c5d64dca [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:24.159690 21862 raft_consensus.cc:504] T 00000000000000000000000000000000 P 79e7ea37854d4ee8a23bb334c5d64dca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79e7ea37854d4ee8a23bb334c5d64dca" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 39095 } }
I20260805 22:47:24.159798 21862 leader_election.cc:302] T 00000000000000000000000000000000 P 79e7ea37854d4ee8a23bb334c5d64dca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 79e7ea37854d4ee8a23bb334c5d64dca; no voters:
I20260805 22:47:24.159984 21862 leader_election.cc:288] T 00000000000000000000000000000000 P 79e7ea37854d4ee8a23bb334c5d64dca [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:47:24.160034 21870 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 79e7ea37854d4ee8a23bb334c5d64dca [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:47:24.160194 21870 raft_consensus.cc:686] T 00000000000000000000000000000000 P 79e7ea37854d4ee8a23bb334c5d64dca [term 1 LEADER]: Becoming Leader. State: Replica: 79e7ea37854d4ee8a23bb334c5d64dca, State: Running, Role: LEADER
I20260805 22:47:24.160260 21862 sys_catalog.cc:564] T 00000000000000000000000000000000 P 79e7ea37854d4ee8a23bb334c5d64dca [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:47:24.160297 21870 consensus_queue.cc:237] T 00000000000000000000000000000000 P 79e7ea37854d4ee8a23bb334c5d64dca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79e7ea37854d4ee8a23bb334c5d64dca" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 39095 } }
I20260805 22:47:24.160668 21872 sys_catalog.cc:455] T 00000000000000000000000000000000 P 79e7ea37854d4ee8a23bb334c5d64dca [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "79e7ea37854d4ee8a23bb334c5d64dca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79e7ea37854d4ee8a23bb334c5d64dca" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 39095 } } }
I20260805 22:47:24.160688 21877 sys_catalog.cc:455] T 00000000000000000000000000000000 P 79e7ea37854d4ee8a23bb334c5d64dca [sys.catalog]: SysCatalogTable state changed. Reason: New leader 79e7ea37854d4ee8a23bb334c5d64dca. Latest consensus state: current_term: 1 leader_uuid: "79e7ea37854d4ee8a23bb334c5d64dca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79e7ea37854d4ee8a23bb334c5d64dca" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 39095 } } }
I20260805 22:47:24.160815 21872 sys_catalog.cc:458] T 00000000000000000000000000000000 P 79e7ea37854d4ee8a23bb334c5d64dca [sys.catalog]: This master's current role is: LEADER
I20260805 22:47:24.160864 21877 sys_catalog.cc:458] T 00000000000000000000000000000000 P 79e7ea37854d4ee8a23bb334c5d64dca [sys.catalog]: This master's current role is: LEADER
I20260805 22:47:24.161095 21885 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:47:24.161597 21885 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:47:24.163225 21885 catalog_manager.cc:1347] Generated new cluster ID: 3803441c72b3421f819a7326d25908a4
I20260805 22:47:24.163306 21885 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:47:24.198578 21885 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:47:24.198776 21885 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:47:24.209653 21885 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 79e7ea37854d4ee8a23bb334c5d64dca: Generated new TSK 0
I20260805 22:47:24.209880 21885 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:47:24.220906 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970021300824-15234-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970021300824-15234-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970021300824-15234-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.129:0
--local_ip_for_outbound_sockets=127.14.224.129
--webserver_interface=127.14.224.129
--webserver_port=0
--tserver_master_addrs=127.14.224.190:39095
--builtin_ntp_servers=127.14.224.148:44095
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260805 22:47:24.334021 21906 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:24.334239 21906 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:24.334263 21906 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:24.335430 21906 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:24.335464 21906 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:24.335489 21906 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.129
I20260805 22:47:24.336823 21906 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:44095
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970021300824-15234-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970021300824-15234-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.224.129
--webserver_port=0
--tserver_master_addrs=127.14.224.190:39095
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21906
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.129
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970021300824-15234-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:24.337040 21906 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:24.337316 21906 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:24.342656 21912 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:24.342778 21906 server_base.cc:1034] running on GCE node
W20260805 22:47:24.342676 21915 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:24.342680 21911 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:24.343112 21906 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:24.343453 21906 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:24.344591 21906 hybrid_clock.cc:648] HybridClock initialized: now 1785970044344581 us; error 44 us; skew 500 ppm
I20260805 22:47:24.345984 21906 webserver.cc:460] Webserver started at http://127.14.224.129:44093/ using document root <none> and password file <none>
I20260805 22:47:24.346257 21906 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:24.346312 21906 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:24.346451 21906 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:24.347610 21906 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970021300824-15234-0/minicluster-data/ts-0/data/instance:
uuid: "80a084b1676145519f1f15d4bd012d9f"
format_stamp: "Formatted at 2026-08-05 22:47:24 on dist-test-slave-gjrz"
server_key: "2c6cd622aca48ea8cedebc2556bc7227"
server_key_iv: "14e161cd26dbd64b0f715da313cedfa2"
server_key_version: "encryptionkey@0"
I20260805 22:47:24.347960 21906 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970021300824-15234-0/minicluster-data/ts-0/wal/instance:
uuid: "80a084b1676145519f1f15d4bd012d9f"
format_stamp: "Formatted at 2026-08-05 22:47:24 on dist-test-slave-gjrz"
server_key: "2c6cd622aca48ea8cedebc2556bc7227"
server_key_iv: "14e161cd26dbd64b0f715da313cedfa2"
server_key_version: "encryptionkey@0"
I20260805 22:47:24.349294 21906 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260805 22:47:24.350143 21923 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:24.350404 21906 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:47:24.350504 21906 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970021300824-15234-0/minicluster-data/ts-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970021300824-15234-0/minicluster-data/ts-0/wal
uuid: "80a084b1676145519f1f15d4bd012d9f"
format_stamp: "Formatted at 2026-08-05 22:47:24 on dist-test-slave-gjrz"
server_key: "2c6cd622aca48ea8cedebc2556bc7227"
server_key_iv: "14e161cd26dbd64b0f715da313cedfa2"
server_key_version: "encryptionkey@0"
I20260805 22:47:24.350581 21906 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970021300824-15234-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970021300824-15234-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970021300824-15234-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:24.354032 21906 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:24.354307 21906 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:24.354430 21906 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:24.354631 21906 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:47:24.354939 21906 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:47:24.354983 21906 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:24.355013 21906 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:47:24.355036 21906 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:24.360837 21906 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.129:38297
I20260805 22:47:24.360895 22113 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.129:38297 every 8 connection(s)
I20260805 22:47:24.361235 21906 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
I20260805 22:47:24.364446 21869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:24.362105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.129:39747 (local address 127.14.224.190:39095)
0805 22:47:24.362163 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:24.362165 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:24.362443 (+ 278us) server_negotiation.cc:407] Connection header received
0805 22:47:24.362957 (+ 514us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:24.362958 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:24.362966 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:24.363021 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:24.364194 (+ 1173us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:24.364196 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:24.364196 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:47:24.364202 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:24.364218 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:47:24.364223 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:24.364273 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:24.364352 (+ 79us) server_negotiation.cc:299] Negotiation successful
0805 22:47:24.364368 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260805 22:47:24.364658 22117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:24.362080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:39095 (local address 127.14.224.129:39747)
0805 22:47:24.362318 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:24.362356 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:24.362851 (+ 495us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:24.363097 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:24.363102 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:24.363112 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:24.364033 (+ 921us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 22:47:24.364034 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:24.364067 (+ 33us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 22:47:24.364099 (+ 32us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:24.364278 (+ 179us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:24.364285 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:24.364288 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:47:24.364361 (+ 73us) client_negotiation.cc:240] Negotiation successful
0805 22:47:24.364427 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":95,"threads_started":1}
I20260805 22:47:24.365139 22114 heartbeater.cc:347] Connected to a master server at 127.14.224.190:39095
I20260805 22:47:24.365226 22114 heartbeater.cc:464] Registering TS with master...
I20260805 22:47:24.365373 22114 heartbeater.cc:511] Master 127.14.224.190:39095 requested a full tablet report, sending...
I20260805 22:47:24.365867 21804 ts_manager.cc:194] Registered new tserver with Master: 80a084b1676145519f1f15d4bd012d9f (127.14.224.129:38297)
I20260805 22:47:24.368072 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 21906
I20260805 22:47:24.368157 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970021300824-15234-0/minicluster-data/ts-0/wal/instance
I20260805 22:47:24.368304 15234 external_mini_cluster.cc:1428] Setting key 0646fc08868ea482e4f4960f7c96580d
I20260805 22:47:24.369299 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970021300824-15234-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970021300824-15234-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970021300824-15234-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.130:0
--local_ip_for_outbound_sockets=127.14.224.130
--webserver_interface=127.14.224.130
--webserver_port=0
--tserver_master_addrs=127.14.224.190:39095
--builtin_ntp_servers=127.14.224.148:44095
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260805 22:47:24.453276 22118 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:24.453516 22118 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:24.453541 22118 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:24.454831 22118 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:24.454879 22118 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:24.454906 22118 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.130
I20260805 22:47:24.456396 22118 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:44095
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970021300824-15234-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970021300824-15234-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.224.130
--webserver_port=0
--tserver_master_addrs=127.14.224.190:39095
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22118
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.130
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970021300824-15234-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:24.456637 22118 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:24.456926 22118 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:24.462246 22129 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:24.462246 22128 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:24.462241 22131 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:24.462531 22118 server_base.cc:1034] running on GCE node
I20260805 22:47:24.462770 22118 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:24.463023 22118 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:24.464197 22118 hybrid_clock.cc:648] HybridClock initialized: now 1785970044464180 us; error 29 us; skew 500 ppm
I20260805 22:47:24.465579 22118 webserver.cc:460] Webserver started at http://127.14.224.130:36089/ using document root <none> and password file <none>
I20260805 22:47:24.465826 22118 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:24.465879 22118 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:24.466012 22118 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:24.467123 22118 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970021300824-15234-0/minicluster-data/ts-1/data/instance:
uuid: "c45172b0ba7149229cb1ed42a4fe9932"
format_stamp: "Formatted at 2026-08-05 22:47:24 on dist-test-slave-gjrz"
server_key: "7d9a8c578d2c4b4094a91adc83cf3607"
server_key_iv: "fb29ed1aeb2e1cba0142c67b1bf7fbd2"
server_key_version: "encryptionkey@0"
I20260805 22:47:24.467506 22118 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970021300824-15234-0/minicluster-data/ts-1/wal/instance:
uuid: "c45172b0ba7149229cb1ed42a4fe9932"
format_stamp: "Formatted at 2026-08-05 22:47:24 on dist-test-slave-gjrz"
server_key: "7d9a8c578d2c4b4094a91adc83cf3607"
server_key_iv: "fb29ed1aeb2e1cba0142c67b1bf7fbd2"
server_key_version: "encryptionkey@0"
I20260805 22:47:24.468832 22118 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:47:24.469566 22138 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:24.469740 22118 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260805 22:47:24.469827 22118 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970021300824-15234-0/minicluster-data/ts-1/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970021300824-15234-0/minicluster-data/ts-1/wal
uuid: "c45172b0ba7149229cb1ed42a4fe9932"
format_stamp: "Formatted at 2026-08-05 22:47:24 on dist-test-slave-gjrz"
server_key: "7d9a8c578d2c4b4094a91adc83cf3607"
server_key_iv: "fb29ed1aeb2e1cba0142c67b1bf7fbd2"
server_key_version: "encryptionkey@0"
I20260805 22:47:24.469894 22118 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970021300824-15234-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970021300824-15234-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970021300824-15234-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:24.473322 22118 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:24.473572 22118 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:24.473693 22118 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:24.473881 22118 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:47:24.474187 22118 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:47:24.474222 22118 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:24.474248 22118 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:47:24.474273 22118 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:24.479808 22118 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.130:42233
I20260805 22:47:24.479853 22313 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.130:42233 every 8 connection(s)
I20260805 22:47:24.480191 22118 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
I20260805 22:47:24.483189 21869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:24.480883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:52167 (local address 127.14.224.190:39095)
0805 22:47:24.480927 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:24.480929 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:24.481175 (+ 246us) server_negotiation.cc:407] Connection header received
0805 22:47:24.481694 (+ 519us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:24.481696 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:24.481703 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:24.481758 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:24.482936 (+ 1178us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:24.482938 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:24.482938 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:47:24.482943 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:24.482961 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:47:24.482966 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:24.483017 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:24.483094 (+ 77us) server_negotiation.cc:299] Negotiation successful
0805 22:47:24.483110 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260805 22:47:24.483413 22318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:24.480860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:39095 (local address 127.14.224.130:52167)
0805 22:47:24.481043 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:24.481088 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:24.481587 (+ 499us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:24.481830 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:24.481835 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:24.481845 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:24.482771 (+ 926us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 22:47:24.482772 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:24.482804 (+ 32us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 22:47:24.482836 (+ 32us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:24.483020 (+ 184us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:24.483026 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:24.483030 (+ 4us) client_negotiation.cc:769] Sending connection context
0805 22:47:24.483102 (+ 72us) client_negotiation.cc:240] Negotiation successful
0805 22:47:24.483169 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":79,"threads_started":1}
I20260805 22:47:24.483857 22316 heartbeater.cc:347] Connected to a master server at 127.14.224.190:39095
I20260805 22:47:24.483980 22316 heartbeater.cc:464] Registering TS with master...
I20260805 22:47:24.484141 22316 heartbeater.cc:511] Master 127.14.224.190:39095 requested a full tablet report, sending...
I20260805 22:47:24.484493 21804 ts_manager.cc:194] Registered new tserver with Master: c45172b0ba7149229cb1ed42a4fe9932 (127.14.224.130:42233)
I20260805 22:47:24.484968 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 22118
I20260805 22:47:24.485047 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970021300824-15234-0/minicluster-data/ts-1/wal/instance
I20260805 22:47:24.485198 15234 external_mini_cluster.cc:1428] Setting key 57b0a67da706616abe8330f6a9e51c2d
I20260805 22:47:24.486095 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970021300824-15234-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970021300824-15234-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970021300824-15234-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.131:0
--local_ip_for_outbound_sockets=127.14.224.131
--webserver_interface=127.14.224.131
--webserver_port=0
--tserver_master_addrs=127.14.224.190:39095
--builtin_ntp_servers=127.14.224.148:44095
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260805 22:47:24.568158 22319 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:24.568387 22319 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:24.568419 22319 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:24.569634 22319 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:24.569682 22319 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:24.569717 22319 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.131
I20260805 22:47:24.571161 22319 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:44095
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970021300824-15234-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970021300824-15234-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.224.131
--webserver_port=0
--tserver_master_addrs=127.14.224.190:39095
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22319
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.131
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970021300824-15234-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:24.571441 22319 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:24.571734 22319 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:24.576985 22327 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:24.576994 22328 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:24.576994 22332 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:24.577236 22319 server_base.cc:1034] running on GCE node
I20260805 22:47:24.577425 22319 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:24.577654 22319 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:24.578794 22319 hybrid_clock.cc:648] HybridClock initialized: now 1785970044578782 us; error 30 us; skew 500 ppm
I20260805 22:47:24.580041 22319 webserver.cc:460] Webserver started at http://127.14.224.131:37467/ using document root <none> and password file <none>
I20260805 22:47:24.580286 22319 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:24.580333 22319 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:24.580463 22319 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:24.581615 22319 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970021300824-15234-0/minicluster-data/ts-2/data/instance:
uuid: "5e19ee819963476faef961de1ce5272b"
format_stamp: "Formatted at 2026-08-05 22:47:24 on dist-test-slave-gjrz"
server_key: "3f77950df547e82b0d0b9ff3c5d62f09"
server_key_iv: "6cc255a454ee6509b1b1d7b3891b7251"
server_key_version: "encryptionkey@0"
I20260805 22:47:24.581979 22319 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970021300824-15234-0/minicluster-data/ts-2/wal/instance:
uuid: "5e19ee819963476faef961de1ce5272b"
format_stamp: "Formatted at 2026-08-05 22:47:24 on dist-test-slave-gjrz"
server_key: "3f77950df547e82b0d0b9ff3c5d62f09"
server_key_iv: "6cc255a454ee6509b1b1d7b3891b7251"
server_key_version: "encryptionkey@0"
I20260805 22:47:24.583314 22319 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260805 22:47:24.584061 22347 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:24.584226 22319 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260805 22:47:24.584316 22319 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970021300824-15234-0/minicluster-data/ts-2/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970021300824-15234-0/minicluster-data/ts-2/wal
uuid: "5e19ee819963476faef961de1ce5272b"
format_stamp: "Formatted at 2026-08-05 22:47:24 on dist-test-slave-gjrz"
server_key: "3f77950df547e82b0d0b9ff3c5d62f09"
server_key_iv: "6cc255a454ee6509b1b1d7b3891b7251"
server_key_version: "encryptionkey@0"
I20260805 22:47:24.584383 22319 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970021300824-15234-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970021300824-15234-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970021300824-15234-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:24.587931 22319 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:24.588207 22319 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:24.588330 22319 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:24.588528 22319 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:47:24.588833 22319 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:47:24.588866 22319 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:24.588893 22319 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:47:24.588927 22319 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:24.594599 22319 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.131:39041
I20260805 22:47:24.594647 22518 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.131:39041 every 8 connection(s)
I20260805 22:47:24.594991 22319 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
I20260805 22:47:24.597995 21869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:24.595746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:38483 (local address 127.14.224.190:39095)
0805 22:47:24.595810 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:24.595813 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:24.596097 (+ 284us) server_negotiation.cc:407] Connection header received
0805 22:47:24.596574 (+ 477us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:24.596576 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:24.596581 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:24.596636 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:24.597732 (+ 1096us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:24.597733 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:24.597734 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:47:24.597738 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:24.597753 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:47:24.597757 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:24.597799 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:24.597899 (+ 100us) server_negotiation.cc:299] Negotiation successful
0805 22:47:24.597915 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260805 22:47:24.598145 22524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:24.595736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:39095 (local address 127.14.224.131:38483)
0805 22:47:24.595967 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:24.596007 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:24.596492 (+ 485us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:24.596695 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:24.596698 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:24.596708 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:24.597585 (+ 877us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 22:47:24.597585 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:24.597616 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 22:47:24.597647 (+ 31us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:24.597804 (+ 157us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:24.597807 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:24.597810 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:47:24.597860 (+ 50us) client_negotiation.cc:240] Negotiation successful
0805 22:47:24.597912 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":94,"threads_started":1}
I20260805 22:47:24.598680 22521 heartbeater.cc:347] Connected to a master server at 127.14.224.190:39095
I20260805 22:47:24.598776 22521 heartbeater.cc:464] Registering TS with master...
I20260805 22:47:24.598932 22521 heartbeater.cc:511] Master 127.14.224.190:39095 requested a full tablet report, sending...
I20260805 22:47:24.599314 21804 ts_manager.cc:194] Registered new tserver with Master: 5e19ee819963476faef961de1ce5272b (127.14.224.131:39041)
I20260805 22:47:24.601682 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 22319
I20260805 22:47:24.601771 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970021300824-15234-0/minicluster-data/ts-2/wal/instance
I20260805 22:47:24.601956 15234 external_mini_cluster.cc:1428] Setting key 155dbf27df6dc2012721b5d9effc0523
I20260805 22:47:24.602818 15234 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 22:47:24.605157 21869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:24.604161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40096 (local address 127.14.224.190:39095)
0805 22:47:24.604224 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:24.604226 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:24.604327 (+ 101us) server_negotiation.cc:407] Connection header received
0805 22:47:24.604377 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:24.604378 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:24.604383 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:24.604430 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:24.604941 (+ 511us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:24.604942 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:24.604943 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:47:24.604947 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:24.604960 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:47:24.604964 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:24.605005 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:24.605064 (+ 59us) server_negotiation.cc:299] Negotiation successful
0805 22:47:24.605076 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260805 22:47:24.606662 21804 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40096:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:47:24.608343 21804 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:47:24.612201 22541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:24.610777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33584 (local address 127.14.224.131:39041)
0805 22:47:24.610957 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:24.610962 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:24.610972 (+ 10us) server_negotiation.cc:407] Connection header received
0805 22:47:24.611001 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:24.611004 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:24.611014 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:24.611417 (+ 403us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:24.611878 (+ 461us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:24.611885 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:24.611886 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:47:24.611890 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:24.611927 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:47:24.611948 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:24.611998 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:24.612109 (+ 111us) server_negotiation.cc:299] Negotiation successful
0805 22:47:24.612125 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":91,"threads_started":1}
I20260805 22:47:24.612180 22534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:24.610454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.131:39041 (local address 127.0.0.1:33584)
0805 22:47:24.610601 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:24.610645 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:24.610707 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:24.611150 (+ 443us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:24.611157 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:24.611165 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:24.611742 (+ 577us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 22:47:24.611743 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:24.611762 (+ 19us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 22:47:24.611791 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:24.612024 (+ 233us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:24.612025 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:24.612026 (+ 1us) client_negotiation.cc:769] Sending connection context
0805 22:47:24.612078 (+ 52us) client_negotiation.cc:240] Negotiation successful
0805 22:47:24.612092 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":89,"threads_started":1}
I20260805 22:47:24.612185 22540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:24.610456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.129:38297 (local address 127.0.0.1:56648)
0805 22:47:24.610911 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:24.610920 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:24.610974 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:24.611165 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:24.611166 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:24.611167 (+ 1us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:24.611786 (+ 619us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 22:47:24.611787 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:24.611795 (+ 8us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 22:47:24.611808 (+ 13us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:24.612007 (+ 199us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:24.612015 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:24.612018 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:47:24.612088 (+ 70us) client_negotiation.cc:240] Negotiation successful
0805 22:47:24.612101 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":437,"spinlock_wait_cycles":768,"thread_start_us":141,"threads_started":1}
I20260805 22:47:24.612486 22539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:24.610584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56648 (local address 127.14.224.129:38297)
0805 22:47:24.610750 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:24.610755 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:24.610981 (+ 226us) server_negotiation.cc:407] Connection header received
0805 22:47:24.611018 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:24.611020 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:24.611031 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:24.611119 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:24.611900 (+ 781us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:24.611903 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:24.611903 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:47:24.611906 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:24.611930 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:47:24.611944 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:24.612003 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:24.612392 (+ 389us) server_negotiation.cc:299] Negotiation successful
0805 22:47:24.612411 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":89,"threads_started":1}
I20260805 22:47:24.612982 22428 tablet_service.cc:1467] Processing CreateTablet for tablet b35f5d6ea63c459380e074273b4ef108 (DEFAULT_TABLE table=test-table [id=ab706d4336364740b54b2e9305b5d440]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:47:24.613301 22535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:24.610693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.130:42233 (local address 127.0.0.1:49326)
0805 22:47:24.611048 (+ 355us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:24.611057 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:24.611088 (+ 31us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:24.612115 (+ 1027us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:24.612116 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:24.612118 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:24.612877 (+ 759us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 22:47:24.612877 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:24.612885 (+ 8us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 22:47:24.612897 (+ 12us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:24.613155 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:24.613156 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:24.613157 (+ 1us) client_negotiation.cc:769] Sending connection context
0805 22:47:24.613228 (+ 71us) client_negotiation.cc:240] Negotiation successful
0805 22:47:24.613242 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":342,"thread_start_us":64,"threads_started":1}
I20260805 22:47:24.613392 22428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b35f5d6ea63c459380e074273b4ef108. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:24.613291 22021 tablet_service.cc:1467] Processing CreateTablet for tablet b35f5d6ea63c459380e074273b4ef108 (DEFAULT_TABLE table=test-table [id=ab706d4336364740b54b2e9305b5d440]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:47:24.613626 22021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b35f5d6ea63c459380e074273b4ef108. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:24.613638 22542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:24.610908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49326 (local address 127.14.224.130:42233)
0805 22:47:24.611747 (+ 839us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:24.611751 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:24.611761 (+ 10us) server_negotiation.cc:407] Connection header received
0805 22:47:24.611789 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:24.611791 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:24.611799 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:24.611869 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:24.612978 (+ 1109us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:24.612986 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:24.612986 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:47:24.612991 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:24.613027 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:47:24.613052 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:24.613124 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:24.613541 (+ 417us) server_negotiation.cc:299] Negotiation successful
0805 22:47:24.613559 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":804,"thread_start_us":93,"threads_started":1}
I20260805 22:47:24.614370 22220 tablet_service.cc:1467] Processing CreateTablet for tablet b35f5d6ea63c459380e074273b4ef108 (DEFAULT_TABLE table=test-table [id=ab706d4336364740b54b2e9305b5d440]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:47:24.614705 22220 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b35f5d6ea63c459380e074273b4ef108. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:24.617115 22544 tablet_bootstrap.cc:492] T b35f5d6ea63c459380e074273b4ef108 P 5e19ee819963476faef961de1ce5272b: Bootstrap starting.
I20260805 22:47:24.617877 22544 tablet_bootstrap.cc:654] T b35f5d6ea63c459380e074273b4ef108 P 5e19ee819963476faef961de1ce5272b: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:24.618265 22545 tablet_bootstrap.cc:492] T b35f5d6ea63c459380e074273b4ef108 P c45172b0ba7149229cb1ed42a4fe9932: Bootstrap starting.
I20260805 22:47:24.618928 22545 tablet_bootstrap.cc:654] T b35f5d6ea63c459380e074273b4ef108 P c45172b0ba7149229cb1ed42a4fe9932: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:24.618948 22544 log.cc:824] T b35f5d6ea63c459380e074273b4ef108 P 5e19ee819963476faef961de1ce5272b: Log is configured to *not* fsync() on all Append() calls
I20260805 22:47:24.619249 22545 log.cc:824] T b35f5d6ea63c459380e074273b4ef108 P c45172b0ba7149229cb1ed42a4fe9932: Log is configured to *not* fsync() on all Append() calls
I20260805 22:47:24.619477 22546 tablet_bootstrap.cc:492] T b35f5d6ea63c459380e074273b4ef108 P 80a084b1676145519f1f15d4bd012d9f: Bootstrap starting.
I20260805 22:47:24.619886 22544 tablet_bootstrap.cc:492] T b35f5d6ea63c459380e074273b4ef108 P 5e19ee819963476faef961de1ce5272b: No bootstrap required, opened a new log
I20260805 22:47:24.619971 22544 ts_tablet_manager.cc:1397] T b35f5d6ea63c459380e074273b4ef108 P 5e19ee819963476faef961de1ce5272b: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260805 22:47:24.620029 22546 tablet_bootstrap.cc:654] T b35f5d6ea63c459380e074273b4ef108 P 80a084b1676145519f1f15d4bd012d9f: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:24.620345 22546 log.cc:824] T b35f5d6ea63c459380e074273b4ef108 P 80a084b1676145519f1f15d4bd012d9f: Log is configured to *not* fsync() on all Append() calls
I20260805 22:47:24.620970 22545 tablet_bootstrap.cc:492] T b35f5d6ea63c459380e074273b4ef108 P c45172b0ba7149229cb1ed42a4fe9932: No bootstrap required, opened a new log
I20260805 22:47:24.621040 22545 ts_tablet_manager.cc:1397] T b35f5d6ea63c459380e074273b4ef108 P c45172b0ba7149229cb1ed42a4fe9932: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260805 22:47:24.622632 22544 raft_consensus.cc:348] T b35f5d6ea63c459380e074273b4ef108 P 5e19ee819963476faef961de1ce5272b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e19ee819963476faef961de1ce5272b" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 39041 } } peers { permanent_uuid: "c45172b0ba7149229cb1ed42a4fe9932" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 42233 } } peers { permanent_uuid: "80a084b1676145519f1f15d4bd012d9f" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 38297 } }
I20260805 22:47:24.622826 22544 raft_consensus.cc:374] T b35f5d6ea63c459380e074273b4ef108 P 5e19ee819963476faef961de1ce5272b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:24.622867 22544 raft_consensus.cc:729] T b35f5d6ea63c459380e074273b4ef108 P 5e19ee819963476faef961de1ce5272b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e19ee819963476faef961de1ce5272b, State: Initialized, Role: FOLLOWER
I20260805 22:47:24.623011 22544 consensus_queue.cc:260] T b35f5d6ea63c459380e074273b4ef108 P 5e19ee819963476faef961de1ce5272b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e19ee819963476faef961de1ce5272b" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 39041 } } peers { permanent_uuid: "c45172b0ba7149229cb1ed42a4fe9932" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 42233 } } peers { permanent_uuid: "80a084b1676145519f1f15d4bd012d9f" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 38297 } }
I20260805 22:47:24.623319 22544 ts_tablet_manager.cc:1428] T b35f5d6ea63c459380e074273b4ef108 P 5e19ee819963476faef961de1ce5272b: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260805 22:47:24.623370 22521 heartbeater.cc:503] Master 127.14.224.190:39095 was elected leader, sending a full tablet report...
I20260805 22:47:24.623610 22545 raft_consensus.cc:348] T b35f5d6ea63c459380e074273b4ef108 P c45172b0ba7149229cb1ed42a4fe9932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e19ee819963476faef961de1ce5272b" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 39041 } } peers { permanent_uuid: "c45172b0ba7149229cb1ed42a4fe9932" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 42233 } } peers { permanent_uuid: "80a084b1676145519f1f15d4bd012d9f" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 38297 } }
I20260805 22:47:24.623764 22545 raft_consensus.cc:374] T b35f5d6ea63c459380e074273b4ef108 P c45172b0ba7149229cb1ed42a4fe9932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:24.623797 22545 raft_consensus.cc:729] T b35f5d6ea63c459380e074273b4ef108 P c45172b0ba7149229cb1ed42a4fe9932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45172b0ba7149229cb1ed42a4fe9932, State: Initialized, Role: FOLLOWER
I20260805 22:47:24.623921 22545 consensus_queue.cc:260] T b35f5d6ea63c459380e074273b4ef108 P c45172b0ba7149229cb1ed42a4fe9932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e19ee819963476faef961de1ce5272b" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 39041 } } peers { permanent_uuid: "c45172b0ba7149229cb1ed42a4fe9932" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 42233 } } peers { permanent_uuid: "80a084b1676145519f1f15d4bd012d9f" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 38297 } }
I20260805 22:47:24.624137 22546 tablet_bootstrap.cc:492] T b35f5d6ea63c459380e074273b4ef108 P 80a084b1676145519f1f15d4bd012d9f: No bootstrap required, opened a new log
I20260805 22:47:24.624214 22546 ts_tablet_manager.cc:1397] T b35f5d6ea63c459380e074273b4ef108 P 80a084b1676145519f1f15d4bd012d9f: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260805 22:47:24.625690 22545 ts_tablet_manager.cc:1428] T b35f5d6ea63c459380e074273b4ef108 P c45172b0ba7149229cb1ed42a4fe9932: Time spent starting tablet: real 0.005s user 0.002s sys 0.001s
I20260805 22:47:24.627233 22316 heartbeater.cc:503] Master 127.14.224.190:39095 was elected leader, sending a full tablet report...
I20260805 22:47:24.627135 22546 raft_consensus.cc:348] T b35f5d6ea63c459380e074273b4ef108 P 80a084b1676145519f1f15d4bd012d9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e19ee819963476faef961de1ce5272b" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 39041 } } peers { permanent_uuid: "c45172b0ba7149229cb1ed42a4fe9932" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 42233 } } peers { permanent_uuid: "80a084b1676145519f1f15d4bd012d9f" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 38297 } }
I20260805 22:47:24.627341 22546 raft_consensus.cc:374] T b35f5d6ea63c459380e074273b4ef108 P 80a084b1676145519f1f15d4bd012d9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:24.627381 22546 raft_consensus.cc:729] T b35f5d6ea63c459380e074273b4ef108 P 80a084b1676145519f1f15d4bd012d9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80a084b1676145519f1f15d4bd012d9f, State: Initialized, Role: FOLLOWER
I20260805 22:47:24.627537 22546 consensus_queue.cc:260] T b35f5d6ea63c459380e074273b4ef108 P 80a084b1676145519f1f15d4bd012d9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e19ee819963476faef961de1ce5272b" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 39041 } } peers { permanent_uuid: "c45172b0ba7149229cb1ed42a4fe9932" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 42233 } } peers { permanent_uuid: "80a084b1676145519f1f15d4bd012d9f" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 38297 } }
I20260805 22:47:24.629001 22546 ts_tablet_manager.cc:1428] T b35f5d6ea63c459380e074273b4ef108 P 80a084b1676145519f1f15d4bd012d9f: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260805 22:47:24.629029 22114 heartbeater.cc:503] Master 127.14.224.190:39095 was elected leader, sending a full tablet report...
W20260805 22:47:24.730829 22317 tablet.cc:2369] T b35f5d6ea63c459380e074273b4ef108 P c45172b0ba7149229cb1ed42a4fe9932: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:47:24.732932 22552 raft_consensus.cc:482] T b35f5d6ea63c459380e074273b4ef108 P c45172b0ba7149229cb1ed42a4fe9932 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:47:24.733074 22552 raft_consensus.cc:504] T b35f5d6ea63c459380e074273b4ef108 P c45172b0ba7149229cb1ed42a4fe9932 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e19ee819963476faef961de1ce5272b" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 39041 } } peers { permanent_uuid: "c45172b0ba7149229cb1ed42a4fe9932" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 42233 } } peers { permanent_uuid: "80a084b1676145519f1f15d4bd012d9f" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 38297 } }
I20260805 22:47:24.733461 22552 leader_election.cc:288] T b35f5d6ea63c459380e074273b4ef108 P c45172b0ba7149229cb1ed42a4fe9932 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e19ee819963476faef961de1ce5272b (127.14.224.131:39041), 80a084b1676145519f1f15d4bd012d9f (127.14.224.129:38297)
I20260805 22:47:24.734757 22318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:24.733664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.131:39041 (local address 127.14.224.130:41609)
0805 22:47:24.733734 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:24.733746 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:24.733793 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:24.733961 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:24.733962 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:24.733964 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:24.734402 (+ 438us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 22:47:24.734403 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:24.734411 (+ 8us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 22:47:24.734424 (+ 13us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:24.734640 (+ 216us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:24.734641 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:24.734641 (+ 0us) client_negotiation.cc:769] Sending connection context
0805 22:47:24.734674 (+ 33us) client_negotiation.cc:240] Negotiation successful
0805 22:47:24.734688 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260805 22:47:24.734778 22541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:24.733755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:41609 (local address 127.14.224.131:39041)
0805 22:47:24.733824 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:24.733826 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:24.733839 (+ 13us) server_negotiation.cc:407] Connection header received
0805 22:47:24.733872 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:24.733873 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:24.733878 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:24.733947 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:24.734531 (+ 584us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:24.734532 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:24.734532 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:47:24.734536 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:24.734553 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:47:24.734558 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:24.734630 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:24.734693 (+ 63us) server_negotiation.cc:299] Negotiation successful
0805 22:47:24.734708 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260805 22:47:24.734822 22539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:24.733762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:50845 (local address 127.14.224.129:38297)
0805 22:47:24.733845 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:24.733847 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:24.733892 (+ 45us) server_negotiation.cc:407] Connection header received
0805 22:47:24.733943 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:24.733944 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:24.733948 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:24.733995 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:24.734616 (+ 621us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:24.734617 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:24.734618 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:47:24.734623 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:24.734639 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:47:24.734644 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:24.734696 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:24.734750 (+ 54us) server_negotiation.cc:299] Negotiation successful
0805 22:47:24.734762 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260805 22:47:24.734849 22554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:24.733674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.129:38297 (local address 127.14.224.130:50845)
0805 22:47:24.733837 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:24.733846 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:24.733892 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:24.734009 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:24.734010 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:24.734012 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:24.734517 (+ 505us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 22:47:24.734517 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:24.734523 (+ 6us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 22:47:24.734532 (+ 9us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:24.734700 (+ 168us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:24.734700 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:24.734701 (+ 1us) client_negotiation.cc:769] Sending connection context
0805 22:47:24.734740 (+ 39us) client_negotiation.cc:240] Negotiation successful
0805 22:47:24.734751 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"mutex_wait_us":3,"thread_start_us":99,"threads_started":1}
I20260805 22:47:24.735064 22460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b35f5d6ea63c459380e074273b4ef108" candidate_uuid: "c45172b0ba7149229cb1ed42a4fe9932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e19ee819963476faef961de1ce5272b" is_pre_election: true
I20260805 22:47:24.735203 22460 raft_consensus.cc:2454] T b35f5d6ea63c459380e074273b4ef108 P 5e19ee819963476faef961de1ce5272b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45172b0ba7149229cb1ed42a4fe9932 in term 0.
I20260805 22:47:24.735423 22142 leader_election.cc:302] T b35f5d6ea63c459380e074273b4ef108 P c45172b0ba7149229cb1ed42a4fe9932 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e19ee819963476faef961de1ce5272b, c45172b0ba7149229cb1ed42a4fe9932; no voters:
I20260805 22:47:24.735515 22047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b35f5d6ea63c459380e074273b4ef108" candidate_uuid: "c45172b0ba7149229cb1ed42a4fe9932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80a084b1676145519f1f15d4bd012d9f" is_pre_election: true
I20260805 22:47:24.735628 22552 raft_consensus.cc:2781] T b35f5d6ea63c459380e074273b4ef108 P c45172b0ba7149229cb1ed42a4fe9932 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:47:24.735669 22047 raft_consensus.cc:2454] T b35f5d6ea63c459380e074273b4ef108 P 80a084b1676145519f1f15d4bd012d9f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45172b0ba7149229cb1ed42a4fe9932 in term 0.
I20260805 22:47:24.735698 22552 raft_consensus.cc:482] T b35f5d6ea63c459380e074273b4ef108 P c45172b0ba7149229cb1ed42a4fe9932 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:47:24.735723 22552 raft_consensus.cc:3037] T b35f5d6ea63c459380e074273b4ef108 P c45172b0ba7149229cb1ed42a4fe9932 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:24.736469 22552 raft_consensus.cc:504] T b35f5d6ea63c459380e074273b4ef108 P c45172b0ba7149229cb1ed42a4fe9932 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e19ee819963476faef961de1ce5272b" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 39041 } } peers { permanent_uuid: "c45172b0ba7149229cb1ed42a4fe9932" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 42233 } } peers { permanent_uuid: "80a084b1676145519f1f15d4bd012d9f" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 38297 } }
I20260805 22:47:24.736608 22552 leader_election.cc:288] T b35f5d6ea63c459380e074273b4ef108 P c45172b0ba7149229cb1ed42a4fe9932 [CANDIDATE]: Term 1 election: Requested vote from peers 5e19ee819963476faef961de1ce5272b (127.14.224.131:39041), 80a084b1676145519f1f15d4bd012d9f (127.14.224.129:38297)
I20260805 22:47:24.736756 22047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b35f5d6ea63c459380e074273b4ef108" candidate_uuid: "c45172b0ba7149229cb1ed42a4fe9932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80a084b1676145519f1f15d4bd012d9f"
I20260805 22:47:24.736778 22460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b35f5d6ea63c459380e074273b4ef108" candidate_uuid: "c45172b0ba7149229cb1ed42a4fe9932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e19ee819963476faef961de1ce5272b"
I20260805 22:47:24.736825 22047 raft_consensus.cc:3037] T b35f5d6ea63c459380e074273b4ef108 P 80a084b1676145519f1f15d4bd012d9f [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:24.736847 22460 raft_consensus.cc:3037] T b35f5d6ea63c459380e074273b4ef108 P 5e19ee819963476faef961de1ce5272b [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:24.737515 22047 raft_consensus.cc:2454] T b35f5d6ea63c459380e074273b4ef108 P 80a084b1676145519f1f15d4bd012d9f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45172b0ba7149229cb1ed42a4fe9932 in term 1.
I20260805 22:47:24.737653 22460 raft_consensus.cc:2454] T b35f5d6ea63c459380e074273b4ef108 P 5e19ee819963476faef961de1ce5272b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45172b0ba7149229cb1ed42a4fe9932 in term 1.
I20260805 22:47:24.737730 22140 leader_election.cc:302] T b35f5d6ea63c459380e074273b4ef108 P c45172b0ba7149229cb1ed42a4fe9932 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80a084b1676145519f1f15d4bd012d9f, c45172b0ba7149229cb1ed42a4fe9932; no voters:
I20260805 22:47:24.737818 22552 raft_consensus.cc:2781] T b35f5d6ea63c459380e074273b4ef108 P c45172b0ba7149229cb1ed42a4fe9932 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:47:24.737946 22552 raft_consensus.cc:686] T b35f5d6ea63c459380e074273b4ef108 P c45172b0ba7149229cb1ed42a4fe9932 [term 1 LEADER]: Becoming Leader. State: Replica: c45172b0ba7149229cb1ed42a4fe9932, State: Running, Role: LEADER
I20260805 22:47:24.738039 22552 consensus_queue.cc:237] T b35f5d6ea63c459380e074273b4ef108 P c45172b0ba7149229cb1ed42a4fe9932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e19ee819963476faef961de1ce5272b" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 39041 } } peers { permanent_uuid: "c45172b0ba7149229cb1ed42a4fe9932" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 42233 } } peers { permanent_uuid: "80a084b1676145519f1f15d4bd012d9f" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 38297 } }
I20260805 22:47:24.738857 21804 catalog_manager.cc:5495] T b35f5d6ea63c459380e074273b4ef108 P c45172b0ba7149229cb1ed42a4fe9932 reported cstate change: term changed from 0 to 1, leader changed from <none> to c45172b0ba7149229cb1ed42a4fe9932 (127.14.224.130). New cstate: current_term: 1 leader_uuid: "c45172b0ba7149229cb1ed42a4fe9932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e19ee819963476faef961de1ce5272b" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 39041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45172b0ba7149229cb1ed42a4fe9932" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 42233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "80a084b1676145519f1f15d4bd012d9f" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 38297 } health_report { overall_health: UNKNOWN } } }
I20260805 22:47:24.759809 22542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:24.758850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49328 (local address 127.14.224.130:42233)
0805 22:47:24.758916 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:24.758918 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:24.758927 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:47:24.758971 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:24.758972 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:24.758987 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:24.759041 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:24.759579 (+ 538us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:24.759581 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:24.759581 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:47:24.759585 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:24.759602 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:47:24.759606 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:24.759651 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:24.759713 (+ 62us) server_negotiation.cc:299] Negotiation successful
0805 22:47:24.759726 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260805 22:47:24.761770 22047 raft_consensus.cc:1261] T b35f5d6ea63c459380e074273b4ef108 P 80a084b1676145519f1f15d4bd012d9f [term 1 FOLLOWER]: Refusing update from remote peer c45172b0ba7149229cb1ed42a4fe9932: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:47:24.761864 22460 raft_consensus.cc:1261] T b35f5d6ea63c459380e074273b4ef108 P 5e19ee819963476faef961de1ce5272b [term 1 FOLLOWER]: Refusing update from remote peer c45172b0ba7149229cb1ed42a4fe9932: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:47:24.762192 22555 consensus_queue.cc:1035] T b35f5d6ea63c459380e074273b4ef108 P c45172b0ba7149229cb1ed42a4fe9932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e19ee819963476faef961de1ce5272b" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 39041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:47:24.762332 22552 consensus_queue.cc:1035] T b35f5d6ea63c459380e074273b4ef108 P c45172b0ba7149229cb1ed42a4fe9932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80a084b1676145519f1f15d4bd012d9f" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 38297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:47:24.764580 22561 mvcc.cc:205] Tried to move back new op lower bound from 7315333303341543424 to 7315333303247601664. Current Snapshot: MvccSnapshot[applied={T|T < 7315333303341543424}]
I20260805 22:47:24.765232 22563 mvcc.cc:205] Tried to move back new op lower bound from 7315333303341543424 to 7315333303247601664. Current Snapshot: MvccSnapshot[applied={T|T < 7315333303341543424}]
I20260805 22:47:24.765645 22566 mvcc.cc:205] Tried to move back new op lower bound from 7315333303341543424 to 7315333303247601664. Current Snapshot: MvccSnapshot[applied={T|T < 7315333303341543424}]
I20260805 22:47:24.767153 21804 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40096:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:47:24.767293 21804 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40096:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:47:24.768136 21804 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 79e7ea37854d4ee8a23bb334c5d64dca: Sending DeleteTablet for 3 replicas of tablet b35f5d6ea63c459380e074273b4ef108
I20260805 22:47:24.768509 22220 tablet_service.cc:1514] Processing DeleteTablet for tablet b35f5d6ea63c459380e074273b4ef108 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:47:24 UTC) from {username='slave'} at 127.0.0.1:49326
I20260805 22:47:24.768517 22428 tablet_service.cc:1514] Processing DeleteTablet for tablet b35f5d6ea63c459380e074273b4ef108 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:47:24 UTC) from {username='slave'} at 127.0.0.1:33584
I20260805 22:47:24.768545 22021 tablet_service.cc:1514] Processing DeleteTablet for tablet b35f5d6ea63c459380e074273b4ef108 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:47:24 UTC) from {username='slave'} at 127.0.0.1:56648
I20260805 22:47:24.768848 22581 tablet_replica.cc:330] T b35f5d6ea63c459380e074273b4ef108 P 80a084b1676145519f1f15d4bd012d9f: stopping tablet replica
I20260805 22:47:24.768986 22581 raft_consensus.cc:2229] T b35f5d6ea63c459380e074273b4ef108 P 80a084b1676145519f1f15d4bd012d9f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:47:24.769083 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 21906
I20260805 22:47:24.769104 22581 raft_consensus.cc:2258] T b35f5d6ea63c459380e074273b4ef108 P 80a084b1676145519f1f15d4bd012d9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:47:24.771432 22579 tablet_replica.cc:330] T b35f5d6ea63c459380e074273b4ef108 P c45172b0ba7149229cb1ed42a4fe9932: stopping tablet replica
I20260805 22:47:24.771549 22579 raft_consensus.cc:2229] T b35f5d6ea63c459380e074273b4ef108 P c45172b0ba7149229cb1ed42a4fe9932 [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:47:24.771667 22579 raft_consensus.cc:2258] T b35f5d6ea63c459380e074273b4ef108 P c45172b0ba7149229cb1ed42a4fe9932 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:47:24.773360 22580 tablet_replica.cc:330] T b35f5d6ea63c459380e074273b4ef108 P 5e19ee819963476faef961de1ce5272b: stopping tablet replica
I20260805 22:47:24.773474 22580 raft_consensus.cc:2229] T b35f5d6ea63c459380e074273b4ef108 P 5e19ee819963476faef961de1ce5272b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:47:24.773571 22580 raft_consensus.cc:2258] T b35f5d6ea63c459380e074273b4ef108 P 5e19ee819963476faef961de1ce5272b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:47:24.777336 22580 ts_tablet_manager.cc:1905] T b35f5d6ea63c459380e074273b4ef108 P 5e19ee819963476faef961de1ce5272b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:47:24.778957 22580 ts_tablet_manager.cc:1918] T b35f5d6ea63c459380e074273b4ef108 P 5e19ee819963476faef961de1ce5272b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:47:24.779028 22580 log.cc:1196] T b35f5d6ea63c459380e074273b4ef108 P 5e19ee819963476faef961de1ce5272b: Deleting WAL directory at /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970021300824-15234-0/minicluster-data/ts-2/wal/wals/b35f5d6ea63c459380e074273b4ef108
I20260805 22:47:24.779214 22580 ts_tablet_manager.cc:1939] T b35f5d6ea63c459380e074273b4ef108 P 5e19ee819963476faef961de1ce5272b: Deleting consensus metadata
I20260805 22:47:24.779647 22579 ts_tablet_manager.cc:1905] T b35f5d6ea63c459380e074273b4ef108 P c45172b0ba7149229cb1ed42a4fe9932: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:47:24.779692 21784 catalog_manager.cc:4841] TS 5e19ee819963476faef961de1ce5272b (127.14.224.131:39041): tablet b35f5d6ea63c459380e074273b4ef108 (table test-table [id=ab706d4336364740b54b2e9305b5d440]) successfully deleted
I20260805 22:47:24.781455 22579 ts_tablet_manager.cc:1918] T b35f5d6ea63c459380e074273b4ef108 P c45172b0ba7149229cb1ed42a4fe9932: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:47:24.781523 22579 log.cc:1196] T b35f5d6ea63c459380e074273b4ef108 P c45172b0ba7149229cb1ed42a4fe9932: Deleting WAL directory at /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970021300824-15234-0/minicluster-data/ts-1/wal/wals/b35f5d6ea63c459380e074273b4ef108
I20260805 22:47:24.781734 22579 ts_tablet_manager.cc:1939] T b35f5d6ea63c459380e074273b4ef108 P c45172b0ba7149229cb1ed42a4fe9932: Deleting consensus metadata
I20260805 22:47:24.792039 21784 catalog_manager.cc:4841] TS c45172b0ba7149229cb1ed42a4fe9932 (127.14.224.130:42233): tablet b35f5d6ea63c459380e074273b4ef108 (table test-table [id=ab706d4336364740b54b2e9305b5d440]) successfully deleted
W20260805 22:47:24.800339 21780 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.224.129:38297 (error 108)
I20260805 22:47:24.800431 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 22118
I20260805 22:47:24.800926 22535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:24.800751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.129:38297 (local address 127.0.0.1:56664)
0805 22:47:24.800834 (+ 83us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:24.800868 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.129:38297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
W20260805 22:47:24.806048 21780 catalog_manager.cc:4584] TS 80a084b1676145519f1f15d4bd012d9f (127.14.224.129:38297): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b35f5d6ea63c459380e074273b4ef108: Network error: Client connection negotiation failed: client connection to 127.14.224.129:38297: connect: Connection refused (error 111)
I20260805 22:47:24.815879 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 22319
I20260805 22:47:24.832890 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 21756
2026-08-05T22:47:24Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (828 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260805 22:47:24.861410 15234 mini_oidc.cc:152] Starting JWKS server
I20260805 22:47:24.862494 15234 webserver.cc:460] Webserver started at https://127.0.0.1:35559/ using document root <none> and password file <none>
I20260805 22:47:24.862592 15234 mini_oidc.cc:189] Starting OIDC Discovery server
I20260805 22:47:24.862769 15234 webserver.cc:460] Webserver started at http://127.0.0.1:34555/ using document root <none> and password file <none>
2026-08-05T22:47:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:47:24Z Disabled control of system clock
I20260805 22:47:24.871738 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785970021300824-15234-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785970021300824-15234-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785970021300824-15234-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:39057
--webserver_interface=127.14.224.190
--webserver_port=0
--builtin_ntp_servers=127.14.224.148:34283
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.224.190:39057
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35559/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785970021300824-15234-0/testchainca.cert with env {}
W20260805 22:47:24.954475 22592 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:24.954696 22592 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:24.954718 22592 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:24.955886 22592 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:47:24.955935 22592 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:24.955946 22592 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:24.955957 22592 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:47:24.955968 22592 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260805 22:47:24.955979 22592 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260805 22:47:24.955989 22592 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:35559/jwks.json
I20260805 22:47:24.957576 22592 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:34283
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785970021300824-15234-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785970021300824-15234-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.224.190:39057
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:39057
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35559/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.224.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785970021300824-15234-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22592
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785970021300824-15234-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:24.957790 22592 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:24.957983 22592 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:24.962908 22598 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:24.962957 22604 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:24.962932 22599 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:24.963258 22592 server_base.cc:1034] running on GCE node
I20260805 22:47:24.963569 22592 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:24.963891 22592 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:24.965039 22592 hybrid_clock.cc:648] HybridClock initialized: now 1785970044965023 us; error 32 us; skew 500 ppm
I20260805 22:47:24.966535 22592 webserver.cc:460] Webserver started at http://127.14.224.190:34683/ using document root <none> and password file <none>
I20260805 22:47:24.966810 22592 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:24.966861 22592 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:24.967002 22592 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:24.968201 22592 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785970021300824-15234-0/minicluster-data/master-0/data/instance:
uuid: "7aadb8d123fa40188a2401da776eb8db"
format_stamp: "Formatted at 2026-08-05 22:47:24 on dist-test-slave-gjrz"
server_key: "535e7acd5b269d979bccaaeb8e981bd9"
server_key_iv: "597af2af8da761ea7cd063a08e7b128e"
server_key_version: "encryptionkey@0"
I20260805 22:47:24.968617 22592 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785970021300824-15234-0/minicluster-data/master-0/wal/instance:
uuid: "7aadb8d123fa40188a2401da776eb8db"
format_stamp: "Formatted at 2026-08-05 22:47:24 on dist-test-slave-gjrz"
server_key: "535e7acd5b269d979bccaaeb8e981bd9"
server_key_iv: "597af2af8da761ea7cd063a08e7b128e"
server_key_version: "encryptionkey@0"
I20260805 22:47:24.970338 22592 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260805 22:47:24.971159 22623 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:24.971367 22592 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:47:24.971481 22592 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785970021300824-15234-0/minicluster-data/master-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785970021300824-15234-0/minicluster-data/master-0/wal
uuid: "7aadb8d123fa40188a2401da776eb8db"
format_stamp: "Formatted at 2026-08-05 22:47:24 on dist-test-slave-gjrz"
server_key: "535e7acd5b269d979bccaaeb8e981bd9"
server_key_iv: "597af2af8da761ea7cd063a08e7b128e"
server_key_version: "encryptionkey@0"
I20260805 22:47:24.971565 22592 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785970021300824-15234-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785970021300824-15234-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785970021300824-15234-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:24.985100 22592 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:24.985438 22592 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:24.985577 22592 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:24.989691 22592 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.190:39057
I20260805 22:47:24.989735 22695 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.190:39057 every 8 connection(s)
I20260805 22:47:24.990087 22592 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
I20260805 22:47:24.991066 22696 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:24.993571 22696 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7aadb8d123fa40188a2401da776eb8db: Bootstrap starting.
I20260805 22:47:24.994204 22696 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7aadb8d123fa40188a2401da776eb8db: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:24.994489 22696 log.cc:824] T 00000000000000000000000000000000 P 7aadb8d123fa40188a2401da776eb8db: Log is configured to *not* fsync() on all Append() calls
I20260805 22:47:24.995231 22696 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7aadb8d123fa40188a2401da776eb8db: No bootstrap required, opened a new log
I20260805 22:47:24.996479 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 22592
I20260805 22:47:24.996592 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785970021300824-15234-0/minicluster-data/master-0/wal/instance
I20260805 22:47:24.996762 15234 external_mini_cluster.cc:1428] Setting key 797450e7710cb7bdb1e680c1a4b231f3
I20260805 22:47:24.997006 22696 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7aadb8d123fa40188a2401da776eb8db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7aadb8d123fa40188a2401da776eb8db" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 39057 } }
I20260805 22:47:24.997190 22696 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7aadb8d123fa40188a2401da776eb8db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:24.997233 22696 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7aadb8d123fa40188a2401da776eb8db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7aadb8d123fa40188a2401da776eb8db, State: Initialized, Role: FOLLOWER
I20260805 22:47:24.997380 22696 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7aadb8d123fa40188a2401da776eb8db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7aadb8d123fa40188a2401da776eb8db" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 39057 } }
I20260805 22:47:24.997474 22696 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7aadb8d123fa40188a2401da776eb8db [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:47:24.997509 22696 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7aadb8d123fa40188a2401da776eb8db [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:47:24.997557 22696 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7aadb8d123fa40188a2401da776eb8db [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:24.998317 22696 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7aadb8d123fa40188a2401da776eb8db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7aadb8d123fa40188a2401da776eb8db" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 39057 } }
I20260805 22:47:24.998451 22696 leader_election.cc:302] T 00000000000000000000000000000000 P 7aadb8d123fa40188a2401da776eb8db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7aadb8d123fa40188a2401da776eb8db; no voters:
I20260805 22:47:24.998648 22696 leader_election.cc:288] T 00000000000000000000000000000000 P 7aadb8d123fa40188a2401da776eb8db [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:47:24.998696 22704 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7aadb8d123fa40188a2401da776eb8db [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:47:24.998840 22704 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7aadb8d123fa40188a2401da776eb8db [term 1 LEADER]: Becoming Leader. State: Replica: 7aadb8d123fa40188a2401da776eb8db, State: Running, Role: LEADER
I20260805 22:47:24.998904 22696 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7aadb8d123fa40188a2401da776eb8db [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:47:24.998935 22704 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7aadb8d123fa40188a2401da776eb8db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7aadb8d123fa40188a2401da776eb8db" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 39057 } }
I20260805 22:47:24.999305 22707 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7aadb8d123fa40188a2401da776eb8db [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7aadb8d123fa40188a2401da776eb8db" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7aadb8d123fa40188a2401da776eb8db" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 39057 } } }
I20260805 22:47:24.999396 22707 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7aadb8d123fa40188a2401da776eb8db [sys.catalog]: This master's current role is: LEADER
I20260805 22:47:24.999294 22704 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7aadb8d123fa40188a2401da776eb8db [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7aadb8d123fa40188a2401da776eb8db. Latest consensus state: current_term: 1 leader_uuid: "7aadb8d123fa40188a2401da776eb8db" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7aadb8d123fa40188a2401da776eb8db" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 39057 } } }
I20260805 22:47:24.999573 22704 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7aadb8d123fa40188a2401da776eb8db [sys.catalog]: This master's current role is: LEADER
I20260805 22:47:24.999697 22720 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:47:25.000465 22720 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:47:25.003070 22703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:24.997279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44716 (local address 127.14.224.190:39057)
0805 22:47:24.997515 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:24.997526 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:24.997560 (+ 34us) server_negotiation.cc:407] Connection header received
0805 22:47:24.997694 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:24.997702 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:24.997775 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:24.997930 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:24.998101 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:24.999945 (+ 1844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:25.001067 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:25.001556 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:25.001680 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:25.002437 (+ 757us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:25.002441 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:25.002441 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:47:25.002612 (+ 171us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:25.002646 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:47:25.002657 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:25.002720 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:25.002811 (+ 91us) server_negotiation.cc:299] Negotiation successful
0805 22:47:25.002895 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":91,"threads_started":1}
I20260805 22:47:25.004078 15234 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:47:25.007419 22720 catalog_manager.cc:1347] Generated new cluster ID: b77168d4327643ccb7d14bf635785dcb
I20260805 22:47:25.007486 22720 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:47:25.020650 22720 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:47:25.021207 22720 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:47:25.028800 22720 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7aadb8d123fa40188a2401da776eb8db: Generated new TSK 0
I20260805 22:47:25.029042 22720 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260805 22:47:25.060297 22749 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260805 22:47:25.060492 22749 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260805 22:47:25.060617 22703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:25.036991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44732 (local address 127.14.224.190:39057)
0805 22:47:25.037043 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:25.037046 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:25.037214 (+ 168us) server_negotiation.cc:407] Connection header received
0805 22:47:25.037335 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:25.037336 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:25.037348 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:25.037400 (+ 52us) server_negotiation.cc:226] Negotiated authn=JWT
0805 22:47:25.037558 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:25.038053 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:25.038815 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:25.039023 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:25.039079 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:25.039338 (+ 259us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0805 22:47:25.060307 (+ 20969us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35559/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0805 22:47:25.060545 (+ 238us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:44732: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35559/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":25}
W20260805 22:47:25.060693 22703 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:44732: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35559/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260805 22:47:25.061136 22748 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:47:25.036887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:39057 (local address 127.0.0.1:44732)
0805 22:47:25.037134 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:25.037145 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:25.037223 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:25.037416 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:25.037417 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:25.037427 (+ 10us) client_negotiation.cc:189] Negotiated authn=JWT
0805 22:47:25.037495 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:25.037497 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:25.038132 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:25.038133 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:25.038730 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:25.038731 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:25.039110 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:25.039111 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:25.039169 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:25.039194 (+ 25us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0805 22:47:25.060613 (+ 21419us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35559/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0805 22:47:25.060756 (+ 143us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.14.224.190:39057: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35559/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":100,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.14.224.190:39057: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35559/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260805 22:47:25.061700 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 22592
2026-08-05T22:47:25Z chronyd exiting
I20260805 22:47:25.105218 15234 test_util.cc:175] -----------------------------------------------
I20260805 22:47:25.105306 15234 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785970021300824-15234-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (245 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260805 22:47:25.106115 15234 mini_oidc.cc:152] Starting JWKS server
I20260805 22:47:25.106781 15234 webserver.cc:460] Webserver started at https://127.0.0.1:33045/ using document root <none> and password file <none>
I20260805 22:47:25.106822 15234 mini_oidc.cc:189] Starting OIDC Discovery server
I20260805 22:47:25.106941 15234 webserver.cc:460] Webserver started at http://127.0.0.1:45535/ using document root <none> and password file <none>
2026-08-05T22:47:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:47:25Z Disabled control of system clock
I20260805 22:47:25.115876 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785970021300824-15234-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785970021300824-15234-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785970021300824-15234-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:43925
--webserver_interface=127.14.224.190
--webserver_port=0
--builtin_ntp_servers=127.14.224.148:38043
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.224.190:43925
--enable_jwt_token_auth=true
--jwks_url=https://localhost:33045/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785970021300824-15234-0/testchainca.cert with env {}
W20260805 22:47:25.200572 22758 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:25.200805 22758 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:25.200839 22758 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:25.202099 22758 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:47:25.202147 22758 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:25.202164 22758 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:25.202180 22758 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:47:25.202195 22758 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260805 22:47:25.202221 22758 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260805 22:47:25.202243 22758 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:33045/jwks.json
I20260805 22:47:25.203940 22758 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:38043
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785970021300824-15234-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785970021300824-15234-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.224.190:43925
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:43925
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:33045/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.224.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785970021300824-15234-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22758
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785970021300824-15234-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:25.204216 22758 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:25.204422 22758 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:25.209748 22766 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:25.209769 22769 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:25.209787 22765 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:25.209794 22758 server_base.cc:1034] running on GCE node
I20260805 22:47:25.210199 22758 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:25.210546 22758 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:25.211704 22758 hybrid_clock.cc:648] HybridClock initialized: now 1785970045211685 us; error 37 us; skew 500 ppm
I20260805 22:47:25.213024 22758 webserver.cc:460] Webserver started at http://127.14.224.190:35199/ using document root <none> and password file <none>
I20260805 22:47:25.213264 22758 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:25.213320 22758 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:25.213456 22758 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:25.214617 22758 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785970021300824-15234-0/minicluster-data/master-0/data/instance:
uuid: "0dfa3cf3d52f472b9204cb2f4ec16e76"
format_stamp: "Formatted at 2026-08-05 22:47:25 on dist-test-slave-gjrz"
server_key: "62cbaaf33a241a909b72eac53767928d"
server_key_iv: "2b5e5257903773cf1a08fb7fc8fcb25a"
server_key_version: "encryptionkey@0"
I20260805 22:47:25.215075 22758 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785970021300824-15234-0/minicluster-data/master-0/wal/instance:
uuid: "0dfa3cf3d52f472b9204cb2f4ec16e76"
format_stamp: "Formatted at 2026-08-05 22:47:25 on dist-test-slave-gjrz"
server_key: "62cbaaf33a241a909b72eac53767928d"
server_key_iv: "2b5e5257903773cf1a08fb7fc8fcb25a"
server_key_version: "encryptionkey@0"
I20260805 22:47:25.216516 22758 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:47:25.217284 22781 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:25.217432 22758 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260805 22:47:25.217526 22758 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785970021300824-15234-0/minicluster-data/master-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785970021300824-15234-0/minicluster-data/master-0/wal
uuid: "0dfa3cf3d52f472b9204cb2f4ec16e76"
format_stamp: "Formatted at 2026-08-05 22:47:25 on dist-test-slave-gjrz"
server_key: "62cbaaf33a241a909b72eac53767928d"
server_key_iv: "2b5e5257903773cf1a08fb7fc8fcb25a"
server_key_version: "encryptionkey@0"
I20260805 22:47:25.217612 22758 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785970021300824-15234-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785970021300824-15234-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785970021300824-15234-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:25.239300 22758 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:25.239671 22758 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:25.239823 22758 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:25.243883 22758 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.190:43925
I20260805 22:47:25.243925 22859 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.190:43925 every 8 connection(s)
I20260805 22:47:25.244280 22758 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
I20260805 22:47:25.244999 22860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:25.247982 22860 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0dfa3cf3d52f472b9204cb2f4ec16e76: Bootstrap starting.
I20260805 22:47:25.248561 22860 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0dfa3cf3d52f472b9204cb2f4ec16e76: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:25.248807 22860 log.cc:824] T 00000000000000000000000000000000 P 0dfa3cf3d52f472b9204cb2f4ec16e76: Log is configured to *not* fsync() on all Append() calls
I20260805 22:47:25.249547 22860 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0dfa3cf3d52f472b9204cb2f4ec16e76: No bootstrap required, opened a new log
I20260805 22:47:25.250981 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 22758
I20260805 22:47:25.251096 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785970021300824-15234-0/minicluster-data/master-0/wal/instance
I20260805 22:47:25.251320 15234 external_mini_cluster.cc:1428] Setting key 48e180d9100e30bab158c0ef1d4db8a7
I20260805 22:47:25.251605 22860 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0dfa3cf3d52f472b9204cb2f4ec16e76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0dfa3cf3d52f472b9204cb2f4ec16e76" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 43925 } }
I20260805 22:47:25.251796 22860 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0dfa3cf3d52f472b9204cb2f4ec16e76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:25.251834 22860 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0dfa3cf3d52f472b9204cb2f4ec16e76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dfa3cf3d52f472b9204cb2f4ec16e76, State: Initialized, Role: FOLLOWER
I20260805 22:47:25.251979 22860 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0dfa3cf3d52f472b9204cb2f4ec16e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0dfa3cf3d52f472b9204cb2f4ec16e76" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 43925 } }
I20260805 22:47:25.252076 22860 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0dfa3cf3d52f472b9204cb2f4ec16e76 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:47:25.252110 22860 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0dfa3cf3d52f472b9204cb2f4ec16e76 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:47:25.252156 22860 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0dfa3cf3d52f472b9204cb2f4ec16e76 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:25.252955 22860 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0dfa3cf3d52f472b9204cb2f4ec16e76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0dfa3cf3d52f472b9204cb2f4ec16e76" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 43925 } }
I20260805 22:47:25.253077 22860 leader_election.cc:302] T 00000000000000000000000000000000 P 0dfa3cf3d52f472b9204cb2f4ec16e76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0dfa3cf3d52f472b9204cb2f4ec16e76; no voters:
I20260805 22:47:25.253237 22860 leader_election.cc:288] T 00000000000000000000000000000000 P 0dfa3cf3d52f472b9204cb2f4ec16e76 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:47:25.253520 22860 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0dfa3cf3d52f472b9204cb2f4ec16e76 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:47:25.253526 22866 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0dfa3cf3d52f472b9204cb2f4ec16e76 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:47:25.253731 22866 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0dfa3cf3d52f472b9204cb2f4ec16e76 [term 1 LEADER]: Becoming Leader. State: Replica: 0dfa3cf3d52f472b9204cb2f4ec16e76, State: Running, Role: LEADER
I20260805 22:47:25.253842 22866 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0dfa3cf3d52f472b9204cb2f4ec16e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0dfa3cf3d52f472b9204cb2f4ec16e76" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 43925 } }
I20260805 22:47:25.254218 22869 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0dfa3cf3d52f472b9204cb2f4ec16e76 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0dfa3cf3d52f472b9204cb2f4ec16e76" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0dfa3cf3d52f472b9204cb2f4ec16e76" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 43925 } } }
I20260805 22:47:25.254307 22869 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0dfa3cf3d52f472b9204cb2f4ec16e76 [sys.catalog]: This master's current role is: LEADER
I20260805 22:47:25.254223 22870 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0dfa3cf3d52f472b9204cb2f4ec16e76 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0dfa3cf3d52f472b9204cb2f4ec16e76. Latest consensus state: current_term: 1 leader_uuid: "0dfa3cf3d52f472b9204cb2f4ec16e76" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0dfa3cf3d52f472b9204cb2f4ec16e76" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 43925 } } }
I20260805 22:47:25.254513 22870 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0dfa3cf3d52f472b9204cb2f4ec16e76 [sys.catalog]: This master's current role is: LEADER
I20260805 22:47:25.254568 22880 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:47:25.255100 22880 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:47:25.256908 22880 catalog_manager.cc:1347] Generated new cluster ID: 43adc149c8254a40b6022a3852dfb882
I20260805 22:47:25.256968 22880 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:47:25.257675 22865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:25.251960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43064 (local address 127.14.224.190:43925)
0805 22:47:25.252247 (+ 287us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:25.252256 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:25.252288 (+ 32us) server_negotiation.cc:407] Connection header received
0805 22:47:25.252432 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:25.252439 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:25.252513 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:25.252675 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:25.252907 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:25.254298 (+ 1391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:25.255595 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:25.256109 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:25.256234 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:25.256956 (+ 722us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:25.256960 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:25.256960 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:47:25.257159 (+ 199us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:25.257203 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:47:25.257218 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:25.257287 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:25.257371 (+ 84us) server_negotiation.cc:299] Negotiation successful
0805 22:47:25.257466 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":201,"thread_start_us":101,"threads_started":1}
I20260805 22:47:25.258679 15234 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:47:25.271903 22880 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:47:25.272461 22880 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:47:25.277074 22880 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0dfa3cf3d52f472b9204cb2f4ec16e76: Generated new TSK 0
I20260805 22:47:25.277293 22880 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260805 22:47:25.300606 22905 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260805 22:47:25.300709 22905 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260805 22:47:25.301085 22865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:25.287032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43076 (local address 127.14.224.190:43925)
0805 22:47:25.287078 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:25.287080 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:25.287232 (+ 152us) server_negotiation.cc:407] Connection header received
0805 22:47:25.287343 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:25.287344 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:25.287356 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:25.287420 (+ 64us) server_negotiation.cc:226] Negotiated authn=JWT
0805 22:47:25.287550 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:25.288073 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:25.288840 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:25.289048 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:25.289104 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:25.289289 (+ 185us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0805 22:47:25.300844 (+ 11555us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33045/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0805 22:47:25.301012 (+ 168us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:43076: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33045/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":22}
W20260805 22:47:25.301156 22865 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:43076: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33045/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260805 22:47:25.301188 22902 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:47:25.286990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:43925 (local address 127.0.0.1:43076)
0805 22:47:25.287164 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:25.287174 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:25.287238 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:25.287423 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:25.287424 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:25.287426 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0805 22:47:25.287488 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:25.287490 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:25.288158 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:25.288159 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:25.288757 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:25.288758 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:25.289123 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:25.289124 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:25.289187 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:25.289192 (+ 5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0805 22:47:25.300966 (+ 11774us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33045/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0805 22:47:25.301096 (+ 130us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.14.224.190:43925: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33045/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":93,"threads_started":1}
I20260805 22:47:25.301667 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 22758
2026-08-05T22:47:25Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (240 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260805 22:47:25.346910 15234 mini_oidc.cc:152] Starting JWKS server
I20260805 22:47:25.347697 15234 webserver.cc:460] Webserver started at https://127.0.0.1:45147/ using document root <none> and password file <none>
I20260805 22:47:25.347745 15234 mini_oidc.cc:189] Starting OIDC Discovery server
I20260805 22:47:25.347882 15234 webserver.cc:460] Webserver started at http://127.0.0.1:45337/ using document root <none> and password file <none>
2026-08-05T22:47:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:47:25Z Disabled control of system clock
I20260805 22:47:25.357046 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785970021300824-15234-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785970021300824-15234-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785970021300824-15234-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:39581
--webserver_interface=127.14.224.190
--webserver_port=0
--builtin_ntp_servers=127.14.224.148:42873
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.224.190:39581
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45147/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260805 22:47:25.439991 22914 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:25.440225 22914 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:25.440248 22914 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:25.441428 22914 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:47:25.441466 22914 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:25.441478 22914 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:25.441488 22914 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:47:25.441499 22914 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260805 22:47:25.441510 22914 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260805 22:47:25.441519 22914 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:45147/jwks.json
I20260805 22:47:25.442937 22914 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:42873
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785970021300824-15234-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785970021300824-15234-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.224.190:39581
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:39581
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45147/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.224.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22914
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785970021300824-15234-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:25.443181 22914 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:25.443485 22914 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260805 22:47:25.448535 22914 server_base.cc:1034] running on GCE node
W20260805 22:47:25.448498 22922 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:25.448484 22924 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:25.448498 22921 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:25.449040 22914 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:25.449365 22914 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:25.450515 22914 hybrid_clock.cc:648] HybridClock initialized: now 1785970045450499 us; error 38 us; skew 500 ppm
I20260805 22:47:25.451915 22914 webserver.cc:460] Webserver started at http://127.14.224.190:44535/ using document root <none> and password file <none>
I20260805 22:47:25.452200 22914 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:25.452252 22914 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:25.452358 22914 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:25.453455 22914 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785970021300824-15234-0/minicluster-data/master-0/data/instance:
uuid: "3656fc89d0a54338a9b0ed88f676837f"
format_stamp: "Formatted at 2026-08-05 22:47:25 on dist-test-slave-gjrz"
server_key: "60f285d06929d5a0f9793357951f5e99"
server_key_iv: "d2e81b43980e12d6efb2169c3e6f9c18"
server_key_version: "encryptionkey@0"
I20260805 22:47:25.453785 22914 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785970021300824-15234-0/minicluster-data/master-0/wal/instance:
uuid: "3656fc89d0a54338a9b0ed88f676837f"
format_stamp: "Formatted at 2026-08-05 22:47:25 on dist-test-slave-gjrz"
server_key: "60f285d06929d5a0f9793357951f5e99"
server_key_iv: "d2e81b43980e12d6efb2169c3e6f9c18"
server_key_version: "encryptionkey@0"
I20260805 22:47:25.455096 22914 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260805 22:47:25.455910 22931 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:25.456117 22914 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:47:25.456213 22914 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785970021300824-15234-0/minicluster-data/master-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785970021300824-15234-0/minicluster-data/master-0/wal
uuid: "3656fc89d0a54338a9b0ed88f676837f"
format_stamp: "Formatted at 2026-08-05 22:47:25 on dist-test-slave-gjrz"
server_key: "60f285d06929d5a0f9793357951f5e99"
server_key_iv: "d2e81b43980e12d6efb2169c3e6f9c18"
server_key_version: "encryptionkey@0"
I20260805 22:47:25.456291 22914 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785970021300824-15234-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785970021300824-15234-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785970021300824-15234-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:25.472244 22914 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:25.472595 22914 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:25.472731 22914 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:25.476876 22914 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.190:39581
I20260805 22:47:25.476922 23000 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.190:39581 every 8 connection(s)
I20260805 22:47:25.477274 22914 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
I20260805 22:47:25.477959 23001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:25.480930 23001 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3656fc89d0a54338a9b0ed88f676837f: Bootstrap starting.
I20260805 22:47:25.481539 23001 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3656fc89d0a54338a9b0ed88f676837f: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:25.481789 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 22914
I20260805 22:47:25.481832 23001 log.cc:824] T 00000000000000000000000000000000 P 3656fc89d0a54338a9b0ed88f676837f: Log is configured to *not* fsync() on all Append() calls
I20260805 22:47:25.481899 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785970021300824-15234-0/minicluster-data/master-0/wal/instance
I20260805 22:47:25.482072 15234 external_mini_cluster.cc:1428] Setting key 4ad8affa4303ff8ad353197dbf3574b3
I20260805 22:47:25.482740 23001 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3656fc89d0a54338a9b0ed88f676837f: No bootstrap required, opened a new log
I20260805 22:47:25.485456 23001 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3656fc89d0a54338a9b0ed88f676837f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3656fc89d0a54338a9b0ed88f676837f" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 39581 } }
I20260805 22:47:25.485656 23001 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3656fc89d0a54338a9b0ed88f676837f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:25.485688 23001 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3656fc89d0a54338a9b0ed88f676837f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3656fc89d0a54338a9b0ed88f676837f, State: Initialized, Role: FOLLOWER
I20260805 22:47:25.485814 23001 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3656fc89d0a54338a9b0ed88f676837f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3656fc89d0a54338a9b0ed88f676837f" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 39581 } }
I20260805 22:47:25.485888 23001 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3656fc89d0a54338a9b0ed88f676837f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:47:25.485930 23001 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3656fc89d0a54338a9b0ed88f676837f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:47:25.485973 23001 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3656fc89d0a54338a9b0ed88f676837f [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:25.486596 23001 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3656fc89d0a54338a9b0ed88f676837f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3656fc89d0a54338a9b0ed88f676837f" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 39581 } }
I20260805 22:47:25.486713 23001 leader_election.cc:302] T 00000000000000000000000000000000 P 3656fc89d0a54338a9b0ed88f676837f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3656fc89d0a54338a9b0ed88f676837f; no voters:
I20260805 22:47:25.486884 23001 leader_election.cc:288] T 00000000000000000000000000000000 P 3656fc89d0a54338a9b0ed88f676837f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:47:25.486931 23008 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3656fc89d0a54338a9b0ed88f676837f [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:47:25.487102 23008 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3656fc89d0a54338a9b0ed88f676837f [term 1 LEADER]: Becoming Leader. State: Replica: 3656fc89d0a54338a9b0ed88f676837f, State: Running, Role: LEADER
I20260805 22:47:25.487154 23001 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3656fc89d0a54338a9b0ed88f676837f [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:47:25.487205 23008 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3656fc89d0a54338a9b0ed88f676837f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3656fc89d0a54338a9b0ed88f676837f" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 39581 } }
I20260805 22:47:25.487588 23008 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3656fc89d0a54338a9b0ed88f676837f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3656fc89d0a54338a9b0ed88f676837f. Latest consensus state: current_term: 1 leader_uuid: "3656fc89d0a54338a9b0ed88f676837f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3656fc89d0a54338a9b0ed88f676837f" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 39581 } } }
I20260805 22:47:25.487670 23008 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3656fc89d0a54338a9b0ed88f676837f [sys.catalog]: This master's current role is: LEADER
I20260805 22:47:25.487897 23019 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:47:25.489048 23007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:25.482606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45838 (local address 127.14.224.190:39581)
0805 22:47:25.482846 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:25.482856 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:25.482895 (+ 39us) server_negotiation.cc:407] Connection header received
0805 22:47:25.484026 (+ 1131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:25.484037 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:25.484123 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:25.484283 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:25.484463 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:25.485824 (+ 1361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:25.486650 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:25.487304 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:25.487500 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:25.488265 (+ 765us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:25.488270 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:25.488270 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:47:25.488486 (+ 216us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:25.488532 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:47:25.488547 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:25.488610 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:25.488736 (+ 126us) server_negotiation.cc:299] Negotiation successful
0805 22:47:25.488824 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":100,"threads_started":1}
I20260805 22:47:25.489454 23019 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:47:25.489387 23011 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3656fc89d0a54338a9b0ed88f676837f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3656fc89d0a54338a9b0ed88f676837f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3656fc89d0a54338a9b0ed88f676837f" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 39581 } } }
I20260805 22:47:25.489971 23011 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3656fc89d0a54338a9b0ed88f676837f [sys.catalog]: This master's current role is: LEADER
I20260805 22:47:25.490002 15234 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:47:25.492130 23019 catalog_manager.cc:1347] Generated new cluster ID: af93b93d2bb9410699f3a5ac7f61fc61
I20260805 22:47:25.492209 23019 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:47:25.505141 23019 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:47:25.505852 23019 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:47:25.530730 23019 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3656fc89d0a54338a9b0ed88f676837f: Generated new TSK 0
I20260805 22:47:25.530987 23019 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:47:25.540694 23007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:25.537250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45840 (local address 127.14.224.190:39581)
0805 22:47:25.537313 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:25.537315 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:25.537418 (+ 103us) server_negotiation.cc:407] Connection header received
0805 22:47:25.537509 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:25.537510 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:25.537525 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:25.537596 (+ 71us) server_negotiation.cc:226] Negotiated authn=JWT
0805 22:47:25.537768 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:25.538291 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:25.539076 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:25.539340 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:25.539399 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:25.539594 (+ 195us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0805 22:47:25.540472 (+ 878us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45147/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0805 22:47:25.540607 (+ 135us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:45840: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45147/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":34}
W20260805 22:47:25.540760 23045 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:47:25.537187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:39581 (local address 127.0.0.1:45840)
0805 22:47:25.537353 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:25.537363 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:25.537428 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:25.537608 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:25.537609 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:25.537611 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0805 22:47:25.537686 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:25.537689 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:25.538386 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:25.538387 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:25.538992 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:25.538994 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:25.539420 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:25.539421 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:25.539484 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:25.539490 (+ 6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0805 22:47:25.540573 (+ 1083us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45147/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0805 22:47:25.540674 (+ 101us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.14.224.190:39581: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45147/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":89,"threads_started":1}
W20260805 22:47:25.540772 23007 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:45840: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45147/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
I20260805 22:47:25.541005 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 22914
E20260805 22:47:25.554728 23047 webserver.cc:533] Webserver: sslize failed:
E20260805 22:47:25.554842 23047 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-05T22:47:25Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (241 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-05T22:47:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:47:25Z Disabled control of system clock
I20260805 22:47:25.596812 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785970021300824-15234-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785970021300824-15234-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785970021300824-15234-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:44977
--webserver_interface=127.14.224.190
--webserver_port=0
--builtin_ntp_servers=127.14.224.148:38523
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.224.190:44977
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785970021300824-15234-0/testchainca.cert with env {}
W20260805 22:47:25.681336 23052 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:25.681569 23052 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:25.681592 23052 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:25.682838 23052 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:47:25.682890 23052 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:25.682901 23052 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:25.682914 23052 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:47:25.682937 23052 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260805 22:47:25.682962 23052 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260805 22:47:25.682986 23052 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260805 22:47:25.684653 23052 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:38523
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785970021300824-15234-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785970021300824-15234-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.224.190:44977
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:44977
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.224.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785970021300824-15234-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23052
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785970021300824-15234-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:25.684927 23052 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:25.685163 23052 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:25.690225 23063 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:25.690325 23062 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:25.690452 23052 server_base.cc:1034] running on GCE node
W20260805 22:47:25.690553 23067 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:25.690799 23052 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:25.691102 23052 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:25.692261 23052 hybrid_clock.cc:648] HybridClock initialized: now 1785970045692245 us; error 36 us; skew 500 ppm
I20260805 22:47:25.693657 23052 webserver.cc:460] Webserver started at http://127.14.224.190:43641/ using document root <none> and password file <none>
I20260805 22:47:25.693883 23052 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:25.693934 23052 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:25.694063 23052 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:25.695144 23052 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785970021300824-15234-0/minicluster-data/master-0/data/instance:
uuid: "182fc12a66224a8b80bdd7610e9df786"
format_stamp: "Formatted at 2026-08-05 22:47:25 on dist-test-slave-gjrz"
server_key: "425870d2c06aa7829d30d64821ced148"
server_key_iv: "222b24716efa9b589f41b3b7486471b6"
server_key_version: "encryptionkey@0"
I20260805 22:47:25.695542 23052 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785970021300824-15234-0/minicluster-data/master-0/wal/instance:
uuid: "182fc12a66224a8b80bdd7610e9df786"
format_stamp: "Formatted at 2026-08-05 22:47:25 on dist-test-slave-gjrz"
server_key: "425870d2c06aa7829d30d64821ced148"
server_key_iv: "222b24716efa9b589f41b3b7486471b6"
server_key_version: "encryptionkey@0"
I20260805 22:47:25.696862 23052 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:47:25.697559 23075 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:25.697703 23052 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260805 22:47:25.697793 23052 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785970021300824-15234-0/minicluster-data/master-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785970021300824-15234-0/minicluster-data/master-0/wal
uuid: "182fc12a66224a8b80bdd7610e9df786"
format_stamp: "Formatted at 2026-08-05 22:47:25 on dist-test-slave-gjrz"
server_key: "425870d2c06aa7829d30d64821ced148"
server_key_iv: "222b24716efa9b589f41b3b7486471b6"
server_key_version: "encryptionkey@0"
I20260805 22:47:25.697865 23052 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785970021300824-15234-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785970021300824-15234-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785970021300824-15234-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:25.708359 23052 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:25.708716 23052 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:25.708855 23052 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:25.712808 23052 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.190:44977
I20260805 22:47:25.712859 23156 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.190:44977 every 8 connection(s)
I20260805 22:47:25.713193 23052 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
I20260805 22:47:25.714175 23157 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:25.716696 23157 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 182fc12a66224a8b80bdd7610e9df786: Bootstrap starting.
I20260805 22:47:25.717314 23157 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 182fc12a66224a8b80bdd7610e9df786: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:25.717593 23157 log.cc:824] T 00000000000000000000000000000000 P 182fc12a66224a8b80bdd7610e9df786: Log is configured to *not* fsync() on all Append() calls
I20260805 22:47:25.718290 23157 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 182fc12a66224a8b80bdd7610e9df786: No bootstrap required, opened a new log
I20260805 22:47:25.720042 23157 raft_consensus.cc:348] T 00000000000000000000000000000000 P 182fc12a66224a8b80bdd7610e9df786 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "182fc12a66224a8b80bdd7610e9df786" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 44977 } }
I20260805 22:47:25.720196 23157 raft_consensus.cc:374] T 00000000000000000000000000000000 P 182fc12a66224a8b80bdd7610e9df786 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:25.720218 23157 raft_consensus.cc:729] T 00000000000000000000000000000000 P 182fc12a66224a8b80bdd7610e9df786 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 182fc12a66224a8b80bdd7610e9df786, State: Initialized, Role: FOLLOWER
I20260805 22:47:25.720366 23157 consensus_queue.cc:260] T 00000000000000000000000000000000 P 182fc12a66224a8b80bdd7610e9df786 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "182fc12a66224a8b80bdd7610e9df786" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 44977 } }
I20260805 22:47:25.720438 23157 raft_consensus.cc:388] T 00000000000000000000000000000000 P 182fc12a66224a8b80bdd7610e9df786 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:47:25.720463 23157 raft_consensus.cc:482] T 00000000000000000000000000000000 P 182fc12a66224a8b80bdd7610e9df786 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:47:25.720510 23157 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 182fc12a66224a8b80bdd7610e9df786 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:25.721071 23157 raft_consensus.cc:504] T 00000000000000000000000000000000 P 182fc12a66224a8b80bdd7610e9df786 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "182fc12a66224a8b80bdd7610e9df786" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 44977 } }
I20260805 22:47:25.721174 23157 leader_election.cc:302] T 00000000000000000000000000000000 P 182fc12a66224a8b80bdd7610e9df786 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 182fc12a66224a8b80bdd7610e9df786; no voters:
I20260805 22:47:25.721347 23157 leader_election.cc:288] T 00000000000000000000000000000000 P 182fc12a66224a8b80bdd7610e9df786 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:47:25.721401 23162 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 182fc12a66224a8b80bdd7610e9df786 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:47:25.721568 23162 raft_consensus.cc:686] T 00000000000000000000000000000000 P 182fc12a66224a8b80bdd7610e9df786 [term 1 LEADER]: Becoming Leader. State: Replica: 182fc12a66224a8b80bdd7610e9df786, State: Running, Role: LEADER
I20260805 22:47:25.721640 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 23052
I20260805 22:47:25.721647 23157 sys_catalog.cc:564] T 00000000000000000000000000000000 P 182fc12a66224a8b80bdd7610e9df786 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:47:25.721683 23162 consensus_queue.cc:237] T 00000000000000000000000000000000 P 182fc12a66224a8b80bdd7610e9df786 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "182fc12a66224a8b80bdd7610e9df786" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 44977 } }
I20260805 22:47:25.721726 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785970021300824-15234-0/minicluster-data/master-0/wal/instance
I20260805 22:47:25.721947 15234 external_mini_cluster.cc:1428] Setting key 68725af8ea408da8b71afc620be4fb62
I20260805 22:47:25.722121 23166 sys_catalog.cc:455] T 00000000000000000000000000000000 P 182fc12a66224a8b80bdd7610e9df786 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 182fc12a66224a8b80bdd7610e9df786. Latest consensus state: current_term: 1 leader_uuid: "182fc12a66224a8b80bdd7610e9df786" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "182fc12a66224a8b80bdd7610e9df786" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 44977 } } }
I20260805 22:47:25.722205 23165 sys_catalog.cc:455] T 00000000000000000000000000000000 P 182fc12a66224a8b80bdd7610e9df786 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "182fc12a66224a8b80bdd7610e9df786" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "182fc12a66224a8b80bdd7610e9df786" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 44977 } } }
I20260805 22:47:25.722260 23165 sys_catalog.cc:458] T 00000000000000000000000000000000 P 182fc12a66224a8b80bdd7610e9df786 [sys.catalog]: This master's current role is: LEADER
I20260805 22:47:25.722203 23166 sys_catalog.cc:458] T 00000000000000000000000000000000 P 182fc12a66224a8b80bdd7610e9df786 [sys.catalog]: This master's current role is: LEADER
I20260805 22:47:25.722752 23174 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:47:25.723510 23174 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:47:25.725225 23174 catalog_manager.cc:1347] Generated new cluster ID: e8a343327e3b49d3856725b98b4c4b21
I20260805 22:47:25.725281 23174 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:47:25.728264 23177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:25.722610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39184 (local address 127.14.224.190:44977)
0805 22:47:25.722873 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:25.722883 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:25.722914 (+ 31us) server_negotiation.cc:407] Connection header received
0805 22:47:25.723046 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:25.723053 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:25.723128 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:25.723573 (+ 445us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:25.723814 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:25.724977 (+ 1163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:25.726099 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:25.726712 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:25.726824 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:25.727561 (+ 737us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:25.727565 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:25.727565 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:47:25.727765 (+ 200us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:25.727806 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:47:25.727819 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:25.727879 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:25.727969 (+ 90us) server_negotiation.cc:299] Negotiation successful
0805 22:47:25.728053 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":182,"thread_start_us":88,"threads_started":1}
I20260805 22:47:25.732357 15234 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:47:25.735831 23174 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:47:25.736735 23174 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:47:25.744622 23174 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 182fc12a66224a8b80bdd7610e9df786: Generated new TSK 0
I20260805 22:47:25.744936 23174 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:47:25.765404 23177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:25.755787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39200 (local address 127.14.224.190:44977)
0805 22:47:25.755840 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:25.755842 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:25.755952 (+ 110us) server_negotiation.cc:407] Connection header received
0805 22:47:25.756048 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:25.756049 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:25.756074 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:25.756132 (+ 58us) server_negotiation.cc:226] Negotiated authn=JWT
0805 22:47:25.756270 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:25.756769 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:25.757543 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:25.757746 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:25.757803 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:25.757981 (+ 178us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0805 22:47:25.765119 (+ 7138us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0805 22:47:25.765318 (+ 199us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:39200: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":28}
W20260805 22:47:25.765482 23177 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:39200: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260805 22:47:25.765523 23194 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:47:25.755739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:44977 (local address 127.0.0.1:39200)
0805 22:47:25.755885 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:25.755895 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:25.755960 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:25.756137 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:25.756138 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:25.756141 (+ 3us) client_negotiation.cc:189] Negotiated authn=JWT
0805 22:47:25.756203 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:25.756206 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:25.756852 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:25.756853 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:25.757455 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:25.757456 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:25.757815 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:25.757815 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:25.757875 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:25.757881 (+ 6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0805 22:47:25.765260 (+ 7379us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0805 22:47:25.765409 (+ 149us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.14.224.190:44977: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":91,"threads_started":1}
I20260805 22:47:25.765726 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 23052
2026-08-05T22:47:25Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (201 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (94 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (92 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:47:26 dist-test-slave-gjrz krb5kdc[23212](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:47:26 dist-test-slave-gjrz krb5kdc[23212](info): set up 2 sockets
Aug 05 22:47:26 dist-test-slave-gjrz krb5kdc[23212](info): commencing operation
krb5kdc: starting...
W20260805 22:47:27.086014 15234 mini_kdc.cc:121] Time spent starting KDC: real 1.109s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Aug 05 22:47:27 dist-test-slave-gjrz krb5kdc[23212](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970047, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:47:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:47:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.224.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab.
Entry for principal kudu/127.14.224.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab.
I20260805 22:47:27.216415 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:36335
--webserver_interface=127.14.224.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:40419
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.224.190:36335
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:47:27.300822 23230 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:27.301059 23230 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:27.301084 23230 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:27.302399 23230 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:47:27.302454 23230 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:27.302467 23230 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:27.302479 23230 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:47:27.302492 23230 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:47:27.304140 23230 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:40419
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.224.190:36335
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:36335
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.224.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23230
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:27.304425 23230 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:27.304654 23230 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260805 22:47:27.309808 23230 server_base.cc:1034] running on GCE node
W20260805 22:47:27.309774 23238 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:27.309799 23239 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:27.309928 23241 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:27.310248 23230 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:27.310561 23230 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:27.311715 23230 hybrid_clock.cc:648] HybridClock initialized: now 1785970047311697 us; error 30 us; skew 500 ppm
Aug 05 22:47:27 dist-test-slave-gjrz krb5kdc[23212](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970047, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:27.314265 23230 init.cc:377] Logged in from keytab as kudu/127.14.224.190@KRBTEST.COM (short username kudu)
I20260805 22:47:27.314752 23230 webserver.cc:460] Webserver started at http://127.14.224.190:45653/ using document root <none> and password file <none>
I20260805 22:47:27.314956 23230 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:27.314999 23230 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:27.315091 23230 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:27.316220 23230 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/minicluster-data/master-0/data/instance:
uuid: "eaee04a46ded401ebe0856e79e97fdd5"
format_stamp: "Formatted at 2026-08-05 22:47:27 on dist-test-slave-gjrz"
server_key: "45b89f8a3c4c5546ae547171920c3e5d"
server_key_iv: "93685c37aa1ba8b9c55cb18842e69548"
server_key_version: "encryptionkey@0"
I20260805 22:47:27.316537 23230 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/minicluster-data/master-0/wal/instance:
uuid: "eaee04a46ded401ebe0856e79e97fdd5"
format_stamp: "Formatted at 2026-08-05 22:47:27 on dist-test-slave-gjrz"
server_key: "45b89f8a3c4c5546ae547171920c3e5d"
server_key_iv: "93685c37aa1ba8b9c55cb18842e69548"
server_key_version: "encryptionkey@0"
I20260805 22:47:27.317848 23230 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260805 22:47:27.318641 23256 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:27.318847 23230 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:47:27.318972 23230 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/minicluster-data/master-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/minicluster-data/master-0/wal
uuid: "eaee04a46ded401ebe0856e79e97fdd5"
format_stamp: "Formatted at 2026-08-05 22:47:27 on dist-test-slave-gjrz"
server_key: "45b89f8a3c4c5546ae547171920c3e5d"
server_key_iv: "93685c37aa1ba8b9c55cb18842e69548"
server_key_version: "encryptionkey@0"
I20260805 22:47:27.319037 23230 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:27.338389 23230 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:27.340704 23230 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:27.340830 23230 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:27.344767 23230 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.190:36335
I20260805 22:47:27.344836 23324 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.190:36335 every 8 connection(s)
I20260805 22:47:27.345158 23230 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
I20260805 22:47:27.346208 23327 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:27.348784 23327 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eaee04a46ded401ebe0856e79e97fdd5: Bootstrap starting.
I20260805 22:47:27.349390 23327 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eaee04a46ded401ebe0856e79e97fdd5: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:27.349654 23327 log.cc:824] T 00000000000000000000000000000000 P eaee04a46ded401ebe0856e79e97fdd5: Log is configured to *not* fsync() on all Append() calls
I20260805 22:47:27.350416 23327 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eaee04a46ded401ebe0856e79e97fdd5: No bootstrap required, opened a new log
I20260805 22:47:27.352211 23327 raft_consensus.cc:348] T 00000000000000000000000000000000 P eaee04a46ded401ebe0856e79e97fdd5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eaee04a46ded401ebe0856e79e97fdd5" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 36335 } }
I20260805 22:47:27.352376 23327 raft_consensus.cc:374] T 00000000000000000000000000000000 P eaee04a46ded401ebe0856e79e97fdd5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:27.352399 23327 raft_consensus.cc:729] T 00000000000000000000000000000000 P eaee04a46ded401ebe0856e79e97fdd5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaee04a46ded401ebe0856e79e97fdd5, State: Initialized, Role: FOLLOWER
I20260805 22:47:27.352388 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 23230
I20260805 22:47:27.352504 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/minicluster-data/master-0/wal/instance
I20260805 22:47:27.352546 23327 consensus_queue.cc:260] T 00000000000000000000000000000000 P eaee04a46ded401ebe0856e79e97fdd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eaee04a46ded401ebe0856e79e97fdd5" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 36335 } }
I20260805 22:47:27.352622 23327 raft_consensus.cc:388] T 00000000000000000000000000000000 P eaee04a46ded401ebe0856e79e97fdd5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:47:27.352661 23327 raft_consensus.cc:482] T 00000000000000000000000000000000 P eaee04a46ded401ebe0856e79e97fdd5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:47:27.352703 15234 external_mini_cluster.cc:1428] Setting key 6f92b5a016667f6c847e5b5bb8261477
I20260805 22:47:27.352712 23327 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eaee04a46ded401ebe0856e79e97fdd5 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:27.353437 23327 raft_consensus.cc:504] T 00000000000000000000000000000000 P eaee04a46ded401ebe0856e79e97fdd5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eaee04a46ded401ebe0856e79e97fdd5" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 36335 } }
I20260805 22:47:27.353549 23327 leader_election.cc:302] T 00000000000000000000000000000000 P eaee04a46ded401ebe0856e79e97fdd5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eaee04a46ded401ebe0856e79e97fdd5; no voters:
I20260805 22:47:27.353755 23327 leader_election.cc:288] T 00000000000000000000000000000000 P eaee04a46ded401ebe0856e79e97fdd5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:47:27.353796 23335 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eaee04a46ded401ebe0856e79e97fdd5 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:47:27.353925 23335 raft_consensus.cc:686] T 00000000000000000000000000000000 P eaee04a46ded401ebe0856e79e97fdd5 [term 1 LEADER]: Becoming Leader. State: Replica: eaee04a46ded401ebe0856e79e97fdd5, State: Running, Role: LEADER
I20260805 22:47:27.354031 23327 sys_catalog.cc:564] T 00000000000000000000000000000000 P eaee04a46ded401ebe0856e79e97fdd5 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:47:27.354056 23335 consensus_queue.cc:237] T 00000000000000000000000000000000 P eaee04a46ded401ebe0856e79e97fdd5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eaee04a46ded401ebe0856e79e97fdd5" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 36335 } }
I20260805 22:47:27.354493 23338 sys_catalog.cc:455] T 00000000000000000000000000000000 P eaee04a46ded401ebe0856e79e97fdd5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eaee04a46ded401ebe0856e79e97fdd5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eaee04a46ded401ebe0856e79e97fdd5" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 36335 } } }
I20260805 22:47:27.354578 23338 sys_catalog.cc:458] T 00000000000000000000000000000000 P eaee04a46ded401ebe0856e79e97fdd5 [sys.catalog]: This master's current role is: LEADER
I20260805 22:47:27.354753 23341 sys_catalog.cc:455] T 00000000000000000000000000000000 P eaee04a46ded401ebe0856e79e97fdd5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader eaee04a46ded401ebe0856e79e97fdd5. Latest consensus state: current_term: 1 leader_uuid: "eaee04a46ded401ebe0856e79e97fdd5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eaee04a46ded401ebe0856e79e97fdd5" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 36335 } } }
I20260805 22:47:27.354827 23341 sys_catalog.cc:458] T 00000000000000000000000000000000 P eaee04a46ded401ebe0856e79e97fdd5 [sys.catalog]: This master's current role is: LEADER
W20260805 22:47:27.356067 23362 catalog_manager.cc:1558] T 00000000000000000000000000000000 P eaee04a46ded401ebe0856e79e97fdd5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260805 22:47:27.356122 23362 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260805 22:47:27.356166 23351 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:47:27.356318 23351 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:47:27.357939 23351 catalog_manager.cc:1347] Generated new cluster ID: e3c6b2bfac9b41119c4cab95d678339e
I20260805 22:47:27.358000 23351 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 05 22:47:27 dist-test-slave-gjrz krb5kdc[23212](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970047, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:47:27.366747 23333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:27.353529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58004 (local address 127.14.224.190:36335)
0805 22:47:27.353761 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:27.353772 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:27.353811 (+ 39us) server_negotiation.cc:407] Connection header received
0805 22:47:27.353947 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:27.353955 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:27.354017 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:27.355037 (+ 1020us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:27.355184 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:27.356631 (+ 1447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:27.357515 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:27.359636 (+ 2121us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:27.359786 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:27.362771 (+ 2985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:27.362778 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:27.362779 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:27.362794 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:27.364860 (+ 2066us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:27.365321 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:27.365325 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:27.365325 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:27.365471 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:27.365700 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:27.365701 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:27.365701 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:27.366057 (+ 356us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:27.366234 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:27.366309 (+ 75us) server_negotiation.cc:299] Negotiation successful
0805 22:47:27.366478 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":172,"thread_start_us":130,"threads_started":1}
I20260805 22:47:27.369153 23351 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:47:27.369910 23351 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:47:27.382619 23351 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eaee04a46ded401ebe0856e79e97fdd5: Generated new TSK 0
I20260805 22:47:27.382865 23351 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.224.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab.
Entry for principal kudu/127.14.224.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab.
I20260805 22:47:27.413746 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.129:0
--local_ip_for_outbound_sockets=127.14.224.129
--webserver_interface=127.14.224.129
--webserver_port=0
--tserver_master_addrs=127.14.224.190:36335
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab
--principal=kudu/127.14.224.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:40419
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:47:27.502776 23369 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:27.503010 23369 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:27.503036 23369 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:27.504350 23369 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:27.504403 23369 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:27.504431 23369 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.129
I20260805 22:47:27.506062 23369 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:40419
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab
--principal=kudu/127.14.224.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.224.129
--webserver_port=0
--tserver_master_addrs=127.14.224.190:36335
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23369
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.129
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:27.506315 23369 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:27.506551 23369 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:27.511776 23383 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:27.511893 23369 server_base.cc:1034] running on GCE node
W20260805 22:47:27.511788 23380 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:27.511797 23381 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:27.512207 23369 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:27.512461 23369 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:27.513605 23369 hybrid_clock.cc:648] HybridClock initialized: now 1785970047513586 us; error 40 us; skew 500 ppm
Aug 05 22:47:27 dist-test-slave-gjrz krb5kdc[23212](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970047, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:27.516185 23369 init.cc:377] Logged in from keytab as kudu/127.14.224.129@KRBTEST.COM (short username kudu)
I20260805 22:47:27.516639 23369 webserver.cc:460] Webserver started at http://127.14.224.129:44231/ using document root <none> and password file <none>
I20260805 22:47:27.516845 23369 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:27.516896 23369 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:27.517026 23369 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:27.518086 23369 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/minicluster-data/ts-0/data/instance:
uuid: "4fdf99d7a46e44d4b765749b14fd78cc"
format_stamp: "Formatted at 2026-08-05 22:47:27 on dist-test-slave-gjrz"
server_key: "f29403b3cafd8146ae007b3626b3ab92"
server_key_iv: "070a7dad634bd6b2b4d72a91db0f83e5"
server_key_version: "encryptionkey@0"
I20260805 22:47:27.518428 23369 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/minicluster-data/ts-0/wal/instance:
uuid: "4fdf99d7a46e44d4b765749b14fd78cc"
format_stamp: "Formatted at 2026-08-05 22:47:27 on dist-test-slave-gjrz"
server_key: "f29403b3cafd8146ae007b3626b3ab92"
server_key_iv: "070a7dad634bd6b2b4d72a91db0f83e5"
server_key_version: "encryptionkey@0"
I20260805 22:47:27.519860 23369 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260805 22:47:27.520689 23392 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:27.520865 23369 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260805 22:47:27.520962 23369 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/minicluster-data/ts-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/minicluster-data/ts-0/wal
uuid: "4fdf99d7a46e44d4b765749b14fd78cc"
format_stamp: "Formatted at 2026-08-05 22:47:27 on dist-test-slave-gjrz"
server_key: "f29403b3cafd8146ae007b3626b3ab92"
server_key_iv: "070a7dad634bd6b2b4d72a91db0f83e5"
server_key_version: "encryptionkey@0"
I20260805 22:47:27.521029 23369 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:27.528756 23369 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:27.530778 23369 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:27.530925 23369 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:27.531158 23369 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:47:27.531517 23369 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:47:27.531554 23369 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:27.531584 23369 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:47:27.531602 23369 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:27.537504 23369 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.129:40945
I20260805 22:47:27.537551 23553 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.129:40945 every 8 connection(s)
I20260805 22:47:27.537894 23369 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
I20260805 22:47:27.539753 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 23369
I20260805 22:47:27.539870 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/minicluster-data/ts-0/wal/instance
I20260805 22:47:27.540077 15234 external_mini_cluster.cc:1428] Setting key d8be2999e0d7ab6c842a511c0c9981b8
Aug 05 22:47:27 dist-test-slave-gjrz krb5kdc[23212](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970047, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.129@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:47:27.549100 23333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:27.538640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.129:33231 (local address 127.14.224.190:36335)
0805 22:47:27.538707 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:27.538709 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:27.538914 (+ 205us) server_negotiation.cc:407] Connection header received
0805 22:47:27.540109 (+ 1195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:27.540111 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:27.540128 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:27.540204 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:27.541068 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:27.541572 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:27.542934 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:27.543326 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:27.543404 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:27.546037 (+ 2633us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:27.546039 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:27.546039 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:27.546051 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:27.547491 (+ 1440us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:27.548043 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:27.548043 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:27.548044 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:27.548116 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:27.548406 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:27.548406 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:27.548406 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:27.548518 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:27.548565 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:27.548927 (+ 362us) server_negotiation.cc:299] Negotiation successful
0805 22:47:27.549011 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260805 22:47:27.549376 23556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:27.538609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:36335 (local address 127.14.224.129:33231)
0805 22:47:27.538788 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:27.538830 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:27.539960 (+ 1130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:27.540321 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:27.540325 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:27.540649 (+ 324us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:27.540964 (+ 315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:27.540972 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:27.541674 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:27.541675 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:27.542837 (+ 1162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:27.542841 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:27.543433 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:27.543434 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:27.543554 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:27.544089 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:27.544098 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:27.545892 (+ 1794us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:27.547585 (+ 1693us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:27.547598 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:27.547601 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:27.547963 (+ 362us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:27.548178 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:27.548178 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:27.548179 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:27.548343 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:27.548576 (+ 233us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:27.548583 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:27.548781 (+ 198us) client_negotiation.cc:769] Sending connection context
0805 22:47:27.548917 (+ 136us) client_negotiation.cc:240] Negotiation successful
0805 22:47:27.549113 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":92,"threads_started":1}
WARNING: no policy specified for kudu/127.14.224.130@KRBTEST.COM; defaulting to no policy
I20260805 22:47:27.549964 23554 heartbeater.cc:347] Connected to a master server at 127.14.224.190:36335
I20260805 22:47:27.550096 23554 heartbeater.cc:464] Registering TS with master...
I20260805 22:47:27.550295 23554 heartbeater.cc:511] Master 127.14.224.190:36335 requested a full tablet report, sending...
I20260805 22:47:27.550858 23282 ts_manager.cc:194] Registered new tserver with Master: 4fdf99d7a46e44d4b765749b14fd78cc (127.14.224.129:40945)
I20260805 22:47:27.551527 23282 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.224.129@KRBTEST.COM'} at 127.14.224.129:33231
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab.
Entry for principal kudu/127.14.224.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab.
I20260805 22:47:27.568441 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.130:0
--local_ip_for_outbound_sockets=127.14.224.130
--webserver_interface=127.14.224.130
--webserver_port=0
--tserver_master_addrs=127.14.224.190:36335
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab
--principal=kudu/127.14.224.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:40419
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:47:27.653187 23560 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:27.653427 23560 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:27.653455 23560 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:27.654835 23560 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:27.654884 23560 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:27.654912 23560 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.130
I20260805 22:47:27.656658 23560 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:40419
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab
--principal=kudu/127.14.224.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.224.130
--webserver_port=0
--tserver_master_addrs=127.14.224.190:36335
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23560
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.130
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:27.656905 23560 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:27.657142 23560 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260805 22:47:27.662325 23560 server_base.cc:1034] running on GCE node
W20260805 22:47:27.662292 23569 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:27.662286 23566 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:27.662286 23567 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:27.662772 23560 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:27.663033 23560 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:27.664260 23560 hybrid_clock.cc:648] HybridClock initialized: now 1785970047664240 us; error 35 us; skew 500 ppm
Aug 05 22:47:27 dist-test-slave-gjrz krb5kdc[23212](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970047, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:27.666869 23560 init.cc:377] Logged in from keytab as kudu/127.14.224.130@KRBTEST.COM (short username kudu)
I20260805 22:47:27.667371 23560 webserver.cc:460] Webserver started at http://127.14.224.130:36391/ using document root <none> and password file <none>
I20260805 22:47:27.667611 23560 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:27.667658 23560 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:27.667790 23560 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:27.668861 23560 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/minicluster-data/ts-1/data/instance:
uuid: "cce0cb4068d04d2e8164f5667e707558"
format_stamp: "Formatted at 2026-08-05 22:47:27 on dist-test-slave-gjrz"
server_key: "4f2936c76caa2d7e097840e64b17c8b5"
server_key_iv: "99d9e39e43101c5bbfc7c905fb02458d"
server_key_version: "encryptionkey@0"
I20260805 22:47:27.669204 23560 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/minicluster-data/ts-1/wal/instance:
uuid: "cce0cb4068d04d2e8164f5667e707558"
format_stamp: "Formatted at 2026-08-05 22:47:27 on dist-test-slave-gjrz"
server_key: "4f2936c76caa2d7e097840e64b17c8b5"
server_key_iv: "99d9e39e43101c5bbfc7c905fb02458d"
server_key_version: "encryptionkey@0"
I20260805 22:47:27.670594 23560 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260805 22:47:27.671397 23579 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:27.671550 23560 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:47:27.671643 23560 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/minicluster-data/ts-1/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/minicluster-data/ts-1/wal
uuid: "cce0cb4068d04d2e8164f5667e707558"
format_stamp: "Formatted at 2026-08-05 22:47:27 on dist-test-slave-gjrz"
server_key: "4f2936c76caa2d7e097840e64b17c8b5"
server_key_iv: "99d9e39e43101c5bbfc7c905fb02458d"
server_key_version: "encryptionkey@0"
I20260805 22:47:27.671707 23560 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:27.695520 23560 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:27.697574 23560 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:27.697724 23560 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:27.697962 23560 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:47:27.698274 23560 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:47:27.698309 23560 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:27.698340 23560 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:47:27.698364 23560 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:27.704174 23560 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.130:34803
I20260805 22:47:27.704229 23756 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.130:34803 every 8 connection(s)
I20260805 22:47:27.704552 23560 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
Aug 05 22:47:27 dist-test-slave-gjrz krb5kdc[23212](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970047, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.130@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:47:27.713407 23333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:27.705328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:56281 (local address 127.14.224.190:36335)
0805 22:47:27.705398 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:27.705400 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:27.705586 (+ 186us) server_negotiation.cc:407] Connection header received
0805 22:47:27.706578 (+ 992us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:27.706579 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:27.706590 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:27.706651 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:27.707248 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:27.707768 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:27.708785 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:27.708981 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:27.709034 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:27.711043 (+ 2009us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:27.711045 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:27.711045 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:27.711052 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:27.712332 (+ 1280us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:27.712680 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:27.712681 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:27.712681 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:27.712729 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:27.712915 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:27.712916 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:27.712916 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:27.713019 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:27.713064 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:27.713273 (+ 209us) server_negotiation.cc:299] Negotiation successful
0805 22:47:27.713335 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260805 22:47:27.713588 23763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:27.705274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:36335 (local address 127.14.224.130:56281)
0805 22:47:27.705457 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:27.705500 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:27.706475 (+ 975us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:27.706721 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:27.706725 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:27.706986 (+ 261us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:27.707181 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:27.707185 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:27.707836 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:27.707837 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:27.708711 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:27.708714 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:27.709044 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:27.709044 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:27.709149 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:27.709626 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:27.709634 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:27.710954 (+ 1320us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:27.712396 (+ 1442us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:27.712401 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:27.712402 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:27.712622 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:27.712773 (+ 151us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:27.712773 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:27.712773 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:27.712864 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:27.713063 (+ 199us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:27.713066 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:27.713178 (+ 112us) client_negotiation.cc:769] Sending connection context
0805 22:47:27.713258 (+ 80us) client_negotiation.cc:240] Negotiation successful
0805 22:47:27.713383 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":93,"threads_started":1}
I20260805 22:47:27.714016 23759 heartbeater.cc:347] Connected to a master server at 127.14.224.190:36335
I20260805 22:47:27.714109 23759 heartbeater.cc:464] Registering TS with master...
I20260805 22:47:27.714262 23759 heartbeater.cc:511] Master 127.14.224.190:36335 requested a full tablet report, sending...
I20260805 22:47:27.714596 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 23560
I20260805 22:47:27.714644 23282 ts_manager.cc:194] Registered new tserver with Master: cce0cb4068d04d2e8164f5667e707558 (127.14.224.130:34803)
I20260805 22:47:27.714684 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/minicluster-data/ts-1/wal/instance
I20260805 22:47:27.714896 15234 external_mini_cluster.cc:1428] Setting key 65031ced4680075423526acc613de29f
I20260805 22:47:27.715040 23282 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.224.130@KRBTEST.COM'} at 127.14.224.130:56281
WARNING: no policy specified for kudu/127.14.224.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab.
Entry for principal kudu/127.14.224.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab.
I20260805 22:47:27.742408 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.131:0
--local_ip_for_outbound_sockets=127.14.224.131
--webserver_interface=127.14.224.131
--webserver_port=0
--tserver_master_addrs=127.14.224.190:36335
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab
--principal=kudu/127.14.224.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:40419
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:47:27.826217 23767 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:27.826449 23767 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:27.826476 23767 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:27.827728 23767 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:27.827776 23767 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:27.827804 23767 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.131
I20260805 22:47:27.829356 23767 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:40419
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab
--principal=kudu/127.14.224.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.224.131
--webserver_port=0
--tserver_master_addrs=127.14.224.190:36335
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23767
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.131
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:27.829612 23767 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:27.829835 23767 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:27.835103 23786 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:27.835112 23784 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:27.835114 23783 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:27.835878 23767 server_base.cc:1034] running on GCE node
I20260805 22:47:27.836123 23767 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:27.836390 23767 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:27.837569 23767 hybrid_clock.cc:648] HybridClock initialized: now 1785970047837545 us; error 29 us; skew 500 ppm
Aug 05 22:47:27 dist-test-slave-gjrz krb5kdc[23212](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970047, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:27.840214 23767 init.cc:377] Logged in from keytab as kudu/127.14.224.131@KRBTEST.COM (short username kudu)
I20260805 22:47:27.840638 23767 webserver.cc:460] Webserver started at http://127.14.224.131:33751/ using document root <none> and password file <none>
I20260805 22:47:27.840834 23767 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:27.840873 23767 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:27.840981 23767 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:27.842048 23767 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/minicluster-data/ts-2/data/instance:
uuid: "769e7c28cea84ea6a1a3e29afc459fec"
format_stamp: "Formatted at 2026-08-05 22:47:27 on dist-test-slave-gjrz"
server_key: "099ac31ced9b978fd30e8f4d4b782ae8"
server_key_iv: "00bf6f5e048c89f6bc52a6bd658d43cd"
server_key_version: "encryptionkey@0"
I20260805 22:47:27.842355 23767 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/minicluster-data/ts-2/wal/instance:
uuid: "769e7c28cea84ea6a1a3e29afc459fec"
format_stamp: "Formatted at 2026-08-05 22:47:27 on dist-test-slave-gjrz"
server_key: "099ac31ced9b978fd30e8f4d4b782ae8"
server_key_iv: "00bf6f5e048c89f6bc52a6bd658d43cd"
server_key_version: "encryptionkey@0"
I20260805 22:47:27.843724 23767 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260805 22:47:27.844465 23794 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:27.844635 23767 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260805 22:47:27.844723 23767 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/minicluster-data/ts-2/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/minicluster-data/ts-2/wal
uuid: "769e7c28cea84ea6a1a3e29afc459fec"
format_stamp: "Formatted at 2026-08-05 22:47:27 on dist-test-slave-gjrz"
server_key: "099ac31ced9b978fd30e8f4d4b782ae8"
server_key_iv: "00bf6f5e048c89f6bc52a6bd658d43cd"
server_key_version: "encryptionkey@0"
I20260805 22:47:27.844786 23767 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:27.856086 23767 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:27.858290 23767 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:27.858414 23767 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:27.858633 23767 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:47:27.858925 23767 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:47:27.858964 23767 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:27.858987 23767 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:47:27.858999 23767 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:27.864876 23767 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.131:39663
I20260805 22:47:27.864952 23971 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.131:39663 every 8 connection(s)
I20260805 22:47:27.865280 23767 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
I20260805 22:47:27.868322 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 23767
I20260805 22:47:27.868423 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/minicluster-data/ts-2/wal/instance
I20260805 22:47:27.868587 15234 external_mini_cluster.cc:1428] Setting key 23b0e936c7b1bda5f924a567615200c2
Aug 05 22:47:27 dist-test-slave-gjrz krb5kdc[23212](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970047, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.131@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:47:27.875250 23333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:27.866078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:36415 (local address 127.14.224.190:36335)
0805 22:47:27.866144 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:27.866146 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:27.866341 (+ 195us) server_negotiation.cc:407] Connection header received
0805 22:47:27.867456 (+ 1115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:27.867457 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:27.867470 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:27.867525 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:27.868249 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:27.868817 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:27.869945 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:27.870147 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:27.870202 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:27.872434 (+ 2232us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:27.872435 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:27.872436 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:27.872443 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:27.873830 (+ 1387us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:27.874262 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:27.874263 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:27.874264 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:27.874324 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:27.874599 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:27.874600 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:27.874601 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:27.874727 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:27.874785 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:27.875064 (+ 279us) server_negotiation.cc:299] Negotiation successful
0805 22:47:27.875156 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260805 22:47:27.875456 23977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:27.866041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:36335 (local address 127.14.224.131:36415)
0805 22:47:27.866217 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:27.866256 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:27.867352 (+ 1096us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:27.867629 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:27.867633 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:27.867919 (+ 286us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:27.868128 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:27.868155 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:27.868963 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:27.868964 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:27.869857 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:27.869860 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:27.870216 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:27.870217 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:27.870336 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:27.870863 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:27.870872 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:27.872331 (+ 1459us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:27.873927 (+ 1596us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:27.873936 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:27.873939 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:27.874186 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:27.874379 (+ 193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:27.874380 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:27.874380 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:27.874541 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:27.874785 (+ 244us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:27.874792 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:27.874937 (+ 145us) client_negotiation.cc:769] Sending connection context
0805 22:47:27.875032 (+ 95us) client_negotiation.cc:240] Negotiation successful
0805 22:47:27.875202 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":101,"threads_started":1}
I20260805 22:47:27.876010 23974 heartbeater.cc:347] Connected to a master server at 127.14.224.190:36335
I20260805 22:47:27.876129 23974 heartbeater.cc:464] Registering TS with master...
I20260805 22:47:27.876322 23974 heartbeater.cc:511] Master 127.14.224.190:36335 requested a full tablet report, sending...
I20260805 22:47:27.876675 23282 ts_manager.cc:194] Registered new tserver with Master: 769e7c28cea84ea6a1a3e29afc459fec (127.14.224.131:39663)
I20260805 22:47:27.877044 23282 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.224.131@KRBTEST.COM'} at 127.14.224.131:36415
I20260805 22:47:27.880445 15234 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/krb5kdc/test-admin.keytab.
Aug 05 22:47:27 dist-test-slave-gjrz krb5kdc[23212](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970047, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:27.896236 15234 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260805 22:47:27.897847 23990 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:47:27.897115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43688 (local address 127.14.224.129:40945)
0805 22:47:27.897273 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:27.897277 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:27.897286 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:47:27.897311 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:27.897313 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:27.897326 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:27.897392 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:27.897769 (+ 377us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43688: BlockingRecv error: recv got EOF from 127.0.0.1:43688 (error 108)
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":73,"threads_started":1}
W20260805 22:47:27.897974 15234 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/krb5kdc/krb5cc' of type FILE
Aug 05 22:47:27 dist-test-slave-gjrz krb5kdc[23212](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970047, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:27.898952 15234 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 05 22:47:27 dist-test-slave-gjrz krb5kdc[23212](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970047, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:27.899835 15234 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 05 22:47:27 dist-test-slave-gjrz krb5kdc[23212](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970047, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.224.129@KRBTEST.COM
I20260805 22:47:27.907541 23990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:27.900419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43704 (local address 127.14.224.129:40945)
0805 22:47:27.900474 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:27.900475 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:27.900485 (+ 10us) server_negotiation.cc:407] Connection header received
0805 22:47:27.900528 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:27.900528 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:27.900539 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:27.900585 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:27.900928 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:27.901659 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:27.902368 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:27.902702 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:27.902754 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:27.904831 (+ 2077us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:27.904841 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:27.904842 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:27.904849 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:27.906335 (+ 1486us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:27.906704 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:27.906708 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:27.906708 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:27.906778 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:27.907012 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:27.907012 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:27.907013 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:27.907159 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:27.907301 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:27.907371 (+ 70us) server_negotiation.cc:299] Negotiation successful
0805 22:47:27.907453 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
W20260805 22:47:27.909386 23990 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:47:27.908916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43720 (local address 127.14.224.129:40945)
0805 22:47:27.908964 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:27.908966 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:27.909003 (+ 37us) server_negotiation.cc:407] Connection header received
0805 22:47:27.909066 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:27.909066 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:27.909075 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:27.909121 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:27.909347 (+ 226us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43720: BlockingRecv error: recv got EOF from 127.0.0.1:43720 (error 108)
Metrics: {"server-negotiator.queue_time_us":29}
W20260805 22:47:27.909492 15234 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/krb5kdc/krb5cc' of type FILE
Aug 05 22:47:27 dist-test-slave-gjrz krb5kdc[23212](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970047, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:27.910461 15234 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 05 22:47:27 dist-test-slave-gjrz krb5kdc[23212](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970047, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:27.911345 15234 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 05 22:47:27 dist-test-slave-gjrz krb5kdc[23212](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970047, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.224.129@KRBTEST.COM
I20260805 22:47:27.918061 23990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:27.911831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43734 (local address 127.14.224.129:40945)
0805 22:47:27.911882 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:27.911884 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:27.911947 (+ 63us) server_negotiation.cc:407] Connection header received
0805 22:47:27.911994 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:27.911994 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:27.912004 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:27.912071 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:27.912431 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:27.912917 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:27.913616 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:27.913808 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:27.913854 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:27.915961 (+ 2107us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:27.915963 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:27.915963 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:27.915970 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:27.917150 (+ 1180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:27.917481 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:27.917481 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:27.917482 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:27.917539 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:27.917678 (+ 139us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:27.917679 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:27.917679 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:27.917767 (+ 88us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:27.917836 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:27.917932 (+ 96us) server_negotiation.cc:299] Negotiation successful
0805 22:47:27.917995 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
W20260805 22:47:27.920146 23990 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:47:27.919141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43742 (local address 127.14.224.129:40945)
0805 22:47:27.919186 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:27.919188 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:27.919593 (+ 405us) server_negotiation.cc:407] Connection header received
0805 22:47:27.919636 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:27.919637 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:27.919647 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:27.919690 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:27.920099 (+ 409us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43742: BlockingRecv error: recv got EOF from 127.0.0.1:43742 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
W20260805 22:47:27.920203 15234 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970021300824-15234-0/krb5kdc/krb5cc' of type FILE
Aug 05 22:47:27 dist-test-slave-gjrz krb5kdc[23212](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970047, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:27.921142 15234 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 05 22:47:27 dist-test-slave-gjrz krb5kdc[23212](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970047, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:27.921984 15234 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 05 22:47:27 dist-test-slave-gjrz krb5kdc[23212](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970047, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.224.129@KRBTEST.COM
I20260805 22:47:27.928613 23990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:27.922505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43750 (local address 127.14.224.129:40945)
0805 22:47:27.922557 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:27.922559 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:27.922571 (+ 12us) server_negotiation.cc:407] Connection header received
0805 22:47:27.922651 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:27.922652 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:27.922661 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:27.922704 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:27.923081 (+ 377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:27.923675 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:27.924337 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:27.924541 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:27.924595 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:27.926494 (+ 1899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:27.926495 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:27.926495 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:27.926503 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:27.927646 (+ 1143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:27.927947 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:27.927948 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:27.927949 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:27.927999 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:27.928157 (+ 158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:27.928158 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:27.928158 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:27.928250 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:27.928333 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:27.928445 (+ 112us) server_negotiation.cc:299] Negotiation successful
0805 22:47:27.928522 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260805 22:47:27.929332 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 23369
I20260805 22:47:27.940733 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 23560
I20260805 22:47:27.953001 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 23767
I20260805 22:47:27.967454 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 23230
2026-08-05T22:47:27Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2019 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:47:28 dist-test-slave-gjrz krb5kdc[24010](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:47:28 dist-test-slave-gjrz krb5kdc[24010](info): set up 2 sockets
Aug 05 22:47:28 dist-test-slave-gjrz krb5kdc[24010](info): commencing operation
krb5kdc: starting...
W20260805 22:47:29.113283 15234 mini_kdc.cc:121] Time spent starting KDC: real 1.117s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Aug 05 22:47:29 dist-test-slave-gjrz krb5kdc[24010](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970049, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:47:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:47:29Z Disabled control of system clock
WARNING: no policy specified for oryx/127.14.224.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.14.224.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.14.224.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/krb5kdc/oryx_127.14.224.190.keytab.
Entry for principal oryx/127.14.224.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/krb5kdc/oryx_127.14.224.190.keytab.
I20260805 22:47:29.242821 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:42399
--webserver_interface=127.14.224.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/krb5kdc/oryx_127.14.224.190.keytab
--principal=oryx/127.14.224.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:43165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.224.190:42399
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:47:29.327400 24027 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:29.327658 24027 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:29.327694 24027 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:29.328991 24027 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:47:29.329053 24027 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:29.329072 24027 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:29.329089 24027 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:47:29.329103 24027 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:47:29.330811 24027 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:43165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.224.190:42399
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/krb5kdc/oryx_127.14.224.190.keytab
--principal=oryx/127.14.224.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:42399
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.224.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24027
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:29.331110 24027 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:29.331367 24027 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:29.336746 24037 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:29.336730 24035 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:29.336848 24027 server_base.cc:1034] running on GCE node
W20260805 22:47:29.336735 24034 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:29.337343 24027 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:29.337658 24027 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:29.338825 24027 hybrid_clock.cc:648] HybridClock initialized: now 1785970049338794 us; error 50 us; skew 500 ppm
Aug 05 22:47:29 dist-test-slave-gjrz krb5kdc[24010](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970049, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.224.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:29.344825 24027 init.cc:377] Logged in from keytab as oryx/127.14.224.190@KRBTEST.COM (short username oryx)
I20260805 22:47:29.345371 24027 webserver.cc:460] Webserver started at http://127.14.224.190:44675/ using document root <none> and password file <none>
I20260805 22:47:29.345624 24027 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:29.345681 24027 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:29.345824 24027 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:29.346988 24027 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/master-0/data/instance:
uuid: "f0fb2e45b5414c06af56004d3bea4ca8"
format_stamp: "Formatted at 2026-08-05 22:47:29 on dist-test-slave-gjrz"
server_key: "9811562c2805c9b9a7628da33cd9dbc7"
server_key_iv: "c3f8136e1a0892c08281b7876e3fd8d5"
server_key_version: "encryptionkey@0"
I20260805 22:47:29.347412 24027 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/master-0/wal/instance:
uuid: "f0fb2e45b5414c06af56004d3bea4ca8"
format_stamp: "Formatted at 2026-08-05 22:47:29 on dist-test-slave-gjrz"
server_key: "9811562c2805c9b9a7628da33cd9dbc7"
server_key_iv: "c3f8136e1a0892c08281b7876e3fd8d5"
server_key_version: "encryptionkey@0"
I20260805 22:47:29.348870 24027 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:47:29.349771 24045 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:29.350006 24027 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:47:29.350108 24027 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/master-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/master-0/wal
uuid: "f0fb2e45b5414c06af56004d3bea4ca8"
format_stamp: "Formatted at 2026-08-05 22:47:29 on dist-test-slave-gjrz"
server_key: "9811562c2805c9b9a7628da33cd9dbc7"
server_key_iv: "c3f8136e1a0892c08281b7876e3fd8d5"
server_key_version: "encryptionkey@0"
I20260805 22:47:29.350188 24027 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:29.363420 24027 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:29.365538 24027 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:29.365693 24027 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:29.369859 24027 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.190:42399
I20260805 22:47:29.369895 24130 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.190:42399 every 8 connection(s)
I20260805 22:47:29.370266 24027 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
I20260805 22:47:29.371309 24133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:29.373739 24133 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0fb2e45b5414c06af56004d3bea4ca8: Bootstrap starting.
I20260805 22:47:29.374379 24133 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f0fb2e45b5414c06af56004d3bea4ca8: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:29.374672 24133 log.cc:824] T 00000000000000000000000000000000 P f0fb2e45b5414c06af56004d3bea4ca8: Log is configured to *not* fsync() on all Append() calls
I20260805 22:47:29.375519 24133 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0fb2e45b5414c06af56004d3bea4ca8: No bootstrap required, opened a new log
I20260805 22:47:29.377202 24133 raft_consensus.cc:348] T 00000000000000000000000000000000 P f0fb2e45b5414c06af56004d3bea4ca8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 42399 } }
I20260805 22:47:29.377362 24133 raft_consensus.cc:374] T 00000000000000000000000000000000 P f0fb2e45b5414c06af56004d3bea4ca8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:29.377385 24133 raft_consensus.cc:729] T 00000000000000000000000000000000 P f0fb2e45b5414c06af56004d3bea4ca8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0fb2e45b5414c06af56004d3bea4ca8, State: Initialized, Role: FOLLOWER
I20260805 22:47:29.377532 24133 consensus_queue.cc:260] T 00000000000000000000000000000000 P f0fb2e45b5414c06af56004d3bea4ca8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 42399 } }
I20260805 22:47:29.377609 24133 raft_consensus.cc:388] T 00000000000000000000000000000000 P f0fb2e45b5414c06af56004d3bea4ca8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:47:29.377635 24133 raft_consensus.cc:482] T 00000000000000000000000000000000 P f0fb2e45b5414c06af56004d3bea4ca8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:47:29.377686 24133 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f0fb2e45b5414c06af56004d3bea4ca8 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:29.378589 24133 raft_consensus.cc:504] T 00000000000000000000000000000000 P f0fb2e45b5414c06af56004d3bea4ca8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 42399 } }
I20260805 22:47:29.378624 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 24027
I20260805 22:47:29.378688 24133 leader_election.cc:302] T 00000000000000000000000000000000 P f0fb2e45b5414c06af56004d3bea4ca8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f0fb2e45b5414c06af56004d3bea4ca8; no voters:
I20260805 22:47:29.378732 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/master-0/wal/instance
I20260805 22:47:29.378877 24133 leader_election.cc:288] T 00000000000000000000000000000000 P f0fb2e45b5414c06af56004d3bea4ca8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:47:29.378909 15234 external_mini_cluster.cc:1428] Setting key b23b7c06022fe3938d48a78916f3f1ed
I20260805 22:47:29.378919 24136 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f0fb2e45b5414c06af56004d3bea4ca8 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:47:29.379052 24136 raft_consensus.cc:686] T 00000000000000000000000000000000 P f0fb2e45b5414c06af56004d3bea4ca8 [term 1 LEADER]: Becoming Leader. State: Replica: f0fb2e45b5414c06af56004d3bea4ca8, State: Running, Role: LEADER
I20260805 22:47:29.379144 24136 consensus_queue.cc:237] T 00000000000000000000000000000000 P f0fb2e45b5414c06af56004d3bea4ca8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 42399 } }
I20260805 22:47:29.379611 24133 sys_catalog.cc:564] T 00000000000000000000000000000000 P f0fb2e45b5414c06af56004d3bea4ca8 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:47:29.379673 24138 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0fb2e45b5414c06af56004d3bea4ca8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f0fb2e45b5414c06af56004d3bea4ca8. Latest consensus state: current_term: 1 leader_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 42399 } } }
I20260805 22:47:29.379779 24138 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0fb2e45b5414c06af56004d3bea4ca8 [sys.catalog]: This master's current role is: LEADER
I20260805 22:47:29.379709 24137 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0fb2e45b5414c06af56004d3bea4ca8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 42399 } } }
I20260805 22:47:29.379931 24137 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0fb2e45b5414c06af56004d3bea4ca8 [sys.catalog]: This master's current role is: LEADER
I20260805 22:47:29.380173 24142 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:47:29.380750 24142 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:47:29.382535 24142 catalog_manager.cc:1347] Generated new cluster ID: 03236882b32e4ccf9fe1162c00642f68
I20260805 22:47:29.382611 24142 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 05 22:47:29 dist-test-slave-gjrz krb5kdc[24010](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970049, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM
I20260805 22:47:29.391290 24141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:29.379462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47198 (local address 127.14.224.190:42399)
0805 22:47:29.380071 (+ 609us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:29.380082 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:29.380121 (+ 39us) server_negotiation.cc:407] Connection header received
0805 22:47:29.380251 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:29.380259 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:29.380324 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:29.380459 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:29.381258 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:29.382540 (+ 1282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:29.383683 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:29.384375 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:29.384517 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:29.387442 (+ 2925us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:29.387447 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:29.387447 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:29.387464 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:29.389475 (+ 2011us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:29.389932 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:29.389935 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:29.389936 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:29.390073 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:29.390278 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:29.390278 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:29.390279 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:29.390599 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:29.390751 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:29.390860 (+ 109us) server_negotiation.cc:299] Negotiation successful
0805 22:47:29.391008 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":557,"thread_start_us":88,"threads_started":1}
I20260805 22:47:29.401650 24142 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:47:29.402252 24142 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:47:29.406994 24142 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f0fb2e45b5414c06af56004d3bea4ca8: Generated new TSK 0
I20260805 22:47:29.407205 24142 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.14.224.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.14.224.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.14.224.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/krb5kdc/oryx_127.14.224.129.keytab.
Entry for principal oryx/127.14.224.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/krb5kdc/oryx_127.14.224.129.keytab.
I20260805 22:47:29.438211 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.129:0
--local_ip_for_outbound_sockets=127.14.224.129
--webserver_interface=127.14.224.129
--webserver_port=0
--tserver_master_addrs=127.14.224.190:42399
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/krb5kdc/oryx_127.14.224.129.keytab
--principal=oryx/127.14.224.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:43165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:47:29.538020 24174 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:29.538225 24174 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:29.538259 24174 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:29.539559 24174 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:29.539613 24174 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:29.539651 24174 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.129
I20260805 22:47:29.541244 24174 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:43165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/krb5kdc/oryx_127.14.224.129.keytab
--principal=oryx/127.14.224.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.224.129
--webserver_port=0
--tserver_master_addrs=127.14.224.190:42399
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24174
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.129
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:29.541493 24174 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:29.541718 24174 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:29.547010 24183 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:29.547134 24174 server_base.cc:1034] running on GCE node
W20260805 22:47:29.546989 24186 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:29.547024 24184 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:29.547438 24174 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:29.547689 24174 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:29.548830 24174 hybrid_clock.cc:648] HybridClock initialized: now 1785970049548816 us; error 28 us; skew 500 ppm
Aug 05 22:47:29 dist-test-slave-gjrz krb5kdc[24010](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970049, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.224.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:29.551398 24174 init.cc:377] Logged in from keytab as oryx/127.14.224.129@KRBTEST.COM (short username oryx)
I20260805 22:47:29.551821 24174 webserver.cc:460] Webserver started at http://127.14.224.129:33671/ using document root <none> and password file <none>
I20260805 22:47:29.552027 24174 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:29.552083 24174 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:29.552217 24174 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:29.553303 24174 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-0/data/instance:
uuid: "936d4bcf12614852a0aede9ed99863a0"
format_stamp: "Formatted at 2026-08-05 22:47:29 on dist-test-slave-gjrz"
server_key: "7bd28843c4d311259a31e16ee8c93b45"
server_key_iv: "571a9df42382ef80d73c14f708fa22ba"
server_key_version: "encryptionkey@0"
I20260805 22:47:29.553651 24174 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-0/wal/instance:
uuid: "936d4bcf12614852a0aede9ed99863a0"
format_stamp: "Formatted at 2026-08-05 22:47:29 on dist-test-slave-gjrz"
server_key: "7bd28843c4d311259a31e16ee8c93b45"
server_key_iv: "571a9df42382ef80d73c14f708fa22ba"
server_key_version: "encryptionkey@0"
I20260805 22:47:29.555100 24174 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260805 22:47:29.555989 24198 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:29.556145 24174 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:47:29.556236 24174 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-0/wal
uuid: "936d4bcf12614852a0aede9ed99863a0"
format_stamp: "Formatted at 2026-08-05 22:47:29 on dist-test-slave-gjrz"
server_key: "7bd28843c4d311259a31e16ee8c93b45"
server_key_iv: "571a9df42382ef80d73c14f708fa22ba"
server_key_version: "encryptionkey@0"
I20260805 22:47:29.556313 24174 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:29.582965 24174 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:29.584913 24174 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:29.585064 24174 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:29.585300 24174 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:47:29.585600 24174 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:47:29.585633 24174 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:29.585664 24174 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:47:29.585687 24174 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:29.591549 24174 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.129:42859
I20260805 22:47:29.591611 24363 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.129:42859 every 8 connection(s)
I20260805 22:47:29.591936 24174 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
I20260805 22:47:29.596505 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 24174
I20260805 22:47:29.596603 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-0/wal/instance
I20260805 22:47:29.596812 15234 external_mini_cluster.cc:1428] Setting key 51f8a269eef93b0fb01bcb44c2e3116f
Aug 05 22:47:29 dist-test-slave-gjrz krb5kdc[24010](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970049, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.224.129@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM
I20260805 22:47:29.601702 24141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:29.592699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.129:43313 (local address 127.14.224.190:42399)
0805 22:47:29.592770 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:29.592772 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:29.592959 (+ 187us) server_negotiation.cc:407] Connection header received
0805 22:47:29.593480 (+ 521us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:29.593482 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:29.593493 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:29.593550 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:29.594512 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:29.595028 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:29.596101 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:29.596327 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:29.596395 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:29.598796 (+ 2401us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:29.598798 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:29.598798 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:29.598805 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:29.600292 (+ 1487us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:29.600720 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:29.600721 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:29.600721 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:29.600775 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:29.601077 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:29.601077 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:29.601077 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:29.601189 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:29.601239 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:29.601564 (+ 325us) server_negotiation.cc:299] Negotiation successful
0805 22:47:29.601635 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260805 22:47:29.601958 24366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:29.592670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42399 (local address 127.14.224.129:43313)
0805 22:47:29.592842 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:29.592879 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:29.593369 (+ 490us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:29.593632 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:29.593636 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:29.594220 (+ 584us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:29.594421 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:29.594426 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:29.595098 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:29.595099 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:29.596033 (+ 934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:29.596037 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:29.596397 (+ 360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:29.596397 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:29.596499 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:29.597132 (+ 633us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:29.597141 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:29.598694 (+ 1553us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:29.600392 (+ 1698us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:29.600400 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:29.600403 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:29.600655 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:29.600858 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:29.600858 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:29.600859 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:29.601001 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:29.601247 (+ 246us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:29.601253 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:29.601430 (+ 177us) client_negotiation.cc:769] Sending connection context
0805 22:47:29.601541 (+ 111us) client_negotiation.cc:240] Negotiation successful
0805 22:47:29.601712 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":95,"threads_started":1}
I20260805 22:47:29.602546 24364 heartbeater.cc:347] Connected to a master server at 127.14.224.190:42399
I20260805 22:47:29.602667 24364 heartbeater.cc:464] Registering TS with master...
I20260805 22:47:29.602906 24364 heartbeater.cc:511] Master 127.14.224.190:42399 requested a full tablet report, sending...
I20260805 22:47:29.603528 24068 ts_manager.cc:194] Registered new tserver with Master: 936d4bcf12614852a0aede9ed99863a0 (127.14.224.129:42859)
I20260805 22:47:29.604164 24068 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.14.224.129@KRBTEST.COM'} at 127.14.224.129:43313
WARNING: no policy specified for oryx/127.14.224.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.14.224.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.14.224.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/krb5kdc/oryx_127.14.224.130.keytab.
Entry for principal oryx/127.14.224.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/krb5kdc/oryx_127.14.224.130.keytab.
I20260805 22:47:29.626577 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.130:0
--local_ip_for_outbound_sockets=127.14.224.130
--webserver_interface=127.14.224.130
--webserver_port=0
--tserver_master_addrs=127.14.224.190:42399
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/krb5kdc/oryx_127.14.224.130.keytab
--principal=oryx/127.14.224.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:43165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:47:29.712407 24370 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:29.712641 24370 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:29.712679 24370 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:29.713981 24370 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:29.714041 24370 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:29.714082 24370 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.130
I20260805 22:47:29.715752 24370 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:43165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/krb5kdc/oryx_127.14.224.130.keytab
--principal=oryx/127.14.224.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.224.130
--webserver_port=0
--tserver_master_addrs=127.14.224.190:42399
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24370
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.130
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:29.716040 24370 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:29.716285 24370 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:29.721545 24384 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:29.721578 24380 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:29.721582 24378 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:29.721695 24370 server_base.cc:1034] running on GCE node
I20260805 22:47:29.721920 24370 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:29.722201 24370 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:29.723407 24370 hybrid_clock.cc:648] HybridClock initialized: now 1785970049723388 us; error 32 us; skew 500 ppm
Aug 05 22:47:29 dist-test-slave-gjrz krb5kdc[24010](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970049, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.224.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:29.726015 24370 init.cc:377] Logged in from keytab as oryx/127.14.224.130@KRBTEST.COM (short username oryx)
I20260805 22:47:29.726536 24370 webserver.cc:460] Webserver started at http://127.14.224.130:41591/ using document root <none> and password file <none>
I20260805 22:47:29.726788 24370 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:29.726840 24370 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:29.726974 24370 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:29.728143 24370 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-1/data/instance:
uuid: "89b1294014344834957f89fad6b58def"
format_stamp: "Formatted at 2026-08-05 22:47:29 on dist-test-slave-gjrz"
server_key: "341eeef424244f62b4ab0fae725c95f3"
server_key_iv: "6e6c8ee9230c89cc59dc18bbeae733e4"
server_key_version: "encryptionkey@0"
I20260805 22:47:29.728513 24370 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-1/wal/instance:
uuid: "89b1294014344834957f89fad6b58def"
format_stamp: "Formatted at 2026-08-05 22:47:29 on dist-test-slave-gjrz"
server_key: "341eeef424244f62b4ab0fae725c95f3"
server_key_iv: "6e6c8ee9230c89cc59dc18bbeae733e4"
server_key_version: "encryptionkey@0"
I20260805 22:47:29.729899 24370 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260805 22:47:29.730664 24393 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:29.730860 24370 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260805 22:47:29.730954 24370 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-1/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-1/wal
uuid: "89b1294014344834957f89fad6b58def"
format_stamp: "Formatted at 2026-08-05 22:47:29 on dist-test-slave-gjrz"
server_key: "341eeef424244f62b4ab0fae725c95f3"
server_key_iv: "6e6c8ee9230c89cc59dc18bbeae733e4"
server_key_version: "encryptionkey@0"
I20260805 22:47:29.731024 24370 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:29.745285 24370 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:29.747400 24370 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:29.747560 24370 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:29.747808 24370 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:47:29.748142 24370 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:47:29.748179 24370 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:29.748209 24370 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:47:29.748234 24370 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:29.754290 24370 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.130:40547
I20260805 22:47:29.754350 24565 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.130:40547 every 8 connection(s)
I20260805 22:47:29.754690 24370 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
Aug 05 22:47:29 dist-test-slave-gjrz krb5kdc[24010](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970049, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.224.130@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM
I20260805 22:47:29.763019 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 24370
I20260805 22:47:29.763118 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-1/wal/instance
I20260805 22:47:29.763345 15234 external_mini_cluster.cc:1428] Setting key 1e34c4de0e0e65489e8125845876bfd9
I20260805 22:47:29.764668 24141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:29.755435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:57713 (local address 127.14.224.190:42399)
0805 22:47:29.755495 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:29.755497 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:29.755694 (+ 197us) server_negotiation.cc:407] Connection header received
0805 22:47:29.756260 (+ 566us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:29.756261 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:29.756276 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:29.756342 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:29.757329 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:29.757849 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:29.758873 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:29.759156 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:29.759223 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:29.761636 (+ 2413us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:29.761639 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:29.761639 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:29.761649 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:29.762855 (+ 1206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:29.763371 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:29.763374 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:29.763374 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:29.763450 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:29.763941 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:29.763942 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:29.763943 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:29.764123 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:29.764199 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:29.764476 (+ 277us) server_negotiation.cc:299] Negotiation successful
0805 22:47:29.764580 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260805 22:47:29.764789 24569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:29.755428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42399 (local address 127.14.224.130:57713)
0805 22:47:29.755572 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:29.755611 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:29.756154 (+ 543us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:29.756415 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:29.756419 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:29.757003 (+ 584us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:29.757224 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:29.757229 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:29.757945 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:29.757946 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:29.758774 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:29.758777 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:29.759238 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:29.759240 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:29.759409 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:29.759913 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:29.759921 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:29.761463 (+ 1542us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:29.762954 (+ 1491us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:29.762962 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:29.762964 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:29.763257 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:29.763514 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:29.763515 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:29.763515 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:29.763683 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:29.764192 (+ 509us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:29.764198 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:29.764340 (+ 142us) client_negotiation.cc:769] Sending connection context
0805 22:47:29.764436 (+ 96us) client_negotiation.cc:240] Negotiation successful
0805 22:47:29.764580 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":74,"threads_started":1}
I20260805 22:47:29.766165 24566 heartbeater.cc:347] Connected to a master server at 127.14.224.190:42399
I20260805 22:47:29.766281 24566 heartbeater.cc:464] Registering TS with master...
I20260805 22:47:29.766484 24566 heartbeater.cc:511] Master 127.14.224.190:42399 requested a full tablet report, sending...
I20260805 22:47:29.766944 24068 ts_manager.cc:194] Registered new tserver with Master: 89b1294014344834957f89fad6b58def (127.14.224.130:40547)
I20260805 22:47:29.767372 24068 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.14.224.130@KRBTEST.COM'} at 127.14.224.130:57713
WARNING: no policy specified for oryx/127.14.224.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.14.224.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.14.224.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/krb5kdc/oryx_127.14.224.131.keytab.
Entry for principal oryx/127.14.224.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/krb5kdc/oryx_127.14.224.131.keytab.
I20260805 22:47:29.791476 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.131:0
--local_ip_for_outbound_sockets=127.14.224.131
--webserver_interface=127.14.224.131
--webserver_port=0
--tserver_master_addrs=127.14.224.190:42399
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/krb5kdc/oryx_127.14.224.131.keytab
--principal=oryx/127.14.224.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:43165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:47:29.875172 24574 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:29.875473 24574 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:29.875510 24574 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:29.876724 24574 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:29.876770 24574 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:29.876806 24574 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.131
I20260805 22:47:29.878306 24574 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:43165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/krb5kdc/oryx_127.14.224.131.keytab
--principal=oryx/127.14.224.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.224.131
--webserver_port=0
--tserver_master_addrs=127.14.224.190:42399
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24574
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.131
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:29.878552 24574 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:29.878775 24574 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:29.884021 24580 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:29.884052 24579 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:29.884150 24574 server_base.cc:1034] running on GCE node
W20260805 22:47:29.884225 24582 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:29.884503 24574 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:29.884783 24574 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:29.885975 24574 hybrid_clock.cc:648] HybridClock initialized: now 1785970049885960 us; error 30 us; skew 500 ppm
Aug 05 22:47:29 dist-test-slave-gjrz krb5kdc[24010](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970049, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.224.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:29.888684 24574 init.cc:377] Logged in from keytab as oryx/127.14.224.131@KRBTEST.COM (short username oryx)
I20260805 22:47:29.889179 24574 webserver.cc:460] Webserver started at http://127.14.224.131:34081/ using document root <none> and password file <none>
I20260805 22:47:29.889390 24574 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:29.889436 24574 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:29.889564 24574 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:29.890645 24574 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-2/data/instance:
uuid: "407ddbed1bf8493fa6677df269ca521c"
format_stamp: "Formatted at 2026-08-05 22:47:29 on dist-test-slave-gjrz"
server_key: "35eeffe0d93843eab6509e7d0c6436a3"
server_key_iv: "663ac34f4f368c7f846c6ab34ba7da26"
server_key_version: "encryptionkey@0"
I20260805 22:47:29.890992 24574 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-2/wal/instance:
uuid: "407ddbed1bf8493fa6677df269ca521c"
format_stamp: "Formatted at 2026-08-05 22:47:29 on dist-test-slave-gjrz"
server_key: "35eeffe0d93843eab6509e7d0c6436a3"
server_key_iv: "663ac34f4f368c7f846c6ab34ba7da26"
server_key_version: "encryptionkey@0"
I20260805 22:47:29.892407 24574 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260805 22:47:29.893105 24596 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:29.893267 24574 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:29.893366 24574 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-2/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-2/wal
uuid: "407ddbed1bf8493fa6677df269ca521c"
format_stamp: "Formatted at 2026-08-05 22:47:29 on dist-test-slave-gjrz"
server_key: "35eeffe0d93843eab6509e7d0c6436a3"
server_key_iv: "663ac34f4f368c7f846c6ab34ba7da26"
server_key_version: "encryptionkey@0"
I20260805 22:47:29.893437 24574 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:29.907145 24574 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:29.909749 24574 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:29.909922 24574 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:29.910181 24574 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:47:29.910502 24574 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:47:29.910542 24574 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:29.910573 24574 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:47:29.910596 24574 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:29.916450 24574 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.131:41917
I20260805 22:47:29.916510 24772 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.131:41917 every 8 connection(s)
I20260805 22:47:29.916832 24574 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
I20260805 22:47:29.917151 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 24574
I20260805 22:47:29.917239 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-2/wal/instance
I20260805 22:47:29.917426 15234 external_mini_cluster.cc:1428] Setting key 1fc4d5caf31269c09c7ab457264e1c89
Aug 05 22:47:29 dist-test-slave-gjrz krb5kdc[24010](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970049, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.224.131@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM
I20260805 22:47:29.925895 24141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:29.917587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:37031 (local address 127.14.224.190:42399)
0805 22:47:29.917640 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:29.917643 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:29.917944 (+ 301us) server_negotiation.cc:407] Connection header received
0805 22:47:29.918556 (+ 612us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:29.918557 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:29.918568 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:29.918612 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:29.919603 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:29.920101 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:29.921086 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:29.921269 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:29.921314 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:29.923489 (+ 2175us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:29.923490 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:29.923490 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:29.923498 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:29.924787 (+ 1289us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:29.925146 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:29.925147 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:29.925148 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:29.925199 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:29.925382 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:29.925383 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:29.925383 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:29.925485 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:29.925530 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:29.925761 (+ 231us) server_negotiation.cc:299] Negotiation successful
0805 22:47:29.925827 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260805 22:47:29.926112 24775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:29.917551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42399 (local address 127.14.224.131:37031)
0805 22:47:29.917733 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:29.917849 (+ 116us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:29.918464 (+ 615us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:29.918671 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:29.918674 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:29.919300 (+ 626us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:29.919527 (+ 227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:29.919533 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:29.920173 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:29.920174 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:29.920984 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:29.920987 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:29.921329 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:29.921329 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:29.921439 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:29.921923 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:29.921931 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:29.923384 (+ 1453us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:29.924858 (+ 1474us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:29.924863 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:29.924864 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:29.925091 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:29.925245 (+ 154us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:29.925245 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:29.925246 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:29.925341 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:29.925526 (+ 185us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:29.925529 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:29.925659 (+ 130us) client_negotiation.cc:769] Sending connection context
0805 22:47:29.925743 (+ 84us) client_negotiation.cc:240] Negotiation successful
0805 22:47:29.925869 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":93,"threads_started":1}
I20260805 22:47:29.926610 24773 heartbeater.cc:347] Connected to a master server at 127.14.224.190:42399
I20260805 22:47:29.926715 24773 heartbeater.cc:464] Registering TS with master...
I20260805 22:47:29.926915 24773 heartbeater.cc:511] Master 127.14.224.190:42399 requested a full tablet report, sending...
I20260805 22:47:29.927378 24068 ts_manager.cc:194] Registered new tserver with Master: 407ddbed1bf8493fa6677df269ca521c (127.14.224.131:41917)
I20260805 22:47:29.927776 24068 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.14.224.131@KRBTEST.COM'} at 127.14.224.131:37031
I20260805 22:47:29.929142 15234 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.14.224.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.14.224.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.14.224.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/krb5kdc/oryx_127.14.224.189.keytab.
Entry for principal oryx/127.14.224.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/krb5kdc/oryx_127.14.224.189.keytab.
I20260805 22:47:29.955871 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.189:44253
--webserver_interface=127.14.224.189
--webserver_port=0
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/krb5kdc/oryx_127.14.224.189.keytab
--principal=oryx/127.14.224.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:43165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.224.190:42399,127.14.224.189:44253
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:47:30.041277 24778 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:30.041513 24778 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:30.041548 24778 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:30.042797 24778 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:47:30.042842 24778 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:30.042856 24778 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:30.042868 24778 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:47:30.042879 24778 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:47:30.044485 24778 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:43165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.14.224.190:42399,127.14.224.189:44253
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/krb5kdc/oryx_127.14.224.189.keytab
--principal=oryx/127.14.224.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.189:44253
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.14.224.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24778
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
W20260805 22:47:30.044606 24778 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.14.224.190:42399,127.14.224.189:44253'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260805 22:47:30.044731 24778 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:30.044934 24778 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:30.049822 24787 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:30.049823 24786 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:30.049823 24791 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:30.049988 24778 server_base.cc:1034] running on GCE node
I20260805 22:47:30.050346 24778 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:30.050686 24778 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:30.051834 24778 hybrid_clock.cc:648] HybridClock initialized: now 1785970050051816 us; error 43 us; skew 500 ppm
Aug 05 22:47:30 dist-test-slave-gjrz krb5kdc[24010](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970050, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.224.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:30.054572 24778 init.cc:377] Logged in from keytab as oryx/127.14.224.189@KRBTEST.COM (short username oryx)
I20260805 22:47:30.055073 24778 webserver.cc:460] Webserver started at http://127.14.224.189:33049/ using document root <none> and password file <none>
I20260805 22:47:30.055353 24778 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:30.055410 24778 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:30.055567 24778 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:30.056667 24778 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/master-1/data/instance:
uuid: "233a2c69697b4b168b656c682271145c"
format_stamp: "Formatted at 2026-08-05 22:47:30 on dist-test-slave-gjrz"
server_key: "e2c4dc2ed9cb1508e6792987a3edbd2e"
server_key_iv: "752aed31f42fecb3dc6e2893f8d2ebe0"
server_key_version: "encryptionkey@0"
I20260805 22:47:30.057024 24778 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/master-1/wal/instance:
uuid: "233a2c69697b4b168b656c682271145c"
format_stamp: "Formatted at 2026-08-05 22:47:30 on dist-test-slave-gjrz"
server_key: "e2c4dc2ed9cb1508e6792987a3edbd2e"
server_key_iv: "752aed31f42fecb3dc6e2893f8d2ebe0"
server_key_version: "encryptionkey@0"
I20260805 22:47:30.058398 24778 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260805 22:47:30.059180 24803 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:30.059374 24778 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260805 22:47:30.059473 24778 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/master-1/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/master-1/wal
uuid: "233a2c69697b4b168b656c682271145c"
format_stamp: "Formatted at 2026-08-05 22:47:30 on dist-test-slave-gjrz"
server_key: "e2c4dc2ed9cb1508e6792987a3edbd2e"
server_key_iv: "752aed31f42fecb3dc6e2893f8d2ebe0"
server_key_version: "encryptionkey@0"
I20260805 22:47:30.059561 24778 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:30.085624 24778 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:30.087601 24778 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:30.087754 24778 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:30.092082 24778 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.189:44253
I20260805 22:47:30.092114 24879 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.189:44253 every 8 connection(s)
I20260805 22:47:30.092489 24778 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/master-1/data/info.pb
I20260805 22:47:30.093505 24880 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:30.095082 24880 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.224.190" port: 42399 } has no permanent_uuid. Determining permanent_uuid...
Aug 05 22:47:30 dist-test-slave-gjrz krb5kdc[24010](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970050, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.224.189@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM
I20260805 22:47:30.101915 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 24778
I20260805 22:47:30.104547 24141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:30.095957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55254 (local address 127.14.224.190:42399)
0805 22:47:30.096021 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:30.096023 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:30.096118 (+ 95us) server_negotiation.cc:407] Connection header received
0805 22:47:30.096676 (+ 558us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:30.096678 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:30.096689 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:30.096740 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:30.097348 (+ 608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.097885 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.098880 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.099091 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.099153 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:30.101452 (+ 2299us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:30.101454 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:30.101454 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:30.101462 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:30.103110 (+ 1648us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:30.103589 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:30.103590 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:30.103590 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:30.103649 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:30.103900 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:30.103901 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:30.103901 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:30.104046 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:30.104095 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:30.104378 (+ 283us) server_negotiation.cc:299] Negotiation successful
0805 22:47:30.104446 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260805 22:47:30.104777 24882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:30.095817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42399 (local address 127.0.0.1:55254)
0805 22:47:30.096000 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:30.096044 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:30.096573 (+ 529us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:30.096807 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:30.096810 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:30.097073 (+ 263us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:30.097275 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:30.097279 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.097965 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.097966 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:30.098779 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:30.098781 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.099194 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.099195 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:30.099344 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:30.099889 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:30.099898 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:30.101340 (+ 1442us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:30.103178 (+ 1838us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:30.103185 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:30.103187 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:30.103508 (+ 321us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:30.103703 (+ 195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:30.103703 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:30.103704 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:30.103841 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:30.104100 (+ 259us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:30.104105 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:30.104259 (+ 154us) client_negotiation.cc:769] Sending connection context
0805 22:47:30.104365 (+ 106us) client_negotiation.cc:240] Negotiation successful
0805 22:47:30.104543 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":85,"threads_started":1}
I20260805 22:47:30.105407 24880 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.224.189" port: 44253 } has no permanent_uuid. Determining permanent_uuid...
Aug 05 22:47:30 dist-test-slave-gjrz krb5kdc[24010](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970049, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.14.224.189@KRBTEST.COM
Aug 05 22:47:30 dist-test-slave-gjrz krb5kdc[24010](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970050, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.224.189@KRBTEST.COM for oryx/127.14.224.189@KRBTEST.COM
I20260805 22:47:30.111217 24884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:30.102416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57626 (local address 127.14.224.189:44253)
0805 22:47:30.102596 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:30.102601 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:30.102742 (+ 141us) server_negotiation.cc:407] Connection header received
0805 22:47:30.102773 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:30.102776 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:30.102793 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:30.102878 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:30.103429 (+ 551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.104401 (+ 972us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.105408 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.105800 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.105874 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:30.108287 (+ 2413us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:30.108297 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:30.108297 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:30.108304 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:30.109957 (+ 1653us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:30.110317 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:30.110321 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:30.110322 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:30.110388 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:30.110635 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:30.110636 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:30.110636 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:30.110809 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:30.110970 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:30.111020 (+ 50us) server_negotiation.cc:299] Negotiation successful
0805 22:47:30.111097 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":99,"threads_started":1}
I20260805 22:47:30.112761 24882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:30.105682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.189:44253 (local address 127.0.0.1:57640)
0805 22:47:30.105727 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:30.105737 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:30.105769 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:30.105998 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:30.105999 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:30.106112 (+ 113us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:30.106156 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:30.106157 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.106756 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.106757 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:30.107229 (+ 472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:30.107231 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.107611 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.107611 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:30.107668 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:30.107980 (+ 312us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:30.107986 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:30.109317 (+ 1331us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:30.111830 (+ 2513us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:30.111831 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:30.111831 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:30.112042 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:30.112282 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:30.112282 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:30.112283 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:30.112342 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:30.112538 (+ 196us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:30.112539 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:30.112571 (+ 32us) client_negotiation.cc:769] Sending connection context
0805 22:47:30.112613 (+ 42us) client_negotiation.cc:240] Negotiation successful
0805 22:47:30.112693 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27}
I20260805 22:47:30.112890 24887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:30.105747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57640 (local address 127.14.224.189:44253)
0805 22:47:30.105891 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:30.105893 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:30.105898 (+ 5us) server_negotiation.cc:407] Connection header received
0805 22:47:30.105912 (+ 14us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:30.105913 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:30.105923 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:30.105983 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:30.106225 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.106691 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.107337 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.107554 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.107609 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:30.109398 (+ 1789us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:30.109399 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:30.109400 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:30.109407 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:30.111465 (+ 2058us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:30.112126 (+ 661us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:30.112127 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:30.112128 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:30.112199 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:30.112392 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:30.112392 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:30.112392 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:30.112493 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:30.112542 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:30.112637 (+ 95us) server_negotiation.cc:299] Negotiation successful
0805 22:47:30.112744 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":41,"server-negotiator.queue_time_us":123,"thread_start_us":92,"threads_started":1}
I20260805 22:47:30.114117 24880 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c: Bootstrap starting.
I20260805 22:47:30.114760 24880 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:30.115022 24880 log.cc:824] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c: Log is configured to *not* fsync() on all Append() calls
I20260805 22:47:30.115783 24880 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c: No bootstrap required, opened a new log
I20260805 22:47:30.117182 24880 raft_consensus.cc:348] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 42399 } } peers { permanent_uuid: "233a2c69697b4b168b656c682271145c" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 44253 } }
I20260805 22:47:30.117311 24880 raft_consensus.cc:374] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:30.117332 24880 raft_consensus.cc:729] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 233a2c69697b4b168b656c682271145c, State: Initialized, Role: FOLLOWER
I20260805 22:47:30.117460 24880 consensus_queue.cc:260] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 42399 } } peers { permanent_uuid: "233a2c69697b4b168b656c682271145c" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 44253 } }
I20260805 22:47:30.117779 24880 sys_catalog.cc:564] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:47:30.117743 24891 sys_catalog.cc:455] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 42399 } } peers { permanent_uuid: "233a2c69697b4b168b656c682271145c" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 44253 } } }
I20260805 22:47:30.117825 24891 sys_catalog.cc:458] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c [sys.catalog]: This master's current role is: FOLLOWER
W20260805 22:47:30.119357 24907 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260805 22:47:30.119432 24907 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260805 22:47:30.121006 24778 master_runner.cc:428] Detected that this master 233a2c69697b4b168b656c682271145c is joining an existing cluster
I20260805 22:47:30.121088 24778 master_runner.cc:432] Initiating AddMaster RPC to add 127.14.224.189:44253
I20260805 22:47:30.128773 24887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:30.122444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57650 (local address 127.14.224.189:44253)
0805 22:47:30.122486 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:30.122487 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:30.122497 (+ 10us) server_negotiation.cc:407] Connection header received
0805 22:47:30.122572 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:30.122572 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:30.122581 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:30.122623 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:30.122959 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.123753 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.124504 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.124719 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.124777 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:30.126051 (+ 1274us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:30.126052 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:30.126053 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:30.126058 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:30.127636 (+ 1578us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:30.127930 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:30.127931 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:30.127931 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:30.127983 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:30.128154 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:30.128155 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:30.128155 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:30.128351 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:30.128439 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:30.128565 (+ 126us) server_negotiation.cc:299] Negotiation successful
0805 22:47:30.128657 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":26}
I20260805 22:47:30.129087 24919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:30.122072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42399 (local address 127.0.0.1:55256)
0805 22:47:30.122227 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:30.122238 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:30.122298 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:30.122519 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:30.122521 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:30.122814 (+ 293us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:30.122898 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:30.122900 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.123851 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.123852 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:30.124753 (+ 901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:30.124756 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.125203 (+ 447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.125204 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:30.125266 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:30.125611 (+ 345us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:30.125616 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:30.125957 (+ 341us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:30.128137 (+ 2180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:30.128138 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:30.128138 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:30.128305 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:30.128489 (+ 184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:30.128490 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:30.128490 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:30.128556 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:30.128844 (+ 288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:30.128845 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:30.128884 (+ 39us) client_negotiation.cc:769] Sending connection context
0805 22:47:30.128937 (+ 53us) client_negotiation.cc:240] Negotiation successful
0805 22:47:30.129014 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":90,"threads_started":1}
I20260805 22:47:30.129189 24920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:30.122307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.189:44253 (local address 127.0.0.1:57650)
0805 22:47:30.122415 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:30.122467 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:30.122519 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:30.122635 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:30.122635 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:30.122840 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:30.122894 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:30.122896 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.123847 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.123849 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:30.124422 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:30.124423 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.124780 (+ 357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.124781 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:30.124838 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:30.125408 (+ 570us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:30.125412 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:30.125957 (+ 545us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:30.127708 (+ 1751us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:30.127709 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:30.127709 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:30.127871 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:30.128034 (+ 163us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:30.128035 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:30.128035 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:30.128091 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:30.128421 (+ 330us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:30.128422 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:30.128476 (+ 54us) client_negotiation.cc:769] Sending connection context
0805 22:47:30.128540 (+ 64us) client_negotiation.cc:240] Negotiation successful
0805 22:47:30.128710 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":92,"mutex_wait_us":69,"thread_start_us":73,"threads_started":1}
I20260805 22:47:30.129635 24141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:30.122150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55256 (local address 127.14.224.190:42399)
0805 22:47:30.122204 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:30.122207 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:30.122296 (+ 89us) server_negotiation.cc:407] Connection header received
0805 22:47:30.122353 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:30.122354 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:30.122365 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:30.122447 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:30.123015 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.123775 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.124881 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.125134 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.125194 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:30.126056 (+ 862us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:30.126058 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:30.126059 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:30.126067 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:30.128063 (+ 1996us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:30.128369 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:30.128371 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:30.128371 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:30.128435 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:30.128634 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:30.128635 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:30.128635 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:30.128778 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:30.129388 (+ 610us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:30.129451 (+ 63us) server_negotiation.cc:299] Negotiation successful
0805 22:47:30.129539 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
Aug 05 22:47:30 dist-test-slave-gjrz krb5kdc[24010](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970049, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.224.190@KRBTEST.COM for oryx/127.14.224.189@KRBTEST.COM
I20260805 22:47:30.140044 24923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:30.132018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.189:44253 (local address 127.0.0.1:57656)
0805 22:47:30.132184 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:30.132240 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:30.132329 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:30.132472 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:30.132475 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:30.132853 (+ 378us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:30.132924 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:30.132928 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.133590 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.133591 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:30.134621 (+ 1030us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:30.134625 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.135021 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.135022 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:30.135115 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:30.135618 (+ 503us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:30.135624 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:30.137188 (+ 1564us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:30.138808 (+ 1620us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:30.138818 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:30.138820 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:30.139116 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:30.139366 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:30.139367 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:30.139367 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:30.139444 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:30.139715 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:30.139724 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:30.139778 (+ 54us) client_negotiation.cc:769] Sending connection context
0805 22:47:30.139847 (+ 69us) client_negotiation.cc:240] Negotiation successful
0805 22:47:30.139961 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":93,"threads_started":1}
I20260805 22:47:30.140070 24887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:30.132069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57656 (local address 127.14.224.189:44253)
0805 22:47:30.132127 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:30.132130 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:30.132305 (+ 175us) server_negotiation.cc:407] Connection header received
0805 22:47:30.132408 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:30.132409 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:30.132418 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:30.132464 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:30.133006 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.133517 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.134700 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.134950 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.135008 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:30.137280 (+ 2272us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:30.137282 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:30.137282 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:30.137290 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:30.138715 (+ 1425us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:30.139191 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:30.139192 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:30.139192 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:30.139256 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:30.139509 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:30.139510 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:30.139510 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:30.139655 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:30.139722 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:30.139881 (+ 159us) server_negotiation.cc:299] Negotiation successful
0805 22:47:30.139969 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260805 22:47:30.140722 24068 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.14.224.189:44253: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "233a2c69697b4b168b656c682271145c"
member_type: NON_VOTER
last_known_addr {
host: "127.14.224.189"
port: 44253
}
attrs {
promote: true
}
}
dest_uuid: "f0fb2e45b5414c06af56004d3bea4ca8"
cas_config_opid_index: -1
I20260805 22:47:30.141167 24068 consensus_queue.cc:237] T 00000000000000000000000000000000 P f0fb2e45b5414c06af56004d3bea4ca8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 42399 } } peers { permanent_uuid: "233a2c69697b4b168b656c682271145c" member_type: NON_VOTER last_known_addr { host: "127.14.224.189" port: 44253 } attrs { promote: true } }
I20260805 22:47:30.141788 24925 raft_consensus.cc:2932] T 00000000000000000000000000000000 P f0fb2e45b5414c06af56004d3bea4ca8 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 233a2c69697b4b168b656c682271145c (127.14.224.189) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 42399 } } peers { permanent_uuid: "233a2c69697b4b168b656c682271145c" member_type: NON_VOTER last_known_addr { host: "127.14.224.189" port: 44253 } attrs { promote: true } } }
I20260805 22:47:30.142191 24842 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:30.142868 24925 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.14.224.189:44253
I20260805 22:47:30.142966 24925 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0fb2e45b5414c06af56004d3bea4ca8 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 42399 } } peers { permanent_uuid: "233a2c69697b4b168b656c682271145c" member_type: NON_VOTER last_known_addr { host: "127.14.224.189" port: 44253 } attrs { promote: true } } }
I20260805 22:47:30.143028 24925 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0fb2e45b5414c06af56004d3bea4ca8 [sys.catalog]: This master's current role is: LEADER
I20260805 22:47:30.143013 24842 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c [term 1 FOLLOWER]: Refusing update from remote peer f0fb2e45b5414c06af56004d3bea4ca8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260805 22:47:30.143392 24778 master.cc:537] Master@127.14.224.189:44253 shutting down...
I20260805 22:47:30.143402 24924 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f0fb2e45b5414c06af56004d3bea4ca8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "233a2c69697b4b168b656c682271145c" member_type: NON_VOTER last_known_addr { host: "127.14.224.189" port: 44253 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260805 22:47:30.144209 24046 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260805 22:47:30.144728 24046 consensus_peers.cc:487] T 00000000000000000000000000000000 P f0fb2e45b5414c06af56004d3bea4ca8 -> Peer 233a2c69697b4b168b656c682271145c (127.14.224.189:44253): Couldn't send request to peer 233a2c69697b4b168b656c682271145c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260805 22:47:30.146360 24778 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:47:30.146452 24778 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:47:30.146507 24778 tablet_replica.cc:330] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c: stopping tablet replica
I20260805 22:47:30.159677 24778 master.cc:552] Master@127.14.224.189:44253 shutdown complete.
I20260805 22:47:30.159736 24778 master_runner.cc:305] Clearing existing system tablet
I20260805 22:47:30.159855 24778 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:30.159899 24778 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:30.160563 24778 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s
I20260805 22:47:30.161023 24929 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:30.161157 24778 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:30.161214 24778 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:30.161238 24778 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/master-1/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/master-1/wal
uuid: "233a2c69697b4b168b656c682271145c"
format_stamp: "Formatted at 2026-08-05 22:47:30 on dist-test-slave-gjrz"
server_key: "e2c4dc2ed9cb1508e6792987a3edbd2e"
server_key_iv: "752aed31f42fecb3dc6e2893f8d2ebe0"
server_key_version: "encryptionkey@0"
I20260805 22:47:30.161969 24778 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:47:30.163600 24778 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260805 22:47:30.163671 24778 log.cc:1196] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c: Deleting WAL directory at /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260805 22:47:30.163846 24778 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c: Deleting consensus metadata
I20260805 22:47:30.163954 24778 master_runner.cc:315] Copying system tablet from 127.14.224.190:42399
I20260805 22:47:30.164549 24778 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c: tablet copy: Beginning tablet copy session from remote peer at address 127.14.224.190:42399
I20260805 22:47:30.171056 24937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:30.164848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42399 (local address 127.0.0.1:55264)
0805 22:47:30.164970 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:30.164981 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:30.165044 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:30.165198 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:30.165198 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:30.165360 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:30.165434 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:30.165436 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.166404 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.166406 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:30.166967 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:30.166969 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.167519 (+ 550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.167520 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:30.167576 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:30.168047 (+ 471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:30.168051 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:30.168353 (+ 302us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:30.170101 (+ 1748us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:30.170102 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:30.170103 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:30.170292 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:30.170487 (+ 195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:30.170487 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:30.170488 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:30.170537 (+ 49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:30.170781 (+ 244us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:30.170781 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:30.170821 (+ 40us) client_negotiation.cc:769] Sending connection context
0805 22:47:30.170881 (+ 60us) client_negotiation.cc:240] Negotiation successful
0805 22:47:30.170973 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":76,"threads_started":1}
I20260805 22:47:30.171077 24141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:30.164938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55264 (local address 127.14.224.190:42399)
0805 22:47:30.164994 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:30.164996 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:30.165034 (+ 38us) server_negotiation.cc:407] Connection header received
0805 22:47:30.165100 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:30.165101 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:30.165113 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:30.165192 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:30.165503 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.166285 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.167074 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.167447 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.167518 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:30.168451 (+ 933us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:30.168453 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:30.168453 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:30.168461 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:30.170008 (+ 1547us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:30.170358 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:30.170359 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:30.170360 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:30.170434 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:30.170585 (+ 151us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:30.170585 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:30.170586 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:30.170725 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:30.170786 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:30.170915 (+ 129us) server_negotiation.cc:299] Negotiation successful
0805 22:47:30.170994 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260805 22:47:30.171708 24106 tablet_copy_service.cc:140] P f0fb2e45b5414c06af56004d3bea4ca8: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 233a2c69697b4b168b656c682271145c ({username='oryx', principal='oryx/127.14.224.189@KRBTEST.COM'} at 127.0.0.1:55264)
I20260805 22:47:30.171806 24106 tablet_copy_service.cc:161] P f0fb2e45b5414c06af56004d3bea4ca8: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 233a2c69697b4b168b656c682271145c at {username='oryx', principal='oryx/127.14.224.189@KRBTEST.COM'} at 127.0.0.1:55264: session id = 233a2c69697b4b168b656c682271145c-00000000000000000000000000000000
I20260805 22:47:30.172519 24106 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P f0fb2e45b5414c06af56004d3bea4ca8: Tablet Copy: opened 0 blocks and 1 log segments
I20260805 22:47:30.173122 24778 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260805 22:47:30.174197 24778 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c: tablet copy: Starting download of 0 data blocks...
I20260805 22:47:30.174345 24778 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c: tablet copy: Starting download of 1 WAL segments...
I20260805 22:47:30.175565 24778 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260805 22:47:30.176481 24106 tablet_copy_service.cc:342] P f0fb2e45b5414c06af56004d3bea4ca8: Request end of tablet copy session 233a2c69697b4b168b656c682271145c-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.14.224.189@KRBTEST.COM'} at 127.0.0.1:55264
I20260805 22:47:30.176548 24106 tablet_copy_service.cc:433] P f0fb2e45b5414c06af56004d3bea4ca8: ending tablet copy session 233a2c69697b4b168b656c682271145c-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 233a2c69697b4b168b656c682271145c
I20260805 22:47:30.179059 24778 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:30.180369 24938 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:30.180394 24939 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:30.180490 24941 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:30.180622 24778 server_base.cc:1034] running on GCE node
I20260805 22:47:30.180717 24778 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:30.180866 24778 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:30.181982 24778 hybrid_clock.cc:648] HybridClock initialized: now 1785970050181966 us; error 30 us; skew 500 ppm
Aug 05 22:47:30 dist-test-slave-gjrz krb5kdc[24010](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970050, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.224.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:30.183326 24778 init.cc:377] Logged in from keytab as oryx/127.14.224.189@KRBTEST.COM (short username oryx)
I20260805 22:47:30.183692 24778 webserver.cc:460] Webserver started at http://127.14.224.189:40929/ using document root <none> and password file <none>
I20260805 22:47:30.183809 24778 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:30.183842 24778 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:30.184535 24778 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s
I20260805 22:47:30.185066 24952 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:30.185196 24778 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:30.185268 24778 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/master-1/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/master-1/wal
uuid: "233a2c69697b4b168b656c682271145c"
format_stamp: "Formatted at 2026-08-05 22:47:30 on dist-test-slave-gjrz"
server_key: "e2c4dc2ed9cb1508e6792987a3edbd2e"
server_key_iv: "752aed31f42fecb3dc6e2893f8d2ebe0"
server_key_version: "encryptionkey@0"
I20260805 22:47:30.185330 24778 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:30.204454 24778 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:30.206059 24778 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:30.209095 24778 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.189:44253
I20260805 22:47:30.209112 25027 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.189:44253 every 8 connection(s)
I20260805 22:47:30.209445 24778 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/master-1/data/info.pb
I20260805 22:47:30.210471 25028 sys_catalog.cc:263] Verifying existing consensus state
I20260805 22:47:30.211057 25028 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c: Bootstrap starting.
I20260805 22:47:30.214120 25028 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260805 22:47:30.214375 25028 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c: Bootstrap complete.
I20260805 22:47:30.214602 25028 raft_consensus.cc:348] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 42399 } } peers { permanent_uuid: "233a2c69697b4b168b656c682271145c" member_type: NON_VOTER last_known_addr { host: "127.14.224.189" port: 44253 } attrs { promote: true } }
I20260805 22:47:30.214700 25028 raft_consensus.cc:729] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 233a2c69697b4b168b656c682271145c, State: Initialized, Role: LEARNER
I20260805 22:47:30.214743 25028 consensus_queue.cc:260] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 42399 } } peers { permanent_uuid: "233a2c69697b4b168b656c682271145c" member_type: NON_VOTER last_known_addr { host: "127.14.224.189" port: 44253 } attrs { promote: true } }
I20260805 22:47:30.214956 25028 sys_catalog.cc:564] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:47:30.214924 25033 sys_catalog.cc:455] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 42399 } } peers { permanent_uuid: "233a2c69697b4b168b656c682271145c" member_type: NON_VOTER last_known_addr { host: "127.14.224.189" port: 44253 } attrs { promote: true } } }
I20260805 22:47:30.215157 25033 sys_catalog.cc:458] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c [sys.catalog]: This master's current role is: LEARNER
I20260805 22:47:30.216898 25050 catalog_manager.cc:1259] Loaded cluster ID: 03236882b32e4ccf9fe1162c00642f68
I20260805 22:47:30.216955 25050 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c: loading cluster ID for follower catalog manager: success
I20260805 22:47:30.218072 25050 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c: acquiring CA information for follower catalog manager: success
I20260805 22:47:30.218431 25050 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260805 22:47:30.219796 25032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:30.212897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57682 (local address 127.14.224.189:44253)
0805 22:47:30.213017 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:30.213020 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:30.213066 (+ 46us) server_negotiation.cc:407] Connection header received
0805 22:47:30.213135 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:30.213136 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:30.213146 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:30.213207 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:30.213712 (+ 505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.214406 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.215342 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.215662 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.215723 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:30.217094 (+ 1371us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:30.217096 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:30.217096 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:30.217103 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:30.218551 (+ 1448us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:30.218984 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:30.218985 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:30.218985 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:30.219063 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:30.219256 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:30.219256 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:30.219256 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:30.219396 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:30.219471 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:30.219622 (+ 151us) server_negotiation.cc:299] Negotiation successful
0805 22:47:30.219702 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98,"thread_start_us":69,"threads_started":1}
WARNING: no policy specified for oryx/127.14.224.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.14.224.188@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.14.224.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/krb5kdc/oryx_127.14.224.188.keytab.
Entry for principal oryx/127.14.224.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/krb5kdc/oryx_127.14.224.188.keytab.
I20260805 22:47:30.254060 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.188:38037
--webserver_interface=127.14.224.188
--webserver_port=0
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/krb5kdc/oryx_127.14.224.188.keytab
--principal=oryx/127.14.224.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:43165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.224.190:42399,127.14.224.189:44253,127.14.224.188:38037
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:47:30.339411 25053 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:30.339639 25053 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:30.339663 25053 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:30.340924 25053 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:47:30.340984 25053 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:30.340997 25053 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:30.341008 25053 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:47:30.341019 25053 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:47:30.343061 25053 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:43165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.14.224.190:42399,127.14.224.189:44253,127.14.224.188:38037
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/krb5kdc/oryx_127.14.224.188.keytab
--principal=oryx/127.14.224.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.188:38037
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.14.224.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25053
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:30.343405 25053 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:30.343658 25053 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:30.348664 25068 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:30.348644 25061 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:30.348639 25062 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:30.348819 25053 server_base.cc:1034] running on GCE node
I20260805 22:47:30.349071 25053 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:30.349380 25053 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:30.350544 25053 hybrid_clock.cc:648] HybridClock initialized: now 1785970050350532 us; error 31 us; skew 500 ppm
Aug 05 22:47:30 dist-test-slave-gjrz krb5kdc[24010](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970050, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.224.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:30.353237 25053 init.cc:377] Logged in from keytab as oryx/127.14.224.188@KRBTEST.COM (short username oryx)
I20260805 22:47:30.353804 25053 webserver.cc:460] Webserver started at http://127.14.224.188:43847/ using document root <none> and password file <none>
I20260805 22:47:30.354053 25053 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:30.354102 25053 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:30.354234 25053 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:30.355449 25053 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/master-2/data/instance:
uuid: "c85d05dcb2f94f3f8ff437ee8666c548"
format_stamp: "Formatted at 2026-08-05 22:47:30 on dist-test-slave-gjrz"
server_key: "32a5548cd9e799de9e812f8298445ea1"
server_key_iv: "fe2b45ee33b636cb6367ae1f94cec302"
server_key_version: "encryptionkey@0"
I20260805 22:47:30.355815 25053 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/master-2/wal/instance:
uuid: "c85d05dcb2f94f3f8ff437ee8666c548"
format_stamp: "Formatted at 2026-08-05 22:47:30 on dist-test-slave-gjrz"
server_key: "32a5548cd9e799de9e812f8298445ea1"
server_key_iv: "fe2b45ee33b636cb6367ae1f94cec302"
server_key_version: "encryptionkey@0"
I20260805 22:47:30.357147 25053 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260805 22:47:30.357882 25081 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:30.358045 25053 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260805 22:47:30.358139 25053 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/master-2/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/master-2/wal
uuid: "c85d05dcb2f94f3f8ff437ee8666c548"
format_stamp: "Formatted at 2026-08-05 22:47:30 on dist-test-slave-gjrz"
server_key: "32a5548cd9e799de9e812f8298445ea1"
server_key_iv: "fe2b45ee33b636cb6367ae1f94cec302"
server_key_version: "encryptionkey@0"
I20260805 22:47:30.358208 25053 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:30.376812 25053 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:30.378711 25053 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:30.378832 25053 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:30.383005 25053 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.188:38037
I20260805 22:47:30.383044 25159 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.188:38037 every 8 connection(s)
I20260805 22:47:30.383422 25053 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/master-2/data/info.pb
I20260805 22:47:30.384431 25160 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:30.386054 25160 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.224.190" port: 42399 } has no permanent_uuid. Determining permanent_uuid...
I20260805 22:47:30.390164 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 25053
Aug 05 22:47:30 dist-test-slave-gjrz krb5kdc[24010](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970050, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.224.188@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM
I20260805 22:47:30.395190 24141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:30.386849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55278 (local address 127.14.224.190:42399)
0805 22:47:30.386914 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:30.386917 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:30.387079 (+ 162us) server_negotiation.cc:407] Connection header received
0805 22:47:30.387605 (+ 526us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:30.387606 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:30.387619 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:30.387672 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:30.388302 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.388792 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.389758 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.389945 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.390002 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:30.392458 (+ 2456us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:30.392460 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:30.392460 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:30.392468 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:30.393778 (+ 1310us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:30.394231 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:30.394232 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:30.394233 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:30.394301 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:30.394551 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:30.394552 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:30.394552 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:30.394699 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:30.394775 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:30.395002 (+ 227us) server_negotiation.cc:299] Negotiation successful
0805 22:47:30.395094 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260805 22:47:30.395404 25162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:30.386736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42399 (local address 127.0.0.1:55278)
0805 22:47:30.386940 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:30.386985 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:30.387498 (+ 513us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:30.387742 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:30.387747 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:30.388007 (+ 260us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:30.388210 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:30.388215 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.388879 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.388880 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:30.389672 (+ 792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:30.389675 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.390039 (+ 364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.390041 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:30.390167 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:30.390730 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:30.390739 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:30.392355 (+ 1616us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:30.393850 (+ 1495us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:30.393855 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:30.393858 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:30.394151 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:30.394367 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:30.394368 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:30.394368 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:30.394490 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:30.394760 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:30.394763 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:30.394883 (+ 120us) client_negotiation.cc:769] Sending connection context
0805 22:47:30.394963 (+ 80us) client_negotiation.cc:240] Negotiation successful
0805 22:47:30.395114 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":109,"threads_started":1}
Aug 05 22:47:30 dist-test-slave-gjrz krb5kdc[24010](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970049, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.14.224.188@KRBTEST.COM
I20260805 22:47:30.395960 25160 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.224.189" port: 44253 } has no permanent_uuid. Determining permanent_uuid...
I20260805 22:47:30.399206 25166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:30.390702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46134 (local address 127.14.224.188:38037)
0805 22:47:30.390886 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:30.390890 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:30.390911 (+ 21us) server_negotiation.cc:407] Connection header received
0805 22:47:30.390935 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:30.390937 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:30.390957 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:30.391033 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:30.391634 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.392512 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.393491 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.393800 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.393865 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:30.396543 (+ 2678us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:30.396551 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:30.396552 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:30.396559 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:30.398027 (+ 1468us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:30.398366 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:30.398369 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:30.398369 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:30.398437 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:30.398647 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:30.398648 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:30.398649 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:30.398833 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:30.398963 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:30.399064 (+ 101us) server_negotiation.cc:299] Negotiation successful
0805 22:47:30.399129 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":111,"threads_started":1}
Aug 05 22:47:30 dist-test-slave-gjrz krb5kdc[24010](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970050, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.224.188@KRBTEST.COM for oryx/127.14.224.189@KRBTEST.COM
I20260805 22:47:30.402127 25162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:30.396262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.189:44253 (local address 127.0.0.1:57696)
0805 22:47:30.396314 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:30.396326 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:30.396371 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:30.396489 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:30.396490 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:30.396620 (+ 130us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:30.396669 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:30.396671 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.397554 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.397555 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:30.398061 (+ 506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:30.398064 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.398431 (+ 367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.398432 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:30.398497 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:30.398836 (+ 339us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:30.398840 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:30.400156 (+ 1316us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:30.401376 (+ 1220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:30.401377 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:30.401378 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:30.401536 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:30.401672 (+ 136us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:30.401672 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:30.401672 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:30.401715 (+ 43us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:30.401892 (+ 177us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:30.401893 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:30.401928 (+ 35us) client_negotiation.cc:769] Sending connection context
0805 22:47:30.401987 (+ 59us) client_negotiation.cc:240] Negotiation successful
0805 22:47:30.402062 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260805 22:47:30.402130 25032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:30.396335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57696 (local address 127.14.224.189:44253)
0805 22:47:30.396387 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:30.396389 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:30.396411 (+ 22us) server_negotiation.cc:407] Connection header received
0805 22:47:30.396434 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:30.396435 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:30.396444 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:30.396482 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:30.396744 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.397483 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.398150 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.398363 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.398430 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:30.400241 (+ 1811us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:30.400242 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:30.400243 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:30.400250 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:30.401310 (+ 1060us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:30.401590 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:30.401590 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:30.401591 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:30.401636 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:30.401747 (+ 111us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:30.401747 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:30.401748 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:30.401843 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:30.401901 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:30.401990 (+ 89us) server_negotiation.cc:299] Negotiation successful
0805 22:47:30.402063 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260805 22:47:30.402537 25160 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.224.188" port: 38037 } has no permanent_uuid. Determining permanent_uuid...
Aug 05 22:47:30 dist-test-slave-gjrz krb5kdc[24010](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970050, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.224.188@KRBTEST.COM for oryx/127.14.224.188@KRBTEST.COM
I20260805 22:47:30.408078 25166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:30.402823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46138 (local address 127.14.224.188:38037)
0805 22:47:30.402856 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:30.402858 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:30.402865 (+ 7us) server_negotiation.cc:407] Connection header received
0805 22:47:30.402905 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:30.402906 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:30.402914 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:30.402961 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:30.403147 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.403653 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.404255 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.404448 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.404503 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:30.406035 (+ 1532us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:30.406036 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:30.406036 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:30.406043 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:30.407252 (+ 1209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:30.407537 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:30.407537 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:30.407537 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:30.407583 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:30.407698 (+ 115us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:30.407699 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:30.407699 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:30.407791 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:30.407832 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:30.407920 (+ 88us) server_negotiation.cc:299] Negotiation successful
0805 22:47:30.408010 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260805 22:47:30.408149 25162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:30.402780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.188:38037 (local address 127.0.0.1:46138)
0805 22:47:30.402822 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:30.402832 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:30.402867 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:30.402966 (+ 99us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:30.402966 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:30.403077 (+ 111us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:30.403109 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:30.403110 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.403709 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.403709 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:30.404185 (+ 476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:30.404187 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.404509 (+ 322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.404510 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:30.404546 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:30.404859 (+ 313us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:30.404863 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:30.405957 (+ 1094us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:30.407341 (+ 1384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:30.407343 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:30.407343 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:30.407484 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:30.407624 (+ 140us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:30.407625 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:30.407625 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:30.407667 (+ 42us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:30.407829 (+ 162us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:30.407829 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:30.407862 (+ 33us) client_negotiation.cc:769] Sending connection context
0805 22:47:30.407905 (+ 43us) client_negotiation.cc:240] Negotiation successful
0805 22:47:30.408067 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26,"mutex_wait_us":75}
I20260805 22:47:30.409595 25160 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c85d05dcb2f94f3f8ff437ee8666c548: Bootstrap starting.
I20260805 22:47:30.410419 25160 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c85d05dcb2f94f3f8ff437ee8666c548: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:30.410673 25160 log.cc:824] T 00000000000000000000000000000000 P c85d05dcb2f94f3f8ff437ee8666c548: Log is configured to *not* fsync() on all Append() calls
I20260805 22:47:30.411554 25160 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c85d05dcb2f94f3f8ff437ee8666c548: No bootstrap required, opened a new log
I20260805 22:47:30.413048 25160 raft_consensus.cc:348] T 00000000000000000000000000000000 P c85d05dcb2f94f3f8ff437ee8666c548 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 42399 } } peers { permanent_uuid: "233a2c69697b4b168b656c682271145c" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 44253 } } peers { permanent_uuid: "c85d05dcb2f94f3f8ff437ee8666c548" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 38037 } }
I20260805 22:47:30.413193 25160 raft_consensus.cc:374] T 00000000000000000000000000000000 P c85d05dcb2f94f3f8ff437ee8666c548 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:30.413225 25160 raft_consensus.cc:729] T 00000000000000000000000000000000 P c85d05dcb2f94f3f8ff437ee8666c548 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c85d05dcb2f94f3f8ff437ee8666c548, State: Initialized, Role: FOLLOWER
I20260805 22:47:30.413355 25160 consensus_queue.cc:260] T 00000000000000000000000000000000 P c85d05dcb2f94f3f8ff437ee8666c548 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 42399 } } peers { permanent_uuid: "233a2c69697b4b168b656c682271145c" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 44253 } } peers { permanent_uuid: "c85d05dcb2f94f3f8ff437ee8666c548" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 38037 } }
I20260805 22:47:30.413687 25160 sys_catalog.cc:564] T 00000000000000000000000000000000 P c85d05dcb2f94f3f8ff437ee8666c548 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:47:30.413631 25168 sys_catalog.cc:455] T 00000000000000000000000000000000 P c85d05dcb2f94f3f8ff437ee8666c548 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 42399 } } peers { permanent_uuid: "233a2c69697b4b168b656c682271145c" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 44253 } } peers { permanent_uuid: "c85d05dcb2f94f3f8ff437ee8666c548" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 38037 } } }
I20260805 22:47:30.413750 25168 sys_catalog.cc:458] T 00000000000000000000000000000000 P c85d05dcb2f94f3f8ff437ee8666c548 [sys.catalog]: This master's current role is: FOLLOWER
W20260805 22:47:30.415252 25185 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c85d05dcb2f94f3f8ff437ee8666c548: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260805 22:47:30.415335 25185 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260805 22:47:30.417804 25053 master_runner.cc:428] Detected that this master c85d05dcb2f94f3f8ff437ee8666c548 is joining an existing cluster
I20260805 22:47:30.417853 25053 master_runner.cc:432] Initiating AddMaster RPC to add 127.14.224.188:38037
I20260805 22:47:30.425566 25166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:30.419103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46154 (local address 127.14.224.188:38037)
0805 22:47:30.419138 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:30.419140 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:30.419392 (+ 252us) server_negotiation.cc:407] Connection header received
0805 22:47:30.419463 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:30.419464 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:30.419473 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:30.419523 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:30.419924 (+ 401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.420625 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.421728 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.422019 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.422059 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:30.423169 (+ 1110us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:30.423170 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:30.423171 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:30.423176 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:30.424481 (+ 1305us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:30.424871 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:30.424872 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:30.424872 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:30.424921 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:30.425116 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:30.425116 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:30.425117 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:30.425220 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:30.425268 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:30.425426 (+ 158us) server_negotiation.cc:299] Negotiation successful
0805 22:47:30.425499 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":18}
I20260805 22:47:30.425748 25194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:30.418921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.188:38037 (local address 127.0.0.1:46154)
0805 22:47:30.419330 (+ 409us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:30.419341 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:30.419414 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:30.419543 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:30.419543 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:30.419772 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:30.419842 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:30.419844 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.420709 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.420710 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:30.421638 (+ 928us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:30.421641 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.422141 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.422142 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:30.422196 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:30.422617 (+ 421us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:30.422622 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:30.423082 (+ 460us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:30.424564 (+ 1482us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:30.424566 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:30.424566 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:30.424803 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:30.424977 (+ 174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:30.424978 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:30.424979 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:30.425046 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:30.425274 (+ 228us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:30.425275 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:30.425333 (+ 58us) client_negotiation.cc:769] Sending connection context
0805 22:47:30.425407 (+ 74us) client_negotiation.cc:240] Negotiation successful
0805 22:47:30.425567 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":386,"mutex_wait_us":93,"thread_start_us":77,"threads_started":1}
I20260805 22:47:30.443455 24141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:30.418944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55282 (local address 127.14.224.190:42399)
0805 22:47:30.418996 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:30.418998 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:30.419115 (+ 117us) server_negotiation.cc:407] Connection header received
0805 22:47:30.419220 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:30.419221 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:30.419233 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:30.419301 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:30.419817 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.420573 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.421736 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.422084 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.422123 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:30.440887 (+ 18764us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:30.440890 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:30.440890 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:30.440900 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:30.442296 (+ 1396us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:30.442663 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:30.442664 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:30.442664 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:30.442722 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:30.442895 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:30.442896 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:30.442897 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:30.443032 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:30.443097 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:30.443245 (+ 148us) server_negotiation.cc:299] Negotiation successful
0805 22:47:30.443363 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260805 22:47:30.443490 25193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:30.418886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42399 (local address 127.0.0.1:55282)
0805 22:47:30.419057 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:30.419068 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:30.419142 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:30.419374 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:30.419375 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:30.419644 (+ 269us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:30.419729 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:30.419731 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.420663 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.420664 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:30.421640 (+ 976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:30.421643 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.422206 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.422206 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:30.422283 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:30.440364 (+ 18081us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:30.440369 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:30.440724 (+ 355us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:30.442396 (+ 1672us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:30.442398 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:30.442398 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:30.442590 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:30.442780 (+ 190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:30.442781 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:30.442781 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:30.442843 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:30.443094 (+ 251us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:30.443095 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:30.443149 (+ 54us) client_negotiation.cc:769] Sending connection context
0805 22:47:30.443215 (+ 66us) client_negotiation.cc:240] Negotiation successful
0805 22:47:30.443355 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"mutex_wait_us":35,"thread_start_us":93,"threads_started":1}
I20260805 22:47:30.444130 25192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:30.419152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.189:44253 (local address 127.0.0.1:57698)
0805 22:47:30.419644 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:30.419655 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:30.419730 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:30.419903 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:30.419904 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:30.420076 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:30.420132 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:30.420135 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.421001 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.421002 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:30.421779 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:30.421781 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.422257 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.422258 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:30.422307 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:30.440105 (+ 17798us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:30.440114 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:30.440724 (+ 610us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:30.442719 (+ 1995us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:30.442721 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:30.442721 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:30.442953 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:30.443162 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:30.443163 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:30.443163 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:30.443221 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:30.443793 (+ 572us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:30.443793 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:30.443856 (+ 63us) client_negotiation.cc:769] Sending connection context
0805 22:47:30.443915 (+ 59us) client_negotiation.cc:240] Negotiation successful
0805 22:47:30.444029 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":477,"thread_start_us":74,"threads_started":1}
I20260805 22:47:30.444182 25032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:30.419341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57698 (local address 127.14.224.189:44253)
0805 22:47:30.419384 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:30.419385 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:30.419706 (+ 321us) server_negotiation.cc:407] Connection header received
0805 22:47:30.419805 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:30.419806 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:30.419817 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:30.419846 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:30.420222 (+ 376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.420915 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.421862 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.422151 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.422188 (+ 37us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:30.440865 (+ 18677us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:30.440868 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:30.440868 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:30.440879 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:30.442603 (+ 1724us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:30.443037 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:30.443039 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:30.443039 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:30.443108 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:30.443347 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:30.443348 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:30.443348 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:30.443495 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:30.443542 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:30.443993 (+ 451us) server_negotiation.cc:299] Negotiation successful
0805 22:47:30.444083 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
Aug 05 22:47:30 dist-test-slave-gjrz krb5kdc[24010](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970049, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.224.190@KRBTEST.COM for oryx/127.14.224.188@KRBTEST.COM
I20260805 22:47:30.450627 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 24174
I20260805 22:47:30.458324 24923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:30.445756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.188:38037 (local address 127.0.0.1:46168)
0805 22:47:30.445813 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:30.445823 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:30.445859 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:30.446020 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:30.446021 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:30.446190 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:30.446241 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:30.446244 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.446904 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.446905 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:30.447768 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:30.447771 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.448106 (+ 335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.448106 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:30.448175 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:30.448529 (+ 354us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:30.448533 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:30.449916 (+ 1383us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:30.457221 (+ 7305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:30.457223 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:30.457223 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:30.457462 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:30.457667 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:30.457668 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:30.457669 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:30.457731 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:30.457978 (+ 247us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:30.457979 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:30.458034 (+ 55us) client_negotiation.cc:769] Sending connection context
0805 22:47:30.458095 (+ 61us) client_negotiation.cc:240] Negotiation successful
0805 22:47:30.458221 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260805 22:47:30.458324 25166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:30.445859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46168 (local address 127.14.224.188:38037)
0805 22:47:30.445898 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:30.445900 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:30.445909 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:47:30.445944 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:30.445945 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:30.445954 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:30.446004 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:30.446304 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.446831 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.447851 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.448038 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.448094 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:30.450013 (+ 1919us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:30.450015 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:30.450015 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:30.450025 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:30.457086 (+ 7061us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:30.457542 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:30.457543 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:30.457544 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:30.457606 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:30.457786 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:30.457787 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:30.457787 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:30.457918 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:30.457979 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:30.458128 (+ 149us) server_negotiation.cc:299] Negotiation successful
0805 22:47:30.458219 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260805 22:47:30.459018 24068 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.14.224.188:38037: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "c85d05dcb2f94f3f8ff437ee8666c548"
member_type: NON_VOTER
last_known_addr {
host: "127.14.224.188"
port: 38037
}
attrs {
promote: true
}
}
dest_uuid: "f0fb2e45b5414c06af56004d3bea4ca8"
cas_config_opid_index: 5
I20260805 22:47:30.459309 24068 consensus_queue.cc:237] T 00000000000000000000000000000000 P f0fb2e45b5414c06af56004d3bea4ca8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 42399 } } peers { permanent_uuid: "233a2c69697b4b168b656c682271145c" member_type: NON_VOTER last_known_addr { host: "127.14.224.189" port: 44253 } attrs { promote: true } } peers { permanent_uuid: "c85d05dcb2f94f3f8ff437ee8666c548" member_type: NON_VOTER last_known_addr { host: "127.14.224.188" port: 38037 } attrs { promote: true } }
I20260805 22:47:30.459906 24925 raft_consensus.cc:2932] T 00000000000000000000000000000000 P f0fb2e45b5414c06af56004d3bea4ca8 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER c85d05dcb2f94f3f8ff437ee8666c548 (127.14.224.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 42399 } } peers { permanent_uuid: "233a2c69697b4b168b656c682271145c" member_type: NON_VOTER last_known_addr { host: "127.14.224.189" port: 44253 } attrs { promote: true } } peers { permanent_uuid: "c85d05dcb2f94f3f8ff437ee8666c548" member_type: NON_VOTER last_known_addr { host: "127.14.224.188" port: 38037 } attrs { promote: true } } }
I20260805 22:47:30.460765 24925 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.14.224.188:38037
I20260805 22:47:30.460855 24925 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0fb2e45b5414c06af56004d3bea4ca8 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 42399 } } peers { permanent_uuid: "233a2c69697b4b168b656c682271145c" member_type: NON_VOTER last_known_addr { host: "127.14.224.189" port: 44253 } attrs { promote: true } } peers { permanent_uuid: "c85d05dcb2f94f3f8ff437ee8666c548" member_type: NON_VOTER last_known_addr { host: "127.14.224.188" port: 38037 } attrs { promote: true } } }
I20260805 22:47:30.461038 24925 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0fb2e45b5414c06af56004d3bea4ca8 [sys.catalog]: This master's current role is: LEADER
I20260805 22:47:30.461366 25053 master.cc:537] Master@127.14.224.188:38037 shutting down...
I20260805 22:47:30.461644 25121 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c85d05dcb2f94f3f8ff437ee8666c548 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:30.462689 25121 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c85d05dcb2f94f3f8ff437ee8666c548 [term 1 FOLLOWER]: Refusing update from remote peer f0fb2e45b5414c06af56004d3bea4ca8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260805 22:47:30.463109 24924 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f0fb2e45b5414c06af56004d3bea4ca8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85d05dcb2f94f3f8ff437ee8666c548" member_type: NON_VOTER last_known_addr { host: "127.14.224.188" port: 38037 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
W20260805 22:47:30.464015 24048 consensus_peers.cc:487] T 00000000000000000000000000000000 P f0fb2e45b5414c06af56004d3bea4ca8 -> Peer c85d05dcb2f94f3f8ff437ee8666c548 (127.14.224.188:38037): Couldn't send request to peer c85d05dcb2f94f3f8ff437ee8666c548. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260805 22:47:30.465379 24923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:30.459794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.189:44253 (local address 127.0.0.1:57714)
0805 22:47:30.461427 (+ 1633us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:30.461441 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:30.461489 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:30.461733 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:30.461735 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:30.461737 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:47:30.461797 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:30.461799 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.462791 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.462792 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:30.464412 (+ 1620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:30.464416 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.465100 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.465101 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:30.465163 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:30.465196 (+ 33us) client_negotiation.cc:769] Sending connection context
0805 22:47:30.465261 (+ 65us) client_negotiation.cc:240] Negotiation successful
0805 22:47:30.465308 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1611}
I20260805 22:47:30.465646 25032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:30.459856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57714 (local address 127.14.224.189:44253)
0805 22:47:30.459902 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:30.459904 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:30.461545 (+ 1641us) server_negotiation.cc:407] Connection header received
0805 22:47:30.461579 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:30.461581 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:30.461607 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:30.461664 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:47:30.461892 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.462630 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.464503 (+ 1873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.465026 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.465103 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:30.465193 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:30.465523 (+ 330us) server_negotiation.cc:299] Negotiation successful
0805 22:47:30.465576 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260805 22:47:30.465889 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.129:42859
--local_ip_for_outbound_sockets=127.14.224.129
--tserver_master_addrs=127.14.224.190:42399
--webserver_port=33671
--webserver_interface=127.14.224.129
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/krb5kdc/oryx_127.14.224.129.keytab
--principal=oryx/127.14.224.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:43165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.14.224.190:42399,127.14.224.189:44253
--tserver_master_addrs=127.14.224.190:42399,127.14.224.189:44253,127.14.224.188:38037 with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 22:47:30.466436 25053 raft_consensus.cc:2229] T 00000000000000000000000000000000 P c85d05dcb2f94f3f8ff437ee8666c548 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:47:30.466547 25053 raft_consensus.cc:2258] T 00000000000000000000000000000000 P c85d05dcb2f94f3f8ff437ee8666c548 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:47:30.466612 25053 tablet_replica.cc:330] T 00000000000000000000000000000000 P c85d05dcb2f94f3f8ff437ee8666c548: stopping tablet replica
I20260805 22:47:30.467692 24993 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c [term 1 LEARNER]: Refusing update from remote peer f0fb2e45b5414c06af56004d3bea4ca8: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260805 22:47:30.467957 24924 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f0fb2e45b5414c06af56004d3bea4ca8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "233a2c69697b4b168b656c682271145c" member_type: NON_VOTER last_known_addr { host: "127.14.224.189" port: 44253 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260805 22:47:30.468623 24993 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER c85d05dcb2f94f3f8ff437ee8666c548 (127.14.224.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 42399 } } peers { permanent_uuid: "233a2c69697b4b168b656c682271145c" member_type: NON_VOTER last_known_addr { host: "127.14.224.189" port: 44253 } attrs { promote: true } } peers { permanent_uuid: "c85d05dcb2f94f3f8ff437ee8666c548" member_type: NON_VOTER last_known_addr { host: "127.14.224.188" port: 38037 } attrs { promote: true } } }
I20260805 22:47:30.469708 25201 sys_catalog.cc:455] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 42399 } } peers { permanent_uuid: "233a2c69697b4b168b656c682271145c" member_type: NON_VOTER last_known_addr { host: "127.14.224.189" port: 44253 } attrs { promote: true } } peers { permanent_uuid: "c85d05dcb2f94f3f8ff437ee8666c548" member_type: NON_VOTER last_known_addr { host: "127.14.224.188" port: 38037 } attrs { promote: true } } }
I20260805 22:47:30.469874 25201 sys_catalog.cc:458] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c [sys.catalog]: This master's current role is: LEARNER
I20260805 22:47:30.469947 25033 sys_catalog.cc:455] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c [sys.catalog]: SysCatalogTable state changed. Reason: New leader f0fb2e45b5414c06af56004d3bea4ca8. Latest consensus state: current_term: 1 leader_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 42399 } } peers { permanent_uuid: "233a2c69697b4b168b656c682271145c" member_type: NON_VOTER last_known_addr { host: "127.14.224.189" port: 44253 } attrs { promote: true } } peers { permanent_uuid: "c85d05dcb2f94f3f8ff437ee8666c548" member_type: NON_VOTER last_known_addr { host: "127.14.224.188" port: 38037 } attrs { promote: true } } }
I20260805 22:47:30.469973 24924 raft_consensus.cc:1050] T 00000000000000000000000000000000 P f0fb2e45b5414c06af56004d3bea4ca8: attempting to promote NON_VOTER 233a2c69697b4b168b656c682271145c to VOTER
I20260805 22:47:30.470017 25033 sys_catalog.cc:458] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c [sys.catalog]: This master's current role is: LEARNER
I20260805 22:47:30.470191 24924 consensus_queue.cc:237] T 00000000000000000000000000000000 P f0fb2e45b5414c06af56004d3bea4ca8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 42399 } } peers { permanent_uuid: "233a2c69697b4b168b656c682271145c" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 44253 } attrs { promote: false } } peers { permanent_uuid: "c85d05dcb2f94f3f8ff437ee8666c548" member_type: NON_VOTER last_known_addr { host: "127.14.224.188" port: 38037 } attrs { promote: true } }
I20260805 22:47:30.470928 24923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:30.470807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.188:38037 (local address 127.0.0.1:46180)
0805 22:47:30.470850 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:30.470895 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.188:38037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
I20260805 22:47:30.470965 24993 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c [term 1 LEARNER]: Refusing update from remote peer f0fb2e45b5414c06af56004d3bea4ca8: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
W20260805 22:47:30.471110 24048 consensus_peers.cc:487] T 00000000000000000000000000000000 P f0fb2e45b5414c06af56004d3bea4ca8 -> Peer c85d05dcb2f94f3f8ff437ee8666c548 (127.14.224.188:38037): Couldn't send request to peer c85d05dcb2f94f3f8ff437ee8666c548. Status: Network error: Client connection negotiation failed: client connection to 127.14.224.188:38037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260805 22:47:30.471165 24925 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f0fb2e45b5414c06af56004d3bea4ca8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "233a2c69697b4b168b656c682271145c" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 44253 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260805 22:47:30.471837 25205 raft_consensus.cc:2932] T 00000000000000000000000000000000 P f0fb2e45b5414c06af56004d3bea4ca8 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 233a2c69697b4b168b656c682271145c (127.14.224.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 42399 } } peers { permanent_uuid: "233a2c69697b4b168b656c682271145c" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 44253 } attrs { promote: false } } peers { permanent_uuid: "c85d05dcb2f94f3f8ff437ee8666c548" member_type: NON_VOTER last_known_addr { host: "127.14.224.188" port: 38037 } attrs { promote: true } } }
I20260805 22:47:30.471994 24993 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 233a2c69697b4b168b656c682271145c (127.14.224.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 42399 } } peers { permanent_uuid: "233a2c69697b4b168b656c682271145c" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 44253 } attrs { promote: false } } peers { permanent_uuid: "c85d05dcb2f94f3f8ff437ee8666c548" member_type: NON_VOTER last_known_addr { host: "127.14.224.188" port: 38037 } attrs { promote: true } } }
I20260805 22:47:30.472914 25033 sys_catalog.cc:455] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 42399 } } peers { permanent_uuid: "233a2c69697b4b168b656c682271145c" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 44253 } attrs { promote: false } } peers { permanent_uuid: "c85d05dcb2f94f3f8ff437ee8666c548" member_type: NON_VOTER last_known_addr { host: "127.14.224.188" port: 38037 } attrs { promote: true } } }
I20260805 22:47:30.472998 25033 sys_catalog.cc:458] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c [sys.catalog]: This master's current role is: FOLLOWER
I20260805 22:47:30.472977 25205 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0fb2e45b5414c06af56004d3bea4ca8 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 42399 } } peers { permanent_uuid: "233a2c69697b4b168b656c682271145c" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 44253 } attrs { promote: false } } peers { permanent_uuid: "c85d05dcb2f94f3f8ff437ee8666c548" member_type: NON_VOTER last_known_addr { host: "127.14.224.188" port: 38037 } attrs { promote: true } } }
I20260805 22:47:30.473067 24925 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0fb2e45b5414c06af56004d3bea4ca8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 42399 } } peers { permanent_uuid: "233a2c69697b4b168b656c682271145c" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 44253 } attrs { promote: false } } peers { permanent_uuid: "c85d05dcb2f94f3f8ff437ee8666c548" member_type: NON_VOTER last_known_addr { host: "127.14.224.188" port: 38037 } attrs { promote: true } } }
I20260805 22:47:30.473232 24925 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0fb2e45b5414c06af56004d3bea4ca8 [sys.catalog]: This master's current role is: LEADER
I20260805 22:47:30.473191 25205 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0fb2e45b5414c06af56004d3bea4ca8 [sys.catalog]: This master's current role is: LEADER
I20260805 22:47:30.482201 25053 master.cc:552] Master@127.14.224.188:38037 shutdown complete.
I20260805 22:47:30.482266 25053 master_runner.cc:305] Clearing existing system tablet
I20260805 22:47:30.482398 25053 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:30.482437 25053 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:30.483227 25053 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:47:30.483800 25208 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:30.483978 25053 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:30.484038 25053 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:30.484086 25053 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/master-2/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/master-2/wal
uuid: "c85d05dcb2f94f3f8ff437ee8666c548"
format_stamp: "Formatted at 2026-08-05 22:47:30 on dist-test-slave-gjrz"
server_key: "32a5548cd9e799de9e812f8298445ea1"
server_key_iv: "fe2b45ee33b636cb6367ae1f94cec302"
server_key_version: "encryptionkey@0"
I20260805 22:47:30.484899 25053 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P c85d05dcb2f94f3f8ff437ee8666c548: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:47:30.486652 25053 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P c85d05dcb2f94f3f8ff437ee8666c548: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260805 22:47:30.486738 25053 log.cc:1196] T 00000000000000000000000000000000 P c85d05dcb2f94f3f8ff437ee8666c548: Deleting WAL directory at /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260805 22:47:30.486954 25053 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P c85d05dcb2f94f3f8ff437ee8666c548: Deleting consensus metadata
I20260805 22:47:30.487095 25053 master_runner.cc:315] Copying system tablet from 127.14.224.190:42399
I20260805 22:47:30.487752 25053 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P c85d05dcb2f94f3f8ff437ee8666c548: tablet copy: Beginning tablet copy session from remote peer at address 127.14.224.190:42399
I20260805 22:47:30.495623 24141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:30.488164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55288 (local address 127.14.224.190:42399)
0805 22:47:30.488213 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:30.488215 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:30.488311 (+ 96us) server_negotiation.cc:407] Connection header received
0805 22:47:30.488372 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:30.488373 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:30.488383 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:30.488456 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:30.488854 (+ 398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.489643 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.490787 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.491133 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.491201 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:30.492625 (+ 1424us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:30.492627 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:30.492627 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:30.492638 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:30.494273 (+ 1635us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:30.494723 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:30.494725 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:30.494725 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:30.494794 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:30.495010 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:30.495011 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:30.495011 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:30.495160 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:30.495225 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:30.495434 (+ 209us) server_negotiation.cc:299] Negotiation successful
0805 22:47:30.495523 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260805 22:47:30.495652 25218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:30.488085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42399 (local address 127.0.0.1:55288)
0805 22:47:30.488228 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:30.488240 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:30.488312 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:30.488480 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:30.488481 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:30.488706 (+ 225us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:30.488772 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:30.488775 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.489745 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.489747 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:30.490616 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:30.490620 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.491232 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.491233 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:30.491585 (+ 352us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:30.492077 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:30.492082 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:30.492496 (+ 414us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:30.494375 (+ 1879us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:30.494376 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:30.494377 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:30.494638 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:30.494864 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:30.494865 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:30.494866 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:30.494944 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:30.495230 (+ 286us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:30.495232 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:30.495326 (+ 94us) client_negotiation.cc:769] Sending connection context
0805 22:47:30.495403 (+ 77us) client_negotiation.cc:240] Negotiation successful
0805 22:47:30.495545 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":81,"threads_started":1}
I20260805 22:47:30.496178 24106 tablet_copy_service.cc:140] P f0fb2e45b5414c06af56004d3bea4ca8: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer c85d05dcb2f94f3f8ff437ee8666c548 ({username='oryx', principal='oryx/127.14.224.188@KRBTEST.COM'} at 127.0.0.1:55288)
I20260805 22:47:30.496245 24106 tablet_copy_service.cc:161] P f0fb2e45b5414c06af56004d3bea4ca8: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer c85d05dcb2f94f3f8ff437ee8666c548 at {username='oryx', principal='oryx/127.14.224.188@KRBTEST.COM'} at 127.0.0.1:55288: session id = c85d05dcb2f94f3f8ff437ee8666c548-00000000000000000000000000000000
I20260805 22:47:30.496893 24106 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P f0fb2e45b5414c06af56004d3bea4ca8: Tablet Copy: opened 0 blocks and 1 log segments
I20260805 22:47:30.497453 25053 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260805 22:47:30.498798 25053 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P c85d05dcb2f94f3f8ff437ee8666c548: tablet copy: Starting download of 0 data blocks...
I20260805 22:47:30.498943 25053 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P c85d05dcb2f94f3f8ff437ee8666c548: tablet copy: Starting download of 1 WAL segments...
I20260805 22:47:30.499891 25053 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P c85d05dcb2f94f3f8ff437ee8666c548: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260805 22:47:30.500970 24106 tablet_copy_service.cc:342] P f0fb2e45b5414c06af56004d3bea4ca8: Request end of tablet copy session c85d05dcb2f94f3f8ff437ee8666c548-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.14.224.188@KRBTEST.COM'} at 127.0.0.1:55288
I20260805 22:47:30.501034 24106 tablet_copy_service.cc:433] P f0fb2e45b5414c06af56004d3bea4ca8: ending tablet copy session c85d05dcb2f94f3f8ff437ee8666c548-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer c85d05dcb2f94f3f8ff437ee8666c548
I20260805 22:47:30.506717 25053 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:30.508277 25228 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:30.508296 25223 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:30.512602 25053 server_base.cc:1034] running on GCE node
W20260805 22:47:30.515837 25224 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:30.516067 25053 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:30.516283 25053 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:30.517408 25053 hybrid_clock.cc:648] HybridClock initialized: now 1785970050517408 us; error 67 us; skew 500 ppm
Aug 05 22:47:30 dist-test-slave-gjrz krb5kdc[24010](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970050, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.224.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:30.519172 25053 init.cc:377] Logged in from keytab as oryx/127.14.224.188@KRBTEST.COM (short username oryx)
I20260805 22:47:30.519547 25053 webserver.cc:460] Webserver started at http://127.14.224.188:40877/ using document root <none> and password file <none>
I20260805 22:47:30.519665 25053 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:30.519691 25053 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:30.520504 25053 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:47:30.521108 25236 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:30.521277 25053 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:30.521327 25053 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/master-2/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/master-2/wal
uuid: "c85d05dcb2f94f3f8ff437ee8666c548"
format_stamp: "Formatted at 2026-08-05 22:47:30 on dist-test-slave-gjrz"
server_key: "32a5548cd9e799de9e812f8298445ea1"
server_key_iv: "fe2b45ee33b636cb6367ae1f94cec302"
server_key_version: "encryptionkey@0"
I20260805 22:47:30.521385 25053 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:30.543073 25053 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:30.545202 25053 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:30.548537 25053 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.188:38037
I20260805 22:47:30.548592 25310 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.188:38037 every 8 connection(s)
I20260805 22:47:30.549054 25053 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/master-2/data/info.pb
I20260805 22:47:30.550099 25311 sys_catalog.cc:263] Verifying existing consensus state
I20260805 22:47:30.550599 25311 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c85d05dcb2f94f3f8ff437ee8666c548: Bootstrap starting.
I20260805 22:47:30.553819 25311 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c85d05dcb2f94f3f8ff437ee8666c548: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260805 22:47:30.554052 25311 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c85d05dcb2f94f3f8ff437ee8666c548: Bootstrap complete.
I20260805 22:47:30.554314 25311 raft_consensus.cc:348] T 00000000000000000000000000000000 P c85d05dcb2f94f3f8ff437ee8666c548 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 42399 } } peers { permanent_uuid: "233a2c69697b4b168b656c682271145c" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 44253 } attrs { promote: false } } peers { permanent_uuid: "c85d05dcb2f94f3f8ff437ee8666c548" member_type: NON_VOTER last_known_addr { host: "127.14.224.188" port: 38037 } attrs { promote: true } }
I20260805 22:47:30.554411 25311 raft_consensus.cc:729] T 00000000000000000000000000000000 P c85d05dcb2f94f3f8ff437ee8666c548 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c85d05dcb2f94f3f8ff437ee8666c548, State: Initialized, Role: LEARNER
I20260805 22:47:30.554445 25311 consensus_queue.cc:260] T 00000000000000000000000000000000 P c85d05dcb2f94f3f8ff437ee8666c548 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 42399 } } peers { permanent_uuid: "233a2c69697b4b168b656c682271145c" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 44253 } attrs { promote: false } } peers { permanent_uuid: "c85d05dcb2f94f3f8ff437ee8666c548" member_type: NON_VOTER last_known_addr { host: "127.14.224.188" port: 38037 } attrs { promote: true } }
I20260805 22:47:30.554641 25311 sys_catalog.cc:564] T 00000000000000000000000000000000 P c85d05dcb2f94f3f8ff437ee8666c548 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:47:30.554670 25314 sys_catalog.cc:455] T 00000000000000000000000000000000 P c85d05dcb2f94f3f8ff437ee8666c548 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 42399 } } peers { permanent_uuid: "233a2c69697b4b168b656c682271145c" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 44253 } attrs { promote: false } } peers { permanent_uuid: "c85d05dcb2f94f3f8ff437ee8666c548" member_type: NON_VOTER last_known_addr { host: "127.14.224.188" port: 38037 } attrs { promote: true } } }
I20260805 22:47:30.554896 25314 sys_catalog.cc:458] T 00000000000000000000000000000000 P c85d05dcb2f94f3f8ff437ee8666c548 [sys.catalog]: This master's current role is: LEARNER
I20260805 22:47:30.556239 25331 catalog_manager.cc:1259] Loaded cluster ID: 03236882b32e4ccf9fe1162c00642f68
I20260805 22:47:30.556627 25331 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c85d05dcb2f94f3f8ff437ee8666c548: loading cluster ID for follower catalog manager: success
I20260805 22:47:30.558100 25331 catalog_manager.cc:1574] T 00000000000000000000000000000000 P c85d05dcb2f94f3f8ff437ee8666c548: acquiring CA information for follower catalog manager: success
I20260805 22:47:30.558562 25331 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c85d05dcb2f94f3f8ff437ee8666c548: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260805 22:47:30.575898 25199 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:30.576146 25199 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:30.576181 25199 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:30.577454 25199 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:30.577510 25199 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:30.577548 25199 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.129
I20260805 22:47:30.579196 25199 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:43165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/krb5kdc/oryx_127.14.224.129.keytab
--principal=oryx/127.14.224.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.129:42859
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.224.129
--webserver_port=33671
--tserver_master_addrs=127.14.224.190:42399,127.14.224.189:44253,127.14.224.188:38037
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25199
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.129
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:30.579490 25199 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:30.579726 25199 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:30.585038 25342 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:30.585124 25199 server_base.cc:1034] running on GCE node
W20260805 22:47:30.585096 25344 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:30.585038 25338 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:30.585525 25199 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:30.585788 25199 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:30.586931 25199 hybrid_clock.cc:648] HybridClock initialized: now 1785970050586919 us; error 34 us; skew 500 ppm
Aug 05 22:47:30 dist-test-slave-gjrz krb5kdc[24010](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970050, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.224.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:30.589627 25199 init.cc:377] Logged in from keytab as oryx/127.14.224.129@KRBTEST.COM (short username oryx)
I20260805 22:47:30.590104 25199 webserver.cc:460] Webserver started at http://127.14.224.129:33671/ using document root <none> and password file <none>
I20260805 22:47:30.590320 25199 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:30.590389 25199 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:30.591831 25199 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260805 22:47:30.592392 25353 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:30.592555 25199 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260805 22:47:30.592650 25199 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-0/wal
uuid: "936d4bcf12614852a0aede9ed99863a0"
format_stamp: "Formatted at 2026-08-05 22:47:29 on dist-test-slave-gjrz"
server_key: "7bd28843c4d311259a31e16ee8c93b45"
server_key_iv: "571a9df42382ef80d73c14f708fa22ba"
server_key_version: "encryptionkey@0"
I20260805 22:47:30.592999 25199 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:30.617340 25199 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:30.619578 25199 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:30.619735 25199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:30.619976 25199 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:47:30.620285 25199 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:47:30.620319 25199 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:30.620352 25199 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:47:30.620373 25199 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:30.626470 25199 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.129:42859
I20260805 22:47:30.626560 25525 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.129:42859 every 8 connection(s)
I20260805 22:47:30.626901 25199 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
Aug 05 22:47:30 dist-test-slave-gjrz krb5kdc[24010](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970050, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.224.129@KRBTEST.COM for oryx/127.14.224.189@KRBTEST.COM
I20260805 22:47:30.635392 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 25199
Aug 05 22:47:30 dist-test-slave-gjrz krb5kdc[24010](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970050, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.224.129@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM
I20260805 22:47:30.635542 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 24370
Aug 05 22:47:30 dist-test-slave-gjrz krb5kdc[24010](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970050, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.224.129@KRBTEST.COM for oryx/127.14.224.188@KRBTEST.COM
I20260805 22:47:30.639139 24141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:30.628275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.129:47437 (local address 127.14.224.190:42399)
0805 22:47:30.628340 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:30.628342 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:30.628394 (+ 52us) server_negotiation.cc:407] Connection header received
0805 22:47:30.629338 (+ 944us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:30.629340 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:30.629352 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:30.629398 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:30.630248 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.631034 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.633133 (+ 2099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.633372 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.633420 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:30.635848 (+ 2428us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:30.635850 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:30.635851 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:30.635859 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:30.637395 (+ 1536us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:30.637917 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:30.637918 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:30.637919 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:30.637983 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:30.638305 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:30.638307 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:30.638307 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:30.638478 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:30.638527 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:30.638945 (+ 418us) server_negotiation.cc:299] Negotiation successful
0805 22:47:30.639031 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260805 22:47:30.639757 25533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:30.628131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42399 (local address 127.14.224.129:47437)
0805 22:47:30.628341 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:30.628351 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:30.629152 (+ 801us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:30.629423 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:30.629427 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:30.629908 (+ 481us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:30.630137 (+ 229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:30.630143 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.632323 (+ 2180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.632324 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:30.633054 (+ 730us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:30.633056 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.633446 (+ 390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.633447 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:30.633510 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:30.633839 (+ 329us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:30.633843 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:30.635739 (+ 1896us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:30.637479 (+ 1740us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:30.637490 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:30.637494 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:30.637822 (+ 328us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:30.638059 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:30.638072 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:30.638072 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:30.638219 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:30.638579 (+ 360us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:30.638587 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:30.638766 (+ 179us) client_negotiation.cc:769] Sending connection context
0805 22:47:30.639314 (+ 548us) client_negotiation.cc:240] Negotiation successful
0805 22:47:30.639508 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":75,"threads_started":1}
I20260805 22:47:30.640232 25530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:30.627753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.129:49351 (local address 127.14.224.188:38037)
0805 22:47:30.627935 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:30.627937 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:30.628138 (+ 201us) server_negotiation.cc:407] Connection header received
0805 22:47:30.629465 (+ 1327us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:30.629466 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:30.629482 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:30.629544 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:30.631151 (+ 1607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.631843 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.632933 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.633178 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.633243 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:30.637128 (+ 3885us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:30.637129 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:30.637129 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:30.637138 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:30.638996 (+ 1858us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:30.639373 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:30.639374 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:30.639374 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:30.639440 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:30.639653 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:30.639654 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:30.639655 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:30.639788 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:30.639834 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:30.640041 (+ 207us) server_negotiation.cc:299] Negotiation successful
0805 22:47:30.640142 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":62,"threads_started":1}
I20260805 22:47:30.640512 25531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:30.627761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.188:38037 (local address 127.14.224.129:49351)
0805 22:47:30.628005 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:30.628042 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:30.629130 (+ 1088us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:30.629565 (+ 435us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:30.629566 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:30.629908 (+ 342us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:30.630138 (+ 230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:30.630145 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.631949 (+ 1804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.631950 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:30.632844 (+ 894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:30.632847 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.633242 (+ 395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.633243 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:30.633309 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:30.633721 (+ 412us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:30.633725 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:30.637011 (+ 3286us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:30.639080 (+ 2069us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:30.639080 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:30.639081 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:30.639288 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:30.639512 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:30.639513 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:30.639513 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:30.639582 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:30.639882 (+ 300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:30.639883 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:30.639927 (+ 44us) client_negotiation.cc:769] Sending connection context
0805 22:47:30.640312 (+ 385us) client_negotiation.cc:240] Negotiation successful
0805 22:47:30.640418 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":209,"mutex_wait_us":43,"thread_start_us":91,"threads_started":1}
I20260805 22:47:30.640964 25526 heartbeater.cc:347] Connected to a master server at 127.14.224.188:38037
I20260805 22:47:30.641080 25526 heartbeater.cc:464] Registering TS with master...
I20260805 22:47:30.641323 25032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:30.627846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.129:46181 (local address 127.14.224.189:44253)
0805 22:47:30.627912 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:30.627915 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:30.628144 (+ 229us) server_negotiation.cc:407] Connection header received
0805 22:47:30.629260 (+ 1116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:30.629262 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:30.629277 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:30.629330 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:30.630273 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.631038 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.632315 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.632508 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.632586 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:30.635450 (+ 2864us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:30.635452 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:30.635452 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:30.635462 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:30.639941 (+ 4479us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:30.640441 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:30.640443 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:30.640443 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:30.640510 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:30.640794 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:30.640795 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:30.640795 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:30.640949 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:30.641014 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:30.641151 (+ 137us) server_negotiation.cc:299] Negotiation successful
0805 22:47:30.641229 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260805 22:47:30.641330 25532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:30.627761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.189:44253 (local address 127.14.224.129:46181)
0805 22:47:30.627995 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:30.628042 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:30.629147 (+ 1105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:30.629422 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:30.629427 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:30.629916 (+ 489us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:30.630138 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:30.630145 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.631150 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.631151 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:30.632220 (+ 1069us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:30.632223 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.632605 (+ 382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.632606 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:30.632737 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:30.633547 (+ 810us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:30.633584 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:30.635345 (+ 1761us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:30.640056 (+ 4711us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:30.640057 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:30.640057 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:30.640300 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:30.640595 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:30.640596 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:30.640596 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:30.640686 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:30.641011 (+ 325us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:30.641012 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:30.641056 (+ 44us) client_negotiation.cc:769] Sending connection context
0805 22:47:30.641119 (+ 63us) client_negotiation.cc:240] Negotiation successful
0805 22:47:30.641228 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":190,"mutex_wait_us":6,"thread_start_us":108,"threads_started":1}
I20260805 22:47:30.641335 25526 heartbeater.cc:511] Master 127.14.224.188:38037 requested a full tablet report, sending...
I20260805 22:47:30.641671 25528 heartbeater.cc:347] Connected to a master server at 127.14.224.189:44253
I20260805 22:47:30.641716 25528 heartbeater.cc:464] Registering TS with master...
I20260805 22:47:30.641778 25528 heartbeater.cc:511] Master 127.14.224.189:44253 requested a full tablet report, sending...
I20260805 22:47:30.641989 25257 ts_manager.cc:194] Registered new tserver with Master: 936d4bcf12614852a0aede9ed99863a0 (127.14.224.129:42859)
I20260805 22:47:30.642235 24977 ts_manager.cc:194] Registered new tserver with Master: 936d4bcf12614852a0aede9ed99863a0 (127.14.224.129:42859)
I20260805 22:47:30.646646 25527 heartbeater.cc:347] Connected to a master server at 127.14.224.190:42399
I20260805 22:47:30.646732 25527 heartbeater.cc:464] Registering TS with master...
I20260805 22:47:30.646816 25527 heartbeater.cc:511] Master 127.14.224.190:42399 requested a full tablet report, sending...
I20260805 22:47:30.647782 24068 ts_manager.cc:194] Re-registered known tserver with Master: 936d4bcf12614852a0aede9ed99863a0 (127.14.224.129:42859)
I20260805 22:47:30.648301 24068 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.14.224.129@KRBTEST.COM'} at 127.14.224.129:47437
I20260805 22:47:30.651314 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.130:40547
--local_ip_for_outbound_sockets=127.14.224.130
--tserver_master_addrs=127.14.224.190:42399
--webserver_port=41591
--webserver_interface=127.14.224.130
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/krb5kdc/oryx_127.14.224.130.keytab
--principal=oryx/127.14.224.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:43165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.14.224.190:42399,127.14.224.189:44253
--tserver_master_addrs=127.14.224.190:42399,127.14.224.189:44253,127.14.224.188:38037 with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:47:30.736953 25534 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:30.737179 25534 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:30.737205 25534 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:30.738417 25534 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:30.738458 25534 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:30.738484 25534 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.130
I20260805 22:47:30.740142 25534 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:43165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/krb5kdc/oryx_127.14.224.130.keytab
--principal=oryx/127.14.224.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.130:40547
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.224.130
--webserver_port=41591
--tserver_master_addrs=127.14.224.190:42399,127.14.224.189:44253,127.14.224.188:38037
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25534
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.130
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:30.740374 25534 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:30.740576 25534 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:30.745689 25541 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:30.745689 25546 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:30.745708 25540 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:30.746135 25534 server_base.cc:1034] running on GCE node
I20260805 22:47:30.746347 25534 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:30.746599 25534 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:30.747749 25534 hybrid_clock.cc:648] HybridClock initialized: now 1785970050747735 us; error 31 us; skew 500 ppm
Aug 05 22:47:30 dist-test-slave-gjrz krb5kdc[24010](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970050, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.224.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:30.750424 25534 init.cc:377] Logged in from keytab as oryx/127.14.224.130@KRBTEST.COM (short username oryx)
I20260805 22:47:30.750954 25534 webserver.cc:460] Webserver started at http://127.14.224.130:41591/ using document root <none> and password file <none>
I20260805 22:47:30.751223 25534 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:30.751336 25534 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:30.752780 25534 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:47:30.753474 25559 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:30.753639 25534 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:47:30.753733 25534 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-1/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-1/wal
uuid: "89b1294014344834957f89fad6b58def"
format_stamp: "Formatted at 2026-08-05 22:47:29 on dist-test-slave-gjrz"
server_key: "341eeef424244f62b4ab0fae725c95f3"
server_key_iv: "6e6c8ee9230c89cc59dc18bbeae733e4"
server_key_version: "encryptionkey@0"
I20260805 22:47:30.754140 25534 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:30.773464 25534 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:30.775501 25534 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:30.775660 25534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:30.775889 25534 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:47:30.776218 25534 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:47:30.776257 25534 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:30.776289 25534 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:47:30.776314 25534 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:30.782502 25534 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.130:40547
I20260805 22:47:30.782547 25738 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.130:40547 every 8 connection(s)
I20260805 22:47:30.782912 25534 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
I20260805 22:47:30.787235 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 25534
I20260805 22:47:30.787416 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 24574
Aug 05 22:47:30 dist-test-slave-gjrz krb5kdc[24010](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970050, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.224.130@KRBTEST.COM for oryx/127.14.224.188@KRBTEST.COM
Aug 05 22:47:30 dist-test-slave-gjrz krb5kdc[24010](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970050, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.224.130@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM
Aug 05 22:47:30 dist-test-slave-gjrz krb5kdc[24010](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970050, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.224.130@KRBTEST.COM for oryx/127.14.224.189@KRBTEST.COM
I20260805 22:47:30.796814 24141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:30.784125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:34221 (local address 127.14.224.190:42399)
0805 22:47:30.784173 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:30.784175 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:30.784767 (+ 592us) server_negotiation.cc:407] Connection header received
0805 22:47:30.785147 (+ 380us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:30.785149 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:30.785161 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:30.785222 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:30.785872 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.786753 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.788551 (+ 1798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.788793 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.788832 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:30.792864 (+ 4032us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:30.792865 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:30.792866 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:30.792875 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:30.794793 (+ 1918us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:30.795539 (+ 746us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:30.795540 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:30.795541 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:30.795619 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:30.795992 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:30.795993 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:30.795994 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:30.796150 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:30.796197 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:30.796631 (+ 434us) server_negotiation.cc:299] Negotiation successful
0805 22:47:30.796715 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260805 22:47:30.797366 25747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:30.784046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42399 (local address 127.14.224.130:34221)
0805 22:47:30.784705 (+ 659us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:30.784716 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:30.785060 (+ 344us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:30.785232 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:30.785233 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:30.785515 (+ 282us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:30.785753 (+ 238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:30.785760 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.787860 (+ 2100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.787861 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:30.788465 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:30.788466 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.788920 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.788921 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:30.789084 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:30.790002 (+ 918us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:30.790016 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:30.792750 (+ 2734us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:30.794860 (+ 2110us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:30.794860 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:30.794861 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:30.795452 (+ 591us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:30.795696 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:30.795697 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:30.795698 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:30.795858 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:30.796247 (+ 389us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:30.796255 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:30.796451 (+ 196us) client_negotiation.cc:769] Sending connection context
0805 22:47:30.796915 (+ 464us) client_negotiation.cc:240] Negotiation successful
0805 22:47:30.797118 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":642,"mutex_wait_us":2,"thread_start_us":55,"threads_started":1}
I20260805 22:47:30.797804 25530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:30.784653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:51827 (local address 127.14.224.188:38037)
0805 22:47:30.784710 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:30.784713 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:30.784799 (+ 86us) server_negotiation.cc:407] Connection header received
0805 22:47:30.785058 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:30.785059 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:30.785073 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:30.785148 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:30.785878 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.786746 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.789347 (+ 2601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.789604 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.789647 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:30.792985 (+ 3338us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:30.792987 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:30.792987 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:30.792995 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:30.794506 (+ 1511us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:30.795331 (+ 825us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:30.795333 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:30.795333 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:30.795401 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:30.796869 (+ 1468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:30.796870 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:30.796870 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:30.797007 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:30.797052 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:30.797606 (+ 554us) server_negotiation.cc:299] Negotiation successful
0805 22:47:30.797717 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260805 22:47:30.798929 25746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:30.784579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.188:38037 (local address 127.14.224.130:51827)
0805 22:47:30.784742 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:30.784751 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:30.784833 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:30.785194 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:30.785195 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:30.785520 (+ 325us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:30.785753 (+ 233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:30.785760 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.786844 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.786845 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:30.787776 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:30.787779 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.789727 (+ 1948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.789728 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:30.789798 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:30.790135 (+ 337us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:30.790140 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:30.792426 (+ 2286us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:30.794615 (+ 2189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:30.794626 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:30.794629 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:30.795230 (+ 601us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:30.796735 (+ 1505us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:30.796736 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:30.796736 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:30.796794 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:30.797115 (+ 321us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:30.797116 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:30.797154 (+ 38us) client_negotiation.cc:769] Sending connection context
0805 22:47:30.798148 (+ 994us) client_negotiation.cc:240] Negotiation successful
0805 22:47:30.798262 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"mutex_wait_us":7,"thread_start_us":76,"threads_started":1}
I20260805 22:47:30.799979 25032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:30.783733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:44221 (local address 127.14.224.189:44253)
0805 22:47:30.783813 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:30.783816 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:30.784099 (+ 283us) server_negotiation.cc:407] Connection header received
0805 22:47:30.784921 (+ 822us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:30.784923 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:30.784938 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:30.784999 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:30.785870 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.786419 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.791907 (+ 5488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.792193 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.792243 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:30.797263 (+ 5020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:30.797266 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:30.797266 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:30.797275 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:30.798786 (+ 1511us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:30.799139 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:30.799141 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:30.799141 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:30.799198 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:30.799423 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:30.799424 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:30.799425 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:30.799556 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:30.799609 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:30.799811 (+ 202us) server_negotiation.cc:299] Negotiation successful
0805 22:47:30.799894 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260805 22:47:30.800187 25742 heartbeater.cc:347] Connected to a master server at 127.14.224.190:42399
I20260805 22:47:30.800282 25739 heartbeater.cc:347] Connected to a master server at 127.14.224.188:38037
I20260805 22:47:30.800300 25742 heartbeater.cc:464] Registering TS with master...
I20260805 22:47:30.800328 25739 heartbeater.cc:464] Registering TS with master...
I20260805 22:47:30.800477 25742 heartbeater.cc:511] Master 127.14.224.190:42399 requested a full tablet report, sending...
I20260805 22:47:30.800480 25739 heartbeater.cc:511] Master 127.14.224.188:38037 requested a full tablet report, sending...
I20260805 22:47:30.800825 24068 ts_manager.cc:194] Re-registered known tserver with Master: 89b1294014344834957f89fad6b58def (127.14.224.130:40547)
I20260805 22:47:30.800882 25257 ts_manager.cc:194] Registered new tserver with Master: 89b1294014344834957f89fad6b58def (127.14.224.130:40547)
I20260805 22:47:30.801334 24068 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.14.224.130@KRBTEST.COM'} at 127.14.224.130:34221
I20260805 22:47:30.801949 25745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:30.783757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.189:44253 (local address 127.14.224.130:44221)
0805 22:47:30.783933 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:30.783992 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:30.784823 (+ 831us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:30.785061 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:30.785066 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:30.785516 (+ 450us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:30.785752 (+ 236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:30.785757 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.786520 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.786521 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:30.791776 (+ 5255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:30.791782 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.792330 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.792331 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:30.792401 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:30.792878 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:30.792882 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:30.796654 (+ 3772us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:30.798871 (+ 2217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:30.798872 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:30.798872 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:30.799081 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:30.799257 (+ 176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:30.799258 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:30.799258 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:30.799350 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:30.799653 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:30.799654 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:30.799706 (+ 52us) client_negotiation.cc:769] Sending connection context
0805 22:47:30.800081 (+ 375us) client_negotiation.cc:240] Negotiation successful
0805 22:47:30.800192 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"mutex_wait_us":18,"thread_start_us":82,"threads_started":1}
I20260805 22:47:30.802299 25743 heartbeater.cc:347] Connected to a master server at 127.14.224.189:44253
I20260805 22:47:30.802357 25743 heartbeater.cc:464] Registering TS with master...
I20260805 22:47:30.802424 25743 heartbeater.cc:511] Master 127.14.224.189:44253 requested a full tablet report, sending...
I20260805 22:47:30.802721 24977 ts_manager.cc:194] Registered new tserver with Master: 89b1294014344834957f89fad6b58def (127.14.224.130:40547)
I20260805 22:47:30.804423 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.131:41917
--local_ip_for_outbound_sockets=127.14.224.131
--tserver_master_addrs=127.14.224.190:42399
--webserver_port=34081
--webserver_interface=127.14.224.131
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/krb5kdc/oryx_127.14.224.131.keytab
--principal=oryx/127.14.224.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:43165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.14.224.190:42399,127.14.224.189:44253
--tserver_master_addrs=127.14.224.190:42399,127.14.224.189:44253,127.14.224.188:38037 with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:47:30.889531 25749 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:30.889772 25749 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:30.889799 25749 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:30.891053 25749 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:30.891110 25749 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:30.891139 25749 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.131
I20260805 22:47:30.892752 25749 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:43165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/krb5kdc/oryx_127.14.224.131.keytab
--principal=oryx/127.14.224.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.131:41917
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.224.131
--webserver_port=34081
--tserver_master_addrs=127.14.224.190:42399,127.14.224.189:44253,127.14.224.188:38037
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25749
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.131
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:30.893016 25749 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:30.893281 25749 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:30.898586 25758 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:30.898586 25762 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:30.898679 25749 server_base.cc:1034] running on GCE node
W20260805 22:47:30.898602 25756 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:30.898988 25749 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:30.899250 25749 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:30.900439 25749 hybrid_clock.cc:648] HybridClock initialized: now 1785970050900416 us; error 39 us; skew 500 ppm
Aug 05 22:47:30 dist-test-slave-gjrz krb5kdc[24010](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970050, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.224.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:30.903010 25749 init.cc:377] Logged in from keytab as oryx/127.14.224.131@KRBTEST.COM (short username oryx)
I20260805 22:47:30.903585 25749 webserver.cc:460] Webserver started at http://127.14.224.131:34081/ using document root <none> and password file <none>
I20260805 22:47:30.903816 25749 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:30.903885 25749 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:30.905267 25749 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:47:30.905861 25778 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:30.906028 25749 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:30.906113 25749 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-2/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-2/wal
uuid: "407ddbed1bf8493fa6677df269ca521c"
format_stamp: "Formatted at 2026-08-05 22:47:29 on dist-test-slave-gjrz"
server_key: "35eeffe0d93843eab6509e7d0c6436a3"
server_key_iv: "663ac34f4f368c7f846c6ab34ba7da26"
server_key_version: "encryptionkey@0"
I20260805 22:47:30.906476 25749 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:30.922859 25749 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:30.925048 25749 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:30.925191 25749 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:30.925414 25749 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:47:30.925714 25749 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:47:30.925748 25749 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:30.925778 25749 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:47:30.925801 25749 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:30.931437 25749 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.131:41917
I20260805 22:47:30.931493 25960 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.131:41917 every 8 connection(s)
I20260805 22:47:30.931840 25749 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
Aug 05 22:47:30 dist-test-slave-gjrz krb5kdc[24010](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970050, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.224.131@KRBTEST.COM for oryx/127.14.224.188@KRBTEST.COM
Aug 05 22:47:30 dist-test-slave-gjrz krb5kdc[24010](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970050, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.224.131@KRBTEST.COM for oryx/127.14.224.189@KRBTEST.COM
Aug 05 22:47:30 dist-test-slave-gjrz krb5kdc[24010](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970050, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.224.131@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM
I20260805 22:47:30.940618 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 25749
I20260805 22:47:30.942112 25530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:30.932630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:40229 (local address 127.14.224.188:38037)
0805 22:47:30.932682 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:30.932684 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:30.933070 (+ 386us) server_negotiation.cc:407] Connection header received
0805 22:47:30.933461 (+ 391us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:30.933462 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:30.933474 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:30.933506 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:30.934291 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.934792 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.936134 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.936432 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.936488 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:30.938998 (+ 2510us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:30.939000 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:30.939000 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:30.939009 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:30.940508 (+ 1499us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:30.940997 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:30.940999 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:30.940999 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:30.941074 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:30.941396 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:30.941398 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:30.941398 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:30.941544 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:30.941587 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:30.941933 (+ 346us) server_negotiation.cc:299] Negotiation successful
0805 22:47:30.942022 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260805 22:47:30.942566 25968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:30.932534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.188:38037 (local address 127.14.224.131:40229)
0805 22:47:30.933009 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:30.933018 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:30.933351 (+ 333us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:30.933589 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:30.933593 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:30.933946 (+ 353us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:30.934146 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:30.934153 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.934903 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.934904 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:30.936055 (+ 1151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:30.936057 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.936507 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.936508 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:30.936559 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:30.937159 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:30.937162 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:30.938890 (+ 1728us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:30.940606 (+ 1716us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:30.940615 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:30.940618 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:30.940908 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:30.941150 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:30.941151 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:30.941152 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:30.941308 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:30.941635 (+ 327us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:30.941644 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:30.941792 (+ 148us) client_negotiation.cc:769] Sending connection context
0805 22:47:30.941895 (+ 103us) client_negotiation.cc:240] Negotiation successful
0805 22:47:30.942340 (+ 445us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":417,"mutex_wait_us":6,"thread_start_us":99,"threads_started":1}
I20260805 22:47:30.942984 24141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:30.932531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:49321 (local address 127.14.224.190:42399)
0805 22:47:30.932647 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:30.932649 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:30.932890 (+ 241us) server_negotiation.cc:407] Connection header received
0805 22:47:30.933443 (+ 553us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:30.933444 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:30.933458 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:30.933504 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:30.934243 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.935027 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.936541 (+ 1514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.936728 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.936784 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:30.939810 (+ 3026us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:30.939813 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:30.939813 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:30.939821 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:30.941584 (+ 1763us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:30.942084 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:30.942085 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:30.942086 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:30.942149 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:30.942377 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:30.942379 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:30.942379 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:30.942525 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:30.942573 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:30.942804 (+ 231us) server_negotiation.cc:299] Negotiation successful
0805 22:47:30.942889 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260805 22:47:30.942996 25032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:30.932915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:37243 (local address 127.14.224.189:44253)
0805 22:47:30.932967 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:30.932968 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:30.933066 (+ 98us) server_negotiation.cc:407] Connection header received
0805 22:47:30.933461 (+ 395us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:30.933462 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:30.933474 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:30.933514 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:30.934272 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.935060 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.936054 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.936336 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.936404 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:30.939670 (+ 3266us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:30.939672 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:30.939672 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:30.939682 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:30.941581 (+ 1899us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:30.942083 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:30.942084 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:30.942085 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:30.942148 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:30.942413 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:30.942414 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:30.942414 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:30.942536 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:30.942575 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:30.942804 (+ 229us) server_negotiation.cc:299] Negotiation successful
0805 22:47:30.942889 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260805 22:47:30.943043 25961 heartbeater.cc:347] Connected to a master server at 127.14.224.188:38037
I20260805 22:47:30.943145 25961 heartbeater.cc:464] Registering TS with master...
I20260805 22:47:30.943320 25969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:30.932833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.189:44253 (local address 127.14.224.131:37243)
0805 22:47:30.932981 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:30.932992 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:30.933351 (+ 359us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:30.933962 (+ 611us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:30.933963 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:30.934103 (+ 140us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:30.934157 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:30.934159 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.935146 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.935147 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:30.935966 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:30.935970 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.936420 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.936420 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:30.936556 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:30.937137 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:30.937149 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:30.939558 (+ 2409us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:30.941663 (+ 2105us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:30.941664 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:30.941665 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:30.941992 (+ 327us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:30.942224 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:30.942224 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:30.942225 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:30.942339 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:30.942622 (+ 283us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:30.942623 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:30.942674 (+ 51us) client_negotiation.cc:769] Sending connection context
0805 22:47:30.943073 (+ 399us) client_negotiation.cc:240] Negotiation successful
0805 22:47:30.943190 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"mutex_wait_us":26,"thread_start_us":57,"threads_started":1}
I20260805 22:47:30.943387 25961 heartbeater.cc:511] Master 127.14.224.188:38037 requested a full tablet report, sending...
I20260805 22:47:30.943403 25967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:30.932534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42399 (local address 127.14.224.131:49321)
0805 22:47:30.932757 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:30.932800 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:30.933339 (+ 539us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:30.933589 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:30.933592 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:30.933929 (+ 337us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:30.934145 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:30.934149 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.935114 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.935115 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:30.936048 (+ 933us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:30.936051 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.937142 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.937143 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:30.937212 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:30.937608 (+ 396us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:30.937613 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:30.939726 (+ 2113us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:30.941672 (+ 1946us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:30.941672 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:30.941673 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:30.941988 (+ 315us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:30.942224 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:30.942224 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:30.942225 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:30.942303 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:30.942622 (+ 319us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:30.942623 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:30.942674 (+ 51us) client_negotiation.cc:769] Sending connection context
0805 22:47:30.943189 (+ 515us) client_negotiation.cc:240] Negotiation successful
0805 22:47:30.943297 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"mutex_wait_us":52,"thread_start_us":89,"threads_started":1}
I20260805 22:47:30.943923 25962 heartbeater.cc:347] Connected to a master server at 127.14.224.190:42399
I20260805 22:47:30.943965 25962 heartbeater.cc:464] Registering TS with master...
I20260805 22:47:30.944029 25962 heartbeater.cc:511] Master 127.14.224.190:42399 requested a full tablet report, sending...
I20260805 22:47:30.944258 24068 ts_manager.cc:194] Re-registered known tserver with Master: 407ddbed1bf8493fa6677df269ca521c (127.14.224.131:41917)
I20260805 22:47:30.944325 25257 ts_manager.cc:194] Registered new tserver with Master: 407ddbed1bf8493fa6677df269ca521c (127.14.224.131:41917)
I20260805 22:47:30.944741 24068 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.14.224.131@KRBTEST.COM'} at 127.14.224.131:49321
I20260805 22:47:30.945492 25963 heartbeater.cc:347] Connected to a master server at 127.14.224.189:44253
I20260805 22:47:30.945556 25963 heartbeater.cc:464] Registering TS with master...
I20260805 22:47:30.945619 25963 heartbeater.cc:511] Master 127.14.224.189:44253 requested a full tablet report, sending...
I20260805 22:47:30.945971 24977 ts_manager.cc:194] Registered new tserver with Master: 407ddbed1bf8493fa6677df269ca521c (127.14.224.131:41917)
I20260805 22:47:30.950682 25032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:30.943798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57722 (local address 127.14.224.189:44253)
0805 22:47:30.943872 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:30.943873 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:30.943921 (+ 48us) server_negotiation.cc:407] Connection header received
0805 22:47:30.943954 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:30.943955 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:30.943963 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:30.944005 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:30.944696 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.945464 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.946416 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.946931 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.947002 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:30.948246 (+ 1244us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:30.948248 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:30.948248 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:30.948255 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:30.949550 (+ 1295us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:30.949926 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:30.949927 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:30.949928 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:30.949986 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:30.950202 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:30.950203 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:30.950203 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:30.950335 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:30.950419 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:30.950508 (+ 89us) server_negotiation.cc:299] Negotiation successful
0805 22:47:30.950588 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260805 22:47:30.950954 24141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:30.943138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55298 (local address 127.14.224.190:42399)
0805 22:47:30.943174 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:30.943176 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:30.943605 (+ 429us) server_negotiation.cc:407] Connection header received
0805 22:47:30.943708 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:30.943709 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:30.943720 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:30.943748 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:30.944523 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.945185 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.946052 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.946288 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.946343 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:30.947808 (+ 1465us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:30.947810 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:30.947810 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:30.947817 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:30.949740 (+ 1923us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:30.950096 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:30.950098 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:30.950098 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:30.950152 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:30.950343 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:30.950344 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:30.950344 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:30.950486 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:30.950578 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:30.950792 (+ 214us) server_negotiation.cc:299] Negotiation successful
0805 22:47:30.950868 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260805 22:47:30.953298 25530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:30.943241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46184 (local address 127.14.224.188:38037)
0805 22:47:30.943301 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:30.943303 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:30.944037 (+ 734us) server_negotiation.cc:407] Connection header received
0805 22:47:30.946498 (+ 2461us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:30.946499 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:30.946510 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:30.946564 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:30.947094 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.948009 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.948947 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.949228 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.949298 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:30.950758 (+ 1460us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:30.950759 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:30.950760 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:30.950767 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:30.952271 (+ 1504us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:30.952665 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:30.952667 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:30.952667 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:30.952727 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:30.952900 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:30.952901 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:30.952901 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:30.952995 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:30.953081 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:30.953174 (+ 93us) server_negotiation.cc:299] Negotiation successful
0805 22:47:30.953237 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260805 22:47:30.952665 24068 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55298:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:47:30.954592 24068 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:47:30.962160 24923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:30.958381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.129:42859 (local address 127.0.0.1:46648)
0805 22:47:30.958581 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:30.958589 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:30.958618 (+ 29us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:30.959106 (+ 488us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:30.959106 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:30.959108 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:47:30.959149 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:30.959150 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.960180 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.960181 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:30.960953 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:30.960955 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.961921 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.961922 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:30.961987 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:30.961991 (+ 4us) client_negotiation.cc:769] Sending connection context
0805 22:47:30.962029 (+ 38us) client_negotiation.cc:240] Negotiation successful
0805 22:47:30.962075 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188,"mutex_wait_us":1,"thread_start_us":86,"threads_started":1}
I20260805 22:47:30.962172 25996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:30.958773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46648 (local address 127.14.224.129:42859)
0805 22:47:30.958929 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:30.958934 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:30.958945 (+ 11us) server_negotiation.cc:407] Connection header received
0805 22:47:30.958988 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:30.958990 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:30.959007 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:30.959105 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:47:30.959200 (+ 95us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.960104 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.961049 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.961826 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.961939 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:30.962012 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:30.962043 (+ 31us) server_negotiation.cc:299] Negotiation successful
0805 22:47:30.962083 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":74,"threads_started":1}
I20260805 22:47:30.962886 25992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:30.958302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.130:40547 (local address 127.0.0.1:51752)
0805 22:47:30.958544 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:30.958556 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:30.958611 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:30.959443 (+ 832us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:30.959444 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:30.959446 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:47:30.959490 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:30.959492 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.961011 (+ 1519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.961012 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:30.961738 (+ 726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:30.961740 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.962655 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.962656 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:30.962718 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:30.962723 (+ 5us) client_negotiation.cc:769] Sending connection context
0805 22:47:30.962768 (+ 45us) client_negotiation.cc:240] Negotiation successful
0805 22:47:30.962810 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":217,"mutex_wait_us":1}
I20260805 22:47:30.963289 25998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:30.958976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51752 (local address 127.14.224.130:40547)
0805 22:47:30.959292 (+ 316us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:30.959296 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:30.959305 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:47:30.959339 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:30.959341 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:30.959357 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:30.959437 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:47:30.959556 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.960936 (+ 1380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.961826 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.962549 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.962952 (+ 403us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:30.963024 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:30.963051 (+ 27us) server_negotiation.cc:299] Negotiation successful
0805 22:47:30.963182 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":257,"thread_start_us":98,"threads_started":1}
I20260805 22:47:30.963356 25425 tablet_service.cc:1467] Processing CreateTablet for tablet a0b8e7882d4b4a92bdc33354d56405be (DEFAULT_TABLE table=test-table [id=210512d3c18541a8800885c8a6dba7a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:47:30.963815 25425 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a0b8e7882d4b4a92bdc33354d56405be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:30.963951 25638 tablet_service.cc:1467] Processing CreateTablet for tablet a0b8e7882d4b4a92bdc33354d56405be (DEFAULT_TABLE table=test-table [id=210512d3c18541a8800885c8a6dba7a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:47:30.964262 25638 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a0b8e7882d4b4a92bdc33354d56405be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:30.967615 25990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:30.958412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.131:41917 (local address 127.0.0.1:39224)
0805 22:47:30.959176 (+ 764us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:30.959185 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:30.959242 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:30.959571 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:30.959571 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:30.959572 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:47:30.959607 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:30.959608 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.960818 (+ 1210us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.960819 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:30.961914 (+ 1095us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:30.961918 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.967358 (+ 5440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.967360 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:30.967438 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:30.967444 (+ 6us) client_negotiation.cc:769] Sending connection context
0805 22:47:30.967497 (+ 53us) client_negotiation.cc:240] Negotiation successful
0805 22:47:30.967540 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":744,"mutex_wait_us":30,"thread_start_us":90,"threads_started":1}
I20260805 22:47:30.968091 26000 tablet_bootstrap.cc:492] T a0b8e7882d4b4a92bdc33354d56405be P 89b1294014344834957f89fad6b58def: Bootstrap starting.
I20260805 22:47:30.968318 25994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:30.958534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39224 (local address 127.14.224.131:41917)
0805 22:47:30.958728 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:30.958733 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:30.959258 (+ 525us) server_negotiation.cc:407] Connection header received
0805 22:47:30.959338 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:30.959340 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:30.959357 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:30.959436 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:47:30.959672 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.960716 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.962009 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:30.962716 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:30.968066 (+ 5350us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:30.968162 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:30.968195 (+ 33us) server_negotiation.cc:299] Negotiation successful
0805 22:47:30.968252 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":76,"threads_started":1}
I20260805 22:47:30.968736 26000 tablet_bootstrap.cc:654] T a0b8e7882d4b4a92bdc33354d56405be P 89b1294014344834957f89fad6b58def: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:30.969031 26000 log.cc:824] T a0b8e7882d4b4a92bdc33354d56405be P 89b1294014344834957f89fad6b58def: Log is configured to *not* fsync() on all Append() calls
I20260805 22:47:30.969017 25856 tablet_service.cc:1467] Processing CreateTablet for tablet a0b8e7882d4b4a92bdc33354d56405be (DEFAULT_TABLE table=test-table [id=210512d3c18541a8800885c8a6dba7a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:47:30.969386 25856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a0b8e7882d4b4a92bdc33354d56405be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:30.969388 25999 tablet_bootstrap.cc:492] T a0b8e7882d4b4a92bdc33354d56405be P 936d4bcf12614852a0aede9ed99863a0: Bootstrap starting.
I20260805 22:47:30.969954 25999 tablet_bootstrap.cc:654] T a0b8e7882d4b4a92bdc33354d56405be P 936d4bcf12614852a0aede9ed99863a0: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:30.970240 25999 log.cc:824] T a0b8e7882d4b4a92bdc33354d56405be P 936d4bcf12614852a0aede9ed99863a0: Log is configured to *not* fsync() on all Append() calls
I20260805 22:47:30.970852 26000 tablet_bootstrap.cc:492] T a0b8e7882d4b4a92bdc33354d56405be P 89b1294014344834957f89fad6b58def: No bootstrap required, opened a new log
I20260805 22:47:30.970928 26000 ts_tablet_manager.cc:1397] T a0b8e7882d4b4a92bdc33354d56405be P 89b1294014344834957f89fad6b58def: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260805 22:47:30.970942 25999 tablet_bootstrap.cc:492] T a0b8e7882d4b4a92bdc33354d56405be P 936d4bcf12614852a0aede9ed99863a0: No bootstrap required, opened a new log
I20260805 22:47:30.970990 25999 ts_tablet_manager.cc:1397] T a0b8e7882d4b4a92bdc33354d56405be P 936d4bcf12614852a0aede9ed99863a0: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260805 22:47:30.972295 26005 tablet_bootstrap.cc:492] T a0b8e7882d4b4a92bdc33354d56405be P 407ddbed1bf8493fa6677df269ca521c: Bootstrap starting.
I20260805 22:47:30.972873 26005 tablet_bootstrap.cc:654] T a0b8e7882d4b4a92bdc33354d56405be P 407ddbed1bf8493fa6677df269ca521c: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:30.972947 26000 raft_consensus.cc:348] T a0b8e7882d4b4a92bdc33354d56405be P 89b1294014344834957f89fad6b58def [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89b1294014344834957f89fad6b58def" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40547 } } peers { permanent_uuid: "407ddbed1bf8493fa6677df269ca521c" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 41917 } } peers { permanent_uuid: "936d4bcf12614852a0aede9ed99863a0" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42859 } }
I20260805 22:47:30.973135 26000 raft_consensus.cc:374] T a0b8e7882d4b4a92bdc33354d56405be P 89b1294014344834957f89fad6b58def [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:30.973073 25999 raft_consensus.cc:348] T a0b8e7882d4b4a92bdc33354d56405be P 936d4bcf12614852a0aede9ed99863a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89b1294014344834957f89fad6b58def" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40547 } } peers { permanent_uuid: "407ddbed1bf8493fa6677df269ca521c" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 41917 } } peers { permanent_uuid: "936d4bcf12614852a0aede9ed99863a0" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42859 } }
I20260805 22:47:30.973173 26000 raft_consensus.cc:729] T a0b8e7882d4b4a92bdc33354d56405be P 89b1294014344834957f89fad6b58def [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89b1294014344834957f89fad6b58def, State: Initialized, Role: FOLLOWER
I20260805 22:47:30.973207 25999 raft_consensus.cc:374] T a0b8e7882d4b4a92bdc33354d56405be P 936d4bcf12614852a0aede9ed99863a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:30.973201 26005 log.cc:824] T a0b8e7882d4b4a92bdc33354d56405be P 407ddbed1bf8493fa6677df269ca521c: Log is configured to *not* fsync() on all Append() calls
I20260805 22:47:30.973244 25999 raft_consensus.cc:729] T a0b8e7882d4b4a92bdc33354d56405be P 936d4bcf12614852a0aede9ed99863a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936d4bcf12614852a0aede9ed99863a0, State: Initialized, Role: FOLLOWER
I20260805 22:47:30.973320 26000 consensus_queue.cc:260] T a0b8e7882d4b4a92bdc33354d56405be P 89b1294014344834957f89fad6b58def [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89b1294014344834957f89fad6b58def" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40547 } } peers { permanent_uuid: "407ddbed1bf8493fa6677df269ca521c" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 41917 } } peers { permanent_uuid: "936d4bcf12614852a0aede9ed99863a0" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42859 } }
I20260805 22:47:30.973357 25999 consensus_queue.cc:260] T a0b8e7882d4b4a92bdc33354d56405be P 936d4bcf12614852a0aede9ed99863a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89b1294014344834957f89fad6b58def" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40547 } } peers { permanent_uuid: "407ddbed1bf8493fa6677df269ca521c" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 41917 } } peers { permanent_uuid: "936d4bcf12614852a0aede9ed99863a0" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42859 } }
I20260805 22:47:30.973613 26000 ts_tablet_manager.cc:1428] T a0b8e7882d4b4a92bdc33354d56405be P 89b1294014344834957f89fad6b58def: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260805 22:47:30.973927 25999 ts_tablet_manager.cc:1428] T a0b8e7882d4b4a92bdc33354d56405be P 936d4bcf12614852a0aede9ed99863a0: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260805 22:47:30.974105 25527 heartbeater.cc:503] Master 127.14.224.190:42399 was elected leader, sending a full tablet report...
I20260805 22:47:30.974196 26005 tablet_bootstrap.cc:492] T a0b8e7882d4b4a92bdc33354d56405be P 407ddbed1bf8493fa6677df269ca521c: No bootstrap required, opened a new log
I20260805 22:47:30.974308 26005 ts_tablet_manager.cc:1397] T a0b8e7882d4b4a92bdc33354d56405be P 407ddbed1bf8493fa6677df269ca521c: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260805 22:47:30.974483 25742 heartbeater.cc:503] Master 127.14.224.190:42399 was elected leader, sending a full tablet report...
I20260805 22:47:30.976357 26005 raft_consensus.cc:348] T a0b8e7882d4b4a92bdc33354d56405be P 407ddbed1bf8493fa6677df269ca521c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89b1294014344834957f89fad6b58def" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40547 } } peers { permanent_uuid: "407ddbed1bf8493fa6677df269ca521c" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 41917 } } peers { permanent_uuid: "936d4bcf12614852a0aede9ed99863a0" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42859 } }
I20260805 22:47:30.976501 26005 raft_consensus.cc:374] T a0b8e7882d4b4a92bdc33354d56405be P 407ddbed1bf8493fa6677df269ca521c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:30.976523 26005 raft_consensus.cc:729] T a0b8e7882d4b4a92bdc33354d56405be P 407ddbed1bf8493fa6677df269ca521c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 407ddbed1bf8493fa6677df269ca521c, State: Initialized, Role: FOLLOWER
I20260805 22:47:30.976603 26005 consensus_queue.cc:260] T a0b8e7882d4b4a92bdc33354d56405be P 407ddbed1bf8493fa6677df269ca521c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89b1294014344834957f89fad6b58def" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40547 } } peers { permanent_uuid: "407ddbed1bf8493fa6677df269ca521c" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 41917 } } peers { permanent_uuid: "936d4bcf12614852a0aede9ed99863a0" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42859 } }
I20260805 22:47:30.976800 26005 ts_tablet_manager.cc:1428] T a0b8e7882d4b4a92bdc33354d56405be P 407ddbed1bf8493fa6677df269ca521c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260805 22:47:30.976866 25962 heartbeater.cc:503] Master 127.14.224.190:42399 was elected leader, sending a full tablet report...
I20260805 22:47:31.022387 25530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:31.019766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46192 (local address 127.14.224.188:38037)
0805 22:47:31.019813 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:31.019815 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:31.019823 (+ 8us) server_negotiation.cc:407] Connection header received
0805 22:47:31.019891 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:31.019892 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:31.019911 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:31.019972 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:47:31.020086 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:31.020572 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:31.021604 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:31.022052 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:31.022116 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:31.022182 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:31.022296 (+ 114us) server_negotiation.cc:299] Negotiation successful
0805 22:47:31.022325 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260805 22:47:31.022404 25990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:31.019699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.188:38037 (local address 127.0.0.1:46192)
0805 22:47:31.019770 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:31.019785 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:31.019842 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:31.019982 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:31.019983 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:31.019984 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:47:31.020040 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:31.020043 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:31.020687 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:31.020689 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:31.021492 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:31.021497 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:31.022165 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:31.022166 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:31.022227 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:31.022232 (+ 5us) client_negotiation.cc:769] Sending connection context
0805 22:47:31.022287 (+ 55us) client_negotiation.cc:240] Negotiation successful
0805 22:47:31.022334 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260805 22:47:31.022826 25270 raft_consensus.cc:1203] T 00000000000000000000000000000000 P c85d05dcb2f94f3f8ff437ee8666c548 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.9] Dedup: 1.7->[1.8-1.9]
I20260805 22:47:31.023828 25314 sys_catalog.cc:455] T 00000000000000000000000000000000 P c85d05dcb2f94f3f8ff437ee8666c548 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f0fb2e45b5414c06af56004d3bea4ca8. Latest consensus state: current_term: 1 leader_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 42399 } } peers { permanent_uuid: "233a2c69697b4b168b656c682271145c" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 44253 } attrs { promote: false } } peers { permanent_uuid: "c85d05dcb2f94f3f8ff437ee8666c548" member_type: NON_VOTER last_known_addr { host: "127.14.224.188" port: 38037 } attrs { promote: true } } }
I20260805 22:47:31.023955 25314 sys_catalog.cc:458] T 00000000000000000000000000000000 P c85d05dcb2f94f3f8ff437ee8666c548 [sys.catalog]: This master's current role is: LEARNER
I20260805 22:47:31.033300 26013 raft_consensus.cc:482] T a0b8e7882d4b4a92bdc33354d56405be P 407ddbed1bf8493fa6677df269ca521c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:47:31.033430 26013 raft_consensus.cc:504] T a0b8e7882d4b4a92bdc33354d56405be P 407ddbed1bf8493fa6677df269ca521c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89b1294014344834957f89fad6b58def" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40547 } } peers { permanent_uuid: "407ddbed1bf8493fa6677df269ca521c" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 41917 } } peers { permanent_uuid: "936d4bcf12614852a0aede9ed99863a0" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42859 } }
I20260805 22:47:31.033931 26013 leader_election.cc:288] T a0b8e7882d4b4a92bdc33354d56405be P 407ddbed1bf8493fa6677df269ca521c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89b1294014344834957f89fad6b58def (127.14.224.130:40547), 936d4bcf12614852a0aede9ed99863a0 (127.14.224.129:42859)
W20260805 22:47:31.034021 25744 tablet.cc:2369] T a0b8e7882d4b4a92bdc33354d56405be P 89b1294014344834957f89fad6b58def: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:47:31.036976 25998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:31.034230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:50727 (local address 127.14.224.130:40547)
0805 22:47:31.034277 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:31.034279 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:31.034288 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:47:31.034313 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:31.034314 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:31.034322 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:31.034374 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:47:31.034555 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:31.035117 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:31.036212 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:31.036577 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:31.036634 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:31.036642 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:31.036853 (+ 211us) server_negotiation.cc:299] Negotiation successful
0805 22:47:31.036899 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260805 22:47:31.036975 25996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:31.034232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:59385 (local address 127.14.224.129:42859)
0805 22:47:31.034412 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:31.034414 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:31.034422 (+ 8us) server_negotiation.cc:407] Connection header received
0805 22:47:31.034445 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:31.034446 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:31.034456 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:31.034522 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:47:31.034680 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:31.035182 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:31.036205 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:31.036578 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:31.036730 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:31.036743 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:31.036863 (+ 120us) server_negotiation.cc:299] Negotiation successful
0805 22:47:31.036909 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151}
I20260805 22:47:31.036975 25969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:31.034114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.130:40547 (local address 127.14.224.131:50727)
0805 22:47:31.034205 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:31.034218 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:31.034263 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:31.034405 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:31.034406 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:31.034407 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:47:31.034487 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:31.034490 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:31.035207 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:31.035209 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:31.036109 (+ 900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:31.036112 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:31.036693 (+ 581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:31.036695 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:31.036774 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:31.036779 (+ 5us) client_negotiation.cc:769] Sending connection context
0805 22:47:31.036825 (+ 46us) client_negotiation.cc:240] Negotiation successful
0805 22:47:31.036871 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":68,"mutex_wait_us":42}
I20260805 22:47:31.036978 25967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:31.034141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.129:42859 (local address 127.14.224.131:59385)
0805 22:47:31.034292 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:31.034301 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:31.034336 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:31.034541 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:31.034543 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:31.034545 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:47:31.034609 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:31.034611 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:31.035290 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:31.035291 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:31.036110 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:31.036112 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:31.036723 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:31.036724 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:31.036796 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:31.036799 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:47:31.036850 (+ 51us) client_negotiation.cc:240] Negotiation successful
0805 22:47:31.036890 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"mutex_wait_us":24}
I20260805 22:47:31.037426 25668 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0b8e7882d4b4a92bdc33354d56405be" candidate_uuid: "407ddbed1bf8493fa6677df269ca521c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89b1294014344834957f89fad6b58def" is_pre_election: true
I20260805 22:47:31.037524 25455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0b8e7882d4b4a92bdc33354d56405be" candidate_uuid: "407ddbed1bf8493fa6677df269ca521c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936d4bcf12614852a0aede9ed99863a0" is_pre_election: true
I20260805 22:47:31.037626 25668 raft_consensus.cc:2454] T a0b8e7882d4b4a92bdc33354d56405be P 89b1294014344834957f89fad6b58def [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 407ddbed1bf8493fa6677df269ca521c in term 0.
I20260805 22:47:31.037667 25455 raft_consensus.cc:2454] T a0b8e7882d4b4a92bdc33354d56405be P 936d4bcf12614852a0aede9ed99863a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 407ddbed1bf8493fa6677df269ca521c in term 0.
I20260805 22:47:31.037879 25779 leader_election.cc:302] T a0b8e7882d4b4a92bdc33354d56405be P 407ddbed1bf8493fa6677df269ca521c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 407ddbed1bf8493fa6677df269ca521c, 89b1294014344834957f89fad6b58def, 936d4bcf12614852a0aede9ed99863a0; no voters:
I20260805 22:47:31.038017 26013 raft_consensus.cc:2781] T a0b8e7882d4b4a92bdc33354d56405be P 407ddbed1bf8493fa6677df269ca521c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:47:31.038080 26013 raft_consensus.cc:482] T a0b8e7882d4b4a92bdc33354d56405be P 407ddbed1bf8493fa6677df269ca521c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:47:31.038110 26013 raft_consensus.cc:3037] T a0b8e7882d4b4a92bdc33354d56405be P 407ddbed1bf8493fa6677df269ca521c [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:31.038820 26013 raft_consensus.cc:504] T a0b8e7882d4b4a92bdc33354d56405be P 407ddbed1bf8493fa6677df269ca521c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89b1294014344834957f89fad6b58def" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40547 } } peers { permanent_uuid: "407ddbed1bf8493fa6677df269ca521c" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 41917 } } peers { permanent_uuid: "936d4bcf12614852a0aede9ed99863a0" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42859 } }
I20260805 22:47:31.038955 26013 leader_election.cc:288] T a0b8e7882d4b4a92bdc33354d56405be P 407ddbed1bf8493fa6677df269ca521c [CANDIDATE]: Term 1 election: Requested vote from peers 89b1294014344834957f89fad6b58def (127.14.224.130:40547), 936d4bcf12614852a0aede9ed99863a0 (127.14.224.129:42859)
I20260805 22:47:31.039141 25668 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0b8e7882d4b4a92bdc33354d56405be" candidate_uuid: "407ddbed1bf8493fa6677df269ca521c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89b1294014344834957f89fad6b58def"
I20260805 22:47:31.039127 25455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0b8e7882d4b4a92bdc33354d56405be" candidate_uuid: "407ddbed1bf8493fa6677df269ca521c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936d4bcf12614852a0aede9ed99863a0"
I20260805 22:47:31.039227 25668 raft_consensus.cc:3037] T a0b8e7882d4b4a92bdc33354d56405be P 89b1294014344834957f89fad6b58def [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:31.039227 25455 raft_consensus.cc:3037] T a0b8e7882d4b4a92bdc33354d56405be P 936d4bcf12614852a0aede9ed99863a0 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:31.040154 25668 raft_consensus.cc:2454] T a0b8e7882d4b4a92bdc33354d56405be P 89b1294014344834957f89fad6b58def [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 407ddbed1bf8493fa6677df269ca521c in term 1.
I20260805 22:47:31.040154 25455 raft_consensus.cc:2454] T a0b8e7882d4b4a92bdc33354d56405be P 936d4bcf12614852a0aede9ed99863a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 407ddbed1bf8493fa6677df269ca521c in term 1.
I20260805 22:47:31.040342 25783 leader_election.cc:302] T a0b8e7882d4b4a92bdc33354d56405be P 407ddbed1bf8493fa6677df269ca521c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 407ddbed1bf8493fa6677df269ca521c, 936d4bcf12614852a0aede9ed99863a0; no voters:
I20260805 22:47:31.040447 26013 raft_consensus.cc:2781] T a0b8e7882d4b4a92bdc33354d56405be P 407ddbed1bf8493fa6677df269ca521c [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:47:31.040655 26013 raft_consensus.cc:686] T a0b8e7882d4b4a92bdc33354d56405be P 407ddbed1bf8493fa6677df269ca521c [term 1 LEADER]: Becoming Leader. State: Replica: 407ddbed1bf8493fa6677df269ca521c, State: Running, Role: LEADER
I20260805 22:47:31.040748 26013 consensus_queue.cc:237] T a0b8e7882d4b4a92bdc33354d56405be P 407ddbed1bf8493fa6677df269ca521c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89b1294014344834957f89fad6b58def" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40547 } } peers { permanent_uuid: "407ddbed1bf8493fa6677df269ca521c" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 41917 } } peers { permanent_uuid: "936d4bcf12614852a0aede9ed99863a0" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42859 } }
I20260805 22:47:31.041723 24066 catalog_manager.cc:5495] T a0b8e7882d4b4a92bdc33354d56405be P 407ddbed1bf8493fa6677df269ca521c reported cstate change: term changed from 0 to 1, leader changed from <none> to 407ddbed1bf8493fa6677df269ca521c (127.14.224.131). New cstate: current_term: 1 leader_uuid: "407ddbed1bf8493fa6677df269ca521c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89b1294014344834957f89fad6b58def" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "407ddbed1bf8493fa6677df269ca521c" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 41917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "936d4bcf12614852a0aede9ed99863a0" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42859 } health_report { overall_health: UNKNOWN } } }
I20260805 22:47:31.042402 25205 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0fb2e45b5414c06af56004d3bea4ca8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 42399 } } peers { permanent_uuid: "233a2c69697b4b168b656c682271145c" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 44253 } attrs { promote: false } } peers { permanent_uuid: "c85d05dcb2f94f3f8ff437ee8666c548" member_type: NON_VOTER last_known_addr { host: "127.14.224.188" port: 38037 } attrs { promote: true } } }
I20260805 22:47:31.042500 25205 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0fb2e45b5414c06af56004d3bea4ca8 [sys.catalog]: This master's current role is: LEADER
I20260805 22:47:31.043326 26024 raft_consensus.cc:1050] T 00000000000000000000000000000000 P f0fb2e45b5414c06af56004d3bea4ca8: attempting to promote NON_VOTER c85d05dcb2f94f3f8ff437ee8666c548 to VOTER
I20260805 22:47:31.043457 26024 consensus_queue.cc:237] T 00000000000000000000000000000000 P f0fb2e45b5414c06af56004d3bea4ca8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 42399 } } peers { permanent_uuid: "233a2c69697b4b168b656c682271145c" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 44253 } attrs { promote: false } } peers { permanent_uuid: "c85d05dcb2f94f3f8ff437ee8666c548" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 38037 } attrs { promote: false } }
I20260805 22:47:31.043874 25270 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c85d05dcb2f94f3f8ff437ee8666c548 [term 1 LEARNER]: Refusing update from remote peer f0fb2e45b5414c06af56004d3bea4ca8: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260805 22:47:31.043896 24992 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c [term 1 FOLLOWER]: Refusing update from remote peer f0fb2e45b5414c06af56004d3bea4ca8: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260805 22:47:31.044106 24924 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f0fb2e45b5414c06af56004d3bea4ca8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85d05dcb2f94f3f8ff437ee8666c548" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 38037 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260805 22:47:31.044312 26025 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f0fb2e45b5414c06af56004d3bea4ca8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "233a2c69697b4b168b656c682271145c" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 44253 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260805 22:47:31.044762 24924 raft_consensus.cc:2932] T 00000000000000000000000000000000 P f0fb2e45b5414c06af56004d3bea4ca8 [term 1 LEADER]: Committing config change with OpId 1.11: config changed from index 7 to 11, c85d05dcb2f94f3f8ff437ee8666c548 (127.14.224.188) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 42399 } } peers { permanent_uuid: "233a2c69697b4b168b656c682271145c" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 44253 } attrs { promote: false } } peers { permanent_uuid: "c85d05dcb2f94f3f8ff437ee8666c548" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 38037 } attrs { promote: false } } }
I20260805 22:47:31.044919 25270 raft_consensus.cc:2932] T 00000000000000000000000000000000 P c85d05dcb2f94f3f8ff437ee8666c548 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 7 to 11, c85d05dcb2f94f3f8ff437ee8666c548 (127.14.224.188) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 42399 } } peers { permanent_uuid: "233a2c69697b4b168b656c682271145c" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 44253 } attrs { promote: false } } peers { permanent_uuid: "c85d05dcb2f94f3f8ff437ee8666c548" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 38037 } attrs { promote: false } } }
I20260805 22:47:31.045774 24924 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0fb2e45b5414c06af56004d3bea4ca8 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 42399 } } peers { permanent_uuid: "233a2c69697b4b168b656c682271145c" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 44253 } attrs { promote: false } } peers { permanent_uuid: "c85d05dcb2f94f3f8ff437ee8666c548" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 38037 } attrs { promote: false } } }
I20260805 22:47:31.045854 24924 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0fb2e45b5414c06af56004d3bea4ca8 [sys.catalog]: This master's current role is: LEADER
I20260805 22:47:31.045823 25205 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0fb2e45b5414c06af56004d3bea4ca8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 42399 } } peers { permanent_uuid: "233a2c69697b4b168b656c682271145c" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 44253 } attrs { promote: false } } peers { permanent_uuid: "c85d05dcb2f94f3f8ff437ee8666c548" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 38037 } attrs { promote: false } } }
I20260805 22:47:31.045912 25205 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0fb2e45b5414c06af56004d3bea4ca8 [sys.catalog]: This master's current role is: LEADER
I20260805 22:47:31.045879 25314 sys_catalog.cc:455] T 00000000000000000000000000000000 P c85d05dcb2f94f3f8ff437ee8666c548 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 42399 } } peers { permanent_uuid: "233a2c69697b4b168b656c682271145c" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 44253 } attrs { promote: false } } peers { permanent_uuid: "c85d05dcb2f94f3f8ff437ee8666c548" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 38037 } attrs { promote: false } } }
I20260805 22:47:31.045946 25314 sys_catalog.cc:458] T 00000000000000000000000000000000 P c85d05dcb2f94f3f8ff437ee8666c548 [sys.catalog]: This master's current role is: FOLLOWER
I20260805 22:47:31.045981 26025 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0fb2e45b5414c06af56004d3bea4ca8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 42399 } } peers { permanent_uuid: "233a2c69697b4b168b656c682271145c" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 44253 } attrs { promote: false } } peers { permanent_uuid: "c85d05dcb2f94f3f8ff437ee8666c548" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 38037 } attrs { promote: false } } }
I20260805 22:47:31.046036 26025 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0fb2e45b5414c06af56004d3bea4ca8 [sys.catalog]: This master's current role is: LEADER
I20260805 22:47:31.046245 24993 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 7 to 11, c85d05dcb2f94f3f8ff437ee8666c548 (127.14.224.188) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 42399 } } peers { permanent_uuid: "233a2c69697b4b168b656c682271145c" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 44253 } attrs { promote: false } } peers { permanent_uuid: "c85d05dcb2f94f3f8ff437ee8666c548" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 38037 } attrs { promote: false } } }
I20260805 22:47:31.047065 26027 sys_catalog.cc:455] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 42399 } } peers { permanent_uuid: "233a2c69697b4b168b656c682271145c" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 44253 } attrs { promote: false } } peers { permanent_uuid: "c85d05dcb2f94f3f8ff437ee8666c548" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 38037 } attrs { promote: false } } }
I20260805 22:47:31.047147 26027 sys_catalog.cc:458] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c [sys.catalog]: This master's current role is: FOLLOWER
I20260805 22:47:31.054518 25994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:31.052196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39230 (local address 127.14.224.131:41917)
0805 22:47:31.052260 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:31.052262 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:31.052271 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:47:31.052306 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:31.052307 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:31.052324 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:31.052382 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:47:31.052513 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:31.052985 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:31.053726 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:31.053920 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:31.053974 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:31.054169 (+ 195us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:47:31.054281 (+ 112us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:47:31.054379 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:31.054397 (+ 18us) server_negotiation.cc:299] Negotiation successful
0805 22:47:31.054420 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260805 22:47:31.056504 25455 raft_consensus.cc:1261] T a0b8e7882d4b4a92bdc33354d56405be P 936d4bcf12614852a0aede9ed99863a0 [term 1 FOLLOWER]: Refusing update from remote peer 407ddbed1bf8493fa6677df269ca521c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:47:31.056511 25668 raft_consensus.cc:1261] T a0b8e7882d4b4a92bdc33354d56405be P 89b1294014344834957f89fad6b58def [term 1 FOLLOWER]: Refusing update from remote peer 407ddbed1bf8493fa6677df269ca521c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:47:31.056883 26022 consensus_queue.cc:1035] T a0b8e7882d4b4a92bdc33354d56405be P 407ddbed1bf8493fa6677df269ca521c [LEADER]: Connected to new peer: Peer: permanent_uuid: "89b1294014344834957f89fad6b58def" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:47:31.057016 26013 consensus_queue.cc:1035] T a0b8e7882d4b4a92bdc33354d56405be P 407ddbed1bf8493fa6677df269ca521c [LEADER]: Connected to new peer: Peer: permanent_uuid: "936d4bcf12614852a0aede9ed99863a0" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:47:31.062299 26038 mvcc.cc:205] Tried to move back new op lower bound from 7315333329124515840 to 7315333329063690240. Current Snapshot: MvccSnapshot[applied={T|T < 7315333329124515840 or (T in {7315333329124515840})}]
I20260805 22:47:31.062453 24066 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55298:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:47:31.062548 24066 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55298:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:47:31.063939 24066 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f0fb2e45b5414c06af56004d3bea4ca8: Sending DeleteTablet for 3 replicas of tablet a0b8e7882d4b4a92bdc33354d56405be
I20260805 22:47:31.064446 25638 tablet_service.cc:1514] Processing DeleteTablet for tablet a0b8e7882d4b4a92bdc33354d56405be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:47:31 UTC) from {username='oryx', principal='oryx/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:51752
I20260805 22:47:31.064544 25856 tablet_service.cc:1514] Processing DeleteTablet for tablet a0b8e7882d4b4a92bdc33354d56405be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:47:31 UTC) from {username='oryx', principal='oryx/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:39224
I20260805 22:47:31.064674 26047 tablet_replica.cc:330] T a0b8e7882d4b4a92bdc33354d56405be P 89b1294014344834957f89fad6b58def: stopping tablet replica
I20260805 22:47:31.064767 26047 raft_consensus.cc:2229] T a0b8e7882d4b4a92bdc33354d56405be P 89b1294014344834957f89fad6b58def [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:47:31.064781 25425 tablet_service.cc:1514] Processing DeleteTablet for tablet a0b8e7882d4b4a92bdc33354d56405be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:47:31 UTC) from {username='oryx', principal='oryx/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:46648
I20260805 22:47:31.064867 26047 raft_consensus.cc:2258] T a0b8e7882d4b4a92bdc33354d56405be P 89b1294014344834957f89fad6b58def [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:47:31.064977 26048 tablet_replica.cc:330] T a0b8e7882d4b4a92bdc33354d56405be P 407ddbed1bf8493fa6677df269ca521c: stopping tablet replica
I20260805 22:47:31.065100 26048 raft_consensus.cc:2229] T a0b8e7882d4b4a92bdc33354d56405be P 407ddbed1bf8493fa6677df269ca521c [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:47:31.065238 26048 raft_consensus.cc:2258] T a0b8e7882d4b4a92bdc33354d56405be P 407ddbed1bf8493fa6677df269ca521c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:47:31.065325 26047 ts_tablet_manager.cc:1905] T a0b8e7882d4b4a92bdc33354d56405be P 89b1294014344834957f89fad6b58def: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:47:31.065866 26048 ts_tablet_manager.cc:1905] T a0b8e7882d4b4a92bdc33354d56405be P 407ddbed1bf8493fa6677df269ca521c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:47:31.066249 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 24027
I20260805 22:47:31.076449 26047 ts_tablet_manager.cc:1918] T a0b8e7882d4b4a92bdc33354d56405be P 89b1294014344834957f89fad6b58def: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:47:31.076561 26047 log.cc:1196] T a0b8e7882d4b4a92bdc33354d56405be P 89b1294014344834957f89fad6b58def: Deleting WAL directory at /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-1/wal/wals/a0b8e7882d4b4a92bdc33354d56405be
I20260805 22:47:31.076820 26047 ts_tablet_manager.cc:1939] T a0b8e7882d4b4a92bdc33354d56405be P 89b1294014344834957f89fad6b58def: Deleting consensus metadata
I20260805 22:47:31.077521 26050 tablet_replica.cc:330] T a0b8e7882d4b4a92bdc33354d56405be P 936d4bcf12614852a0aede9ed99863a0: stopping tablet replica
I20260805 22:47:31.077675 26050 raft_consensus.cc:2229] T a0b8e7882d4b4a92bdc33354d56405be P 936d4bcf12614852a0aede9ed99863a0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:47:31.077814 26050 raft_consensus.cc:2258] T a0b8e7882d4b4a92bdc33354d56405be P 936d4bcf12614852a0aede9ed99863a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:47:31.078032 26048 ts_tablet_manager.cc:1918] T a0b8e7882d4b4a92bdc33354d56405be P 407ddbed1bf8493fa6677df269ca521c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:47:31.078122 26048 log.cc:1196] T a0b8e7882d4b4a92bdc33354d56405be P 407ddbed1bf8493fa6677df269ca521c: Deleting WAL directory at /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-2/wal/wals/a0b8e7882d4b4a92bdc33354d56405be
I20260805 22:47:31.078404 26048 ts_tablet_manager.cc:1939] T a0b8e7882d4b4a92bdc33354d56405be P 407ddbed1bf8493fa6677df269ca521c: Deleting consensus metadata
I20260805 22:47:31.079403 26050 ts_tablet_manager.cc:1905] T a0b8e7882d4b4a92bdc33354d56405be P 936d4bcf12614852a0aede9ed99863a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:47:31.081126 26050 ts_tablet_manager.cc:1918] T a0b8e7882d4b4a92bdc33354d56405be P 936d4bcf12614852a0aede9ed99863a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:47:31.081204 26050 log.cc:1196] T a0b8e7882d4b4a92bdc33354d56405be P 936d4bcf12614852a0aede9ed99863a0: Deleting WAL directory at /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-0/wal/wals/a0b8e7882d4b4a92bdc33354d56405be
I20260805 22:47:31.081478 26050 ts_tablet_manager.cc:1939] T a0b8e7882d4b4a92bdc33354d56405be P 936d4bcf12614852a0aede9ed99863a0: Deleting consensus metadata
W20260805 22:47:31.084534 25779 connection.cc:535] server connection from 127.0.0.1:39224 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260805 22:47:31.084569 25356 connection.cc:535] server connection from 127.0.0.1:46648 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260805 22:47:31.085000 25565 connection.cc:535] server connection from 127.0.0.1:51752 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260805 22:47:31.085035 25530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:31.065513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46198 (local address 127.14.224.188:38037)
0805 22:47:31.065554 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:31.065556 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:31.077349 (+ 11793us) server_negotiation.cc:407] Connection header received
0805 22:47:31.077407 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:31.077409 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:31.077422 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:31.077469 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:31.078656 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:31.079408 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:31.080484 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:31.080752 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:31.080796 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:31.082424 (+ 1628us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:31.082425 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:31.082426 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:31.082434 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:31.083758 (+ 1324us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:31.084104 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:31.084105 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:31.084106 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:31.084162 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:31.084358 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:31.084359 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:31.084359 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:31.084497 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:31.084596 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:31.084823 (+ 227us) server_negotiation.cc:299] Negotiation successful
0805 22:47:31.084925 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260805 22:47:31.094161 25032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:31.086906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57736 (local address 127.14.224.189:44253)
0805 22:47:31.086951 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:31.086953 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:31.086960 (+ 7us) server_negotiation.cc:407] Connection header received
0805 22:47:31.086986 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:31.086987 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:31.086998 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:31.087049 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:31.088067 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:31.088759 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:31.089450 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:31.089654 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:31.089722 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:31.091316 (+ 1594us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:31.091317 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:31.091318 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:31.091326 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:31.092962 (+ 1636us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:31.093383 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:31.093384 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:31.093385 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:31.093450 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:31.093613 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:31.093614 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:31.093614 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:31.093755 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:31.093850 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:31.093969 (+ 119us) server_negotiation.cc:299] Negotiation successful
0805 22:47:31.094052 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260805 22:47:31.094226 25530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:31.086687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46204 (local address 127.14.224.188:38037)
0805 22:47:31.086724 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:31.086726 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:31.086909 (+ 183us) server_negotiation.cc:407] Connection header received
0805 22:47:31.086989 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:31.086990 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:31.087001 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:31.087050 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:31.087837 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:31.088610 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:31.089677 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:31.089904 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:31.089967 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:31.091814 (+ 1847us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:31.091815 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:31.091815 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:31.091822 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:31.093062 (+ 1240us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:31.093453 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:31.093454 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:31.093454 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:31.093516 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:31.093679 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:31.093680 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:31.093681 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:31.093800 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:31.093888 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:31.094058 (+ 170us) server_negotiation.cc:299] Negotiation successful
0805 22:47:31.094134 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260805 22:47:32.062693 26065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:32.062380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42399 (local address 127.14.224.130:43747)
0805 22:47:32.062523 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:32.062633 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:42399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":69,"threads_started":1}
I20260805 22:47:32.062979 26066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:32.062695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42399 (local address 127.14.224.131:60887)
0805 22:47:32.062848 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:32.062915 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:42399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":67,"threads_started":1}
W20260805 22:47:32.062999 25742 heartbeater.cc:644] Failed to heartbeat to 127.14.224.190:42399 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.14.224.190:42399: connect: Connection refused (error 111)
W20260805 22:47:32.063153 25962 heartbeater.cc:644] Failed to heartbeat to 127.14.224.190:42399 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.14.224.190:42399: connect: Connection refused (error 111)
I20260805 22:47:32.065014 26073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:32.064770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42399 (local address 127.14.224.129:35265)
0805 22:47:32.064872 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:32.064972 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:42399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84,"thread_start_us":48,"threads_started":1}
W20260805 22:47:32.065198 25527 heartbeater.cc:644] Failed to heartbeat to 127.14.224.190:42399 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.14.224.190:42399: connect: Connection refused (error 111)
I20260805 22:47:32.564757 26074 raft_consensus.cc:482] T 00000000000000000000000000000000 P c85d05dcb2f94f3f8ff437ee8666c548 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f0fb2e45b5414c06af56004d3bea4ca8)
I20260805 22:47:32.564877 26075 raft_consensus.cc:482] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f0fb2e45b5414c06af56004d3bea4ca8)
I20260805 22:47:32.564945 26074 raft_consensus.cc:504] T 00000000000000000000000000000000 P c85d05dcb2f94f3f8ff437ee8666c548 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 42399 } } peers { permanent_uuid: "233a2c69697b4b168b656c682271145c" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 44253 } attrs { promote: false } } peers { permanent_uuid: "c85d05dcb2f94f3f8ff437ee8666c548" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 38037 } attrs { promote: false } }
I20260805 22:47:32.565024 26075 raft_consensus.cc:504] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 42399 } } peers { permanent_uuid: "233a2c69697b4b168b656c682271145c" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 44253 } attrs { promote: false } } peers { permanent_uuid: "c85d05dcb2f94f3f8ff437ee8666c548" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 38037 } attrs { promote: false } }
I20260805 22:47:32.565260 26074 leader_election.cc:288] T 00000000000000000000000000000000 P c85d05dcb2f94f3f8ff437ee8666c548 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f0fb2e45b5414c06af56004d3bea4ca8 (127.14.224.190:42399), 233a2c69697b4b168b656c682271145c (127.14.224.189:44253)
I20260805 22:47:32.565292 26075 leader_election.cc:288] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f0fb2e45b5414c06af56004d3bea4ca8 (127.14.224.190:42399), c85d05dcb2f94f3f8ff437ee8666c548 (127.14.224.188:38037)
I20260805 22:47:32.565647 26076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:32.565414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42399 (local address 127.0.0.1:55810)
0805 22:47:32.565548 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:32.565599 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:42399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":59,"threads_started":1}
W20260805 22:47:32.565807 24954 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.224.190:42399: connect: Connection refused (error 111)
I20260805 22:47:32.566289 26081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:32.566174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42399 (local address 127.0.0.1:55820)
0805 22:47:32.566213 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:32.566259 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:42399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260805 22:47:32.566295 26082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:32.565414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42399 (local address 127.0.0.1:55800)
0805 22:47:32.565680 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:32.566237 (+ 557us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:42399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":65,"threads_started":1}
W20260805 22:47:32.566397 25237 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.224.190:42399: connect: Connection refused (error 111)
W20260805 22:47:32.566686 24954 leader_election.cc:334] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f0fb2e45b5414c06af56004d3bea4ca8 (127.14.224.190:42399): Network error: Client connection negotiation failed: client connection to 127.14.224.190:42399: connect: Connection refused (error 111)
I20260805 22:47:32.567189 26082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:32.567073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42399 (local address 127.0.0.1:55828)
0805 22:47:32.567127 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:32.567162 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:42399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260805 22:47:32.567333 25237 leader_election.cc:334] T 00000000000000000000000000000000 P c85d05dcb2f94f3f8ff437ee8666c548 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f0fb2e45b5414c06af56004d3bea4ca8 (127.14.224.190:42399): Network error: Client connection negotiation failed: client connection to 127.14.224.190:42399: connect: Connection refused (error 111)
I20260805 22:47:32.568763 26083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:32.565587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46212 (local address 127.14.224.188:38037)
0805 22:47:32.565700 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:32.565702 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:32.565854 (+ 152us) server_negotiation.cc:407] Connection header received
0805 22:47:32.565886 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:32.565887 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:32.565903 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:32.565977 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:47:32.566165 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:32.566880 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:32.568033 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:32.568409 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:32.568480 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:32.568492 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:32.568635 (+ 143us) server_negotiation.cc:299] Negotiation successful
0805 22:47:32.568684 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":92,"thread_start_us":50,"threads_started":1}
I20260805 22:47:32.568761 26084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:32.565712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57746 (local address 127.14.224.189:44253)
0805 22:47:32.565806 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:32.565807 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:32.565838 (+ 31us) server_negotiation.cc:407] Connection header received
0805 22:47:32.565929 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:32.565930 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:32.565940 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:32.565989 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:47:32.566171 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:32.566784 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:32.568008 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:32.568411 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:32.568489 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:32.568499 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:32.568630 (+ 131us) server_negotiation.cc:299] Negotiation successful
0805 22:47:32.568680 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":76,"thread_start_us":51,"threads_started":1}
I20260805 22:47:32.568775 26080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:32.565587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.189:44253 (local address 127.0.0.1:57746)
0805 22:47:32.565772 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:32.565783 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:32.565856 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:32.566036 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:32.566037 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:32.566039 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:47:32.566085 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:32.566087 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:32.566861 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:32.566950 (+ 89us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:32.567913 (+ 963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:32.567917 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:32.568496 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:32.568497 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:32.568567 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:32.568571 (+ 4us) client_negotiation.cc:769] Sending connection context
0805 22:47:32.568618 (+ 47us) client_negotiation.cc:240] Negotiation successful
0805 22:47:32.568668 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":46,"threads_started":1}
I20260805 22:47:32.568761 26076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:32.565453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.188:38037 (local address 127.0.0.1:46212)
0805 22:47:32.565717 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:32.565727 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:32.565796 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:32.565998 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:32.565999 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:32.566001 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:47:32.566049 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:32.566051 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:32.566985 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:32.566986 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:32.567924 (+ 938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:32.567928 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:32.568491 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:32.568492 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:32.568563 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:32.568567 (+ 4us) client_negotiation.cc:769] Sending connection context
0805 22:47:32.568617 (+ 50us) client_negotiation.cc:240] Negotiation successful
0805 22:47:32.568672 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":34,"threads_started":1}
I20260805 22:47:32.569342 24993 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c85d05dcb2f94f3f8ff437ee8666c548" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "233a2c69697b4b168b656c682271145c" is_pre_election: true
I20260805 22:47:32.569465 24993 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85d05dcb2f94f3f8ff437ee8666c548 in term 1.
I20260805 22:47:32.569635 25237 leader_election.cc:302] T 00000000000000000000000000000000 P c85d05dcb2f94f3f8ff437ee8666c548 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 233a2c69697b4b168b656c682271145c, c85d05dcb2f94f3f8ff437ee8666c548; no voters: f0fb2e45b5414c06af56004d3bea4ca8
I20260805 22:47:32.569680 25270 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "233a2c69697b4b168b656c682271145c" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "c85d05dcb2f94f3f8ff437ee8666c548" is_pre_election: true
I20260805 22:47:32.569756 26074 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c85d05dcb2f94f3f8ff437ee8666c548 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260805 22:47:32.569798 25270 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c85d05dcb2f94f3f8ff437ee8666c548 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 233a2c69697b4b168b656c682271145c in term 1.
I20260805 22:47:32.569849 26074 raft_consensus.cc:482] T 00000000000000000000000000000000 P c85d05dcb2f94f3f8ff437ee8666c548 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f0fb2e45b5414c06af56004d3bea4ca8)
I20260805 22:47:32.569882 26074 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c85d05dcb2f94f3f8ff437ee8666c548 [term 1 FOLLOWER]: Advancing to term 2
I20260805 22:47:32.569998 24956 leader_election.cc:302] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 233a2c69697b4b168b656c682271145c, c85d05dcb2f94f3f8ff437ee8666c548; no voters: f0fb2e45b5414c06af56004d3bea4ca8
I20260805 22:47:32.570118 26075 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260805 22:47:32.570165 26075 raft_consensus.cc:482] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c [term 1 FOLLOWER]: Starting leader election (detected failure of leader f0fb2e45b5414c06af56004d3bea4ca8)
I20260805 22:47:32.570189 26075 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c [term 1 FOLLOWER]: Advancing to term 2
I20260805 22:47:32.570868 26074 raft_consensus.cc:504] T 00000000000000000000000000000000 P c85d05dcb2f94f3f8ff437ee8666c548 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 42399 } } peers { permanent_uuid: "233a2c69697b4b168b656c682271145c" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 44253 } attrs { promote: false } } peers { permanent_uuid: "c85d05dcb2f94f3f8ff437ee8666c548" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 38037 } attrs { promote: false } }
I20260805 22:47:32.571039 26074 leader_election.cc:288] T 00000000000000000000000000000000 P c85d05dcb2f94f3f8ff437ee8666c548 [CANDIDATE]: Term 2 election: Requested vote from peers f0fb2e45b5414c06af56004d3bea4ca8 (127.14.224.190:42399), 233a2c69697b4b168b656c682271145c (127.14.224.189:44253)
I20260805 22:47:32.571000 26075 raft_consensus.cc:504] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 42399 } } peers { permanent_uuid: "233a2c69697b4b168b656c682271145c" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 44253 } attrs { promote: false } } peers { permanent_uuid: "c85d05dcb2f94f3f8ff437ee8666c548" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 38037 } attrs { promote: false } }
I20260805 22:47:32.571130 26075 leader_election.cc:288] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c [CANDIDATE]: Term 2 election: Requested vote from peers f0fb2e45b5414c06af56004d3bea4ca8 (127.14.224.190:42399), c85d05dcb2f94f3f8ff437ee8666c548 (127.14.224.188:38037)
I20260805 22:47:32.571313 25270 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "233a2c69697b4b168b656c682271145c" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "c85d05dcb2f94f3f8ff437ee8666c548"
I20260805 22:47:32.571363 24993 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c85d05dcb2f94f3f8ff437ee8666c548" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "233a2c69697b4b168b656c682271145c"
I20260805 22:47:32.571429 25270 raft_consensus.cc:2379] T 00000000000000000000000000000000 P c85d05dcb2f94f3f8ff437ee8666c548 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 233a2c69697b4b168b656c682271145c in current term 2: Already voted for candidate c85d05dcb2f94f3f8ff437ee8666c548 in this term.
I20260805 22:47:32.571480 24993 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c85d05dcb2f94f3f8ff437ee8666c548 in current term 2: Already voted for candidate 233a2c69697b4b168b656c682271145c in this term.
I20260805 22:47:32.571499 26080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:32.571190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42399 (local address 127.0.0.1:55832)
0805 22:47:32.571404 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:32.571431 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:42399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198}
I20260805 22:47:32.571619 26076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:32.571196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42399 (local address 127.0.0.1:55844)
0805 22:47:32.571337 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:32.571375 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:42399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113}
I20260805 22:47:32.571928 26080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:32.571824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42399 (local address 127.0.0.1:55846)
0805 22:47:32.571873 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:32.571902 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:42399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260805 22:47:32.571973 26076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:32.571845 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42399 (local address 127.0.0.1:55862)
0805 22:47:32.571894 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:32.571926 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:42399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260805 22:47:32.572016 25237 leader_election.cc:334] T 00000000000000000000000000000000 P c85d05dcb2f94f3f8ff437ee8666c548 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f0fb2e45b5414c06af56004d3bea4ca8 (127.14.224.190:42399): Network error: Client connection negotiation failed: client connection to 127.14.224.190:42399: connect: Connection refused (error 111)
W20260805 22:47:32.572038 24954 leader_election.cc:334] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f0fb2e45b5414c06af56004d3bea4ca8 (127.14.224.190:42399): Network error: Client connection negotiation failed: client connection to 127.14.224.190:42399: connect: Connection refused (error 111)
I20260805 22:47:32.572058 25237 leader_election.cc:302] T 00000000000000000000000000000000 P c85d05dcb2f94f3f8ff437ee8666c548 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85d05dcb2f94f3f8ff437ee8666c548; no voters: 233a2c69697b4b168b656c682271145c, f0fb2e45b5414c06af56004d3bea4ca8
I20260805 22:47:32.572075 24954 leader_election.cc:302] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 233a2c69697b4b168b656c682271145c; no voters: c85d05dcb2f94f3f8ff437ee8666c548, f0fb2e45b5414c06af56004d3bea4ca8
I20260805 22:47:32.572134 26074 raft_consensus.cc:2726] T 00000000000000000000000000000000 P c85d05dcb2f94f3f8ff437ee8666c548 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260805 22:47:32.572178 26075 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260805 22:47:33.063620 26088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:33.063352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42399 (local address 127.14.224.130:46485)
0805 22:47:33.063516 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:33.063561 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:42399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":91,"threads_started":1}
I20260805 22:47:33.063800 26089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:33.063509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42399 (local address 127.14.224.131:56111)
0805 22:47:33.063648 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:33.063696 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:42399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":65,"threads_started":1}
I20260805 22:47:33.065639 26090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:33.065477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42399 (local address 127.14.224.129:43223)
0805 22:47:33.065578 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:33.065602 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:42399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88,"thread_start_us":56,"threads_started":1}
I20260805 22:47:34.064384 26091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:34.064176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42399 (local address 127.14.224.130:52151)
0805 22:47:34.064294 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:34.064331 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:42399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":61,"threads_started":1}
I20260805 22:47:34.064436 26092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:34.064235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42399 (local address 127.14.224.131:56497)
0805 22:47:34.064348 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:34.064387 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:42399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":55,"threads_started":1}
I20260805 22:47:34.066180 26093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:34.066008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42399 (local address 127.14.224.129:56007)
0805 22:47:34.066111 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:34.066139 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:42399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88,"thread_start_us":53,"threads_started":1}
I20260805 22:47:34.134424 26094 raft_consensus.cc:482] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:47:34.134553 26094 raft_consensus.cc:504] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 42399 } } peers { permanent_uuid: "233a2c69697b4b168b656c682271145c" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 44253 } attrs { promote: false } } peers { permanent_uuid: "c85d05dcb2f94f3f8ff437ee8666c548" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 38037 } attrs { promote: false } }
I20260805 22:47:34.134757 26094 leader_election.cc:288] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f0fb2e45b5414c06af56004d3bea4ca8 (127.14.224.190:42399), c85d05dcb2f94f3f8ff437ee8666c548 (127.14.224.188:38037)
I20260805 22:47:34.135071 25270 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "233a2c69697b4b168b656c682271145c" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "c85d05dcb2f94f3f8ff437ee8666c548" is_pre_election: true
I20260805 22:47:34.135183 25270 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c85d05dcb2f94f3f8ff437ee8666c548 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 233a2c69697b4b168b656c682271145c in term 2.
I20260805 22:47:34.135238 26095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:34.134965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42399 (local address 127.0.0.1:56086)
0805 22:47:34.135130 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:34.135189 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:42399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":80,"threads_started":1}
I20260805 22:47:34.135403 24956 leader_election.cc:302] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 233a2c69697b4b168b656c682271145c, c85d05dcb2f94f3f8ff437ee8666c548; no voters:
I20260805 22:47:34.135654 26094 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260805 22:47:34.135711 26094 raft_consensus.cc:482] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:47:34.135715 26095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:34.135610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42399 (local address 127.0.0.1:56098)
0805 22:47:34.135657 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:34.135690 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:42399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260805 22:47:34.135756 26094 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c [term 2 FOLLOWER]: Advancing to term 3
W20260805 22:47:34.135787 24954 leader_election.cc:334] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f0fb2e45b5414c06af56004d3bea4ca8 (127.14.224.190:42399): Network error: Client connection negotiation failed: client connection to 127.14.224.190:42399: connect: Connection refused (error 111)
I20260805 22:47:34.136540 26094 raft_consensus.cc:504] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 42399 } } peers { permanent_uuid: "233a2c69697b4b168b656c682271145c" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 44253 } attrs { promote: false } } peers { permanent_uuid: "c85d05dcb2f94f3f8ff437ee8666c548" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 38037 } attrs { promote: false } }
I20260805 22:47:34.136677 26094 leader_election.cc:288] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c [CANDIDATE]: Term 3 election: Requested vote from peers f0fb2e45b5414c06af56004d3bea4ca8 (127.14.224.190:42399), c85d05dcb2f94f3f8ff437ee8666c548 (127.14.224.188:38037)
I20260805 22:47:34.136894 26095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:34.136783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42399 (local address 127.0.0.1:56108)
0805 22:47:34.136833 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:34.136871 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:42399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260805 22:47:34.136881 25270 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "233a2c69697b4b168b656c682271145c" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "c85d05dcb2f94f3f8ff437ee8666c548"
I20260805 22:47:34.137005 25270 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c85d05dcb2f94f3f8ff437ee8666c548 [term 2 FOLLOWER]: Advancing to term 3
I20260805 22:47:34.137259 26095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:34.137162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42399 (local address 127.0.0.1:56116)
0805 22:47:34.137214 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:34.137241 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:42399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260805 22:47:34.137327 24954 leader_election.cc:334] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer f0fb2e45b5414c06af56004d3bea4ca8 (127.14.224.190:42399): Network error: Client connection negotiation failed: client connection to 127.14.224.190:42399: connect: Connection refused (error 111)
I20260805 22:47:34.137738 25270 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c85d05dcb2f94f3f8ff437ee8666c548 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 233a2c69697b4b168b656c682271145c in term 3.
I20260805 22:47:34.137977 24956 leader_election.cc:302] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 233a2c69697b4b168b656c682271145c, c85d05dcb2f94f3f8ff437ee8666c548; no voters: f0fb2e45b5414c06af56004d3bea4ca8
I20260805 22:47:34.138123 26094 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c [term 3 FOLLOWER]: Leader election won for term 3
I20260805 22:47:34.138252 26094 raft_consensus.cc:686] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c [term 3 LEADER]: Becoming Leader. State: Replica: 233a2c69697b4b168b656c682271145c, State: Running, Role: LEADER
I20260805 22:47:34.138341 26094 consensus_queue.cc:237] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 42399 } } peers { permanent_uuid: "233a2c69697b4b168b656c682271145c" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 44253 } attrs { promote: false } } peers { permanent_uuid: "c85d05dcb2f94f3f8ff437ee8666c548" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 38037 } attrs { promote: false } }
I20260805 22:47:34.138731 26098 sys_catalog.cc:455] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 233a2c69697b4b168b656c682271145c. Latest consensus state: current_term: 3 leader_uuid: "233a2c69697b4b168b656c682271145c" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 42399 } } peers { permanent_uuid: "233a2c69697b4b168b656c682271145c" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 44253 } attrs { promote: false } } peers { permanent_uuid: "c85d05dcb2f94f3f8ff437ee8666c548" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 38037 } attrs { promote: false } } }
I20260805 22:47:34.138844 26098 sys_catalog.cc:458] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c [sys.catalog]: This master's current role is: LEADER
I20260805 22:47:34.139032 26101 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:47:34.139637 26101 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:47:34.139729 26101 catalog_manager.cc:1259] Loaded cluster ID: 03236882b32e4ccf9fe1162c00642f68
I20260805 22:47:34.139762 26101 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:47:34.139942 26101 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:47:34.140014 26101 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c: Loaded TSK: 0
I20260805 22:47:34.140157 26101 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:47:34.178654 24977 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57736:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:47:34.180410 24977 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:47:34.181438 26095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:34.181333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42399 (local address 127.0.0.1:56124)
0805 22:47:34.181381 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:34.181411 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:42399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260805 22:47:34.181488 25270 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c85d05dcb2f94f3f8ff437ee8666c548 [term 3 FOLLOWER]: Refusing update from remote peer 233a2c69697b4b168b656c682271145c: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260805 22:47:34.181766 26095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:34.181681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42399 (local address 127.0.0.1:56136)
0805 22:47:34.181722 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:34.181746 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:42399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
I20260805 22:47:34.181722 26094 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85d05dcb2f94f3f8ff437ee8666c548" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 38037 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260805 22:47:34.181845 24954 consensus_peers.cc:487] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c -> Peer f0fb2e45b5414c06af56004d3bea4ca8 (127.14.224.190:42399): Couldn't send request to peer f0fb2e45b5414c06af56004d3bea4ca8. Status: Network error: Client connection negotiation failed: client connection to 127.14.224.190:42399: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260805 22:47:34.182317 26103 sys_catalog.cc:455] T 00000000000000000000000000000000 P c85d05dcb2f94f3f8ff437ee8666c548 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 233a2c69697b4b168b656c682271145c. Latest consensus state: current_term: 3 leader_uuid: "233a2c69697b4b168b656c682271145c" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 42399 } } peers { permanent_uuid: "233a2c69697b4b168b656c682271145c" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 44253 } attrs { promote: false } } peers { permanent_uuid: "c85d05dcb2f94f3f8ff437ee8666c548" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 38037 } attrs { promote: false } } }
I20260805 22:47:34.182417 26103 sys_catalog.cc:458] T 00000000000000000000000000000000 P c85d05dcb2f94f3f8ff437ee8666c548 [sys.catalog]: This master's current role is: FOLLOWER
I20260805 22:47:34.182853 26098 sys_catalog.cc:455] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "233a2c69697b4b168b656c682271145c" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 42399 } } peers { permanent_uuid: "233a2c69697b4b168b656c682271145c" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 44253 } attrs { promote: false } } peers { permanent_uuid: "c85d05dcb2f94f3f8ff437ee8666c548" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 38037 } attrs { promote: false } } }
I20260805 22:47:34.182956 26098 sys_catalog.cc:458] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c [sys.catalog]: This master's current role is: LEADER
I20260805 22:47:34.183003 26104 mvcc.cc:205] Tried to move back new op lower bound from 7315333341925322752 to 7315333341751304192. Current Snapshot: MvccSnapshot[applied={T|T < 7315333341925322752}]
I20260805 22:47:34.183084 26103 sys_catalog.cc:455] T 00000000000000000000000000000000 P c85d05dcb2f94f3f8ff437ee8666c548 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "233a2c69697b4b168b656c682271145c" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "f0fb2e45b5414c06af56004d3bea4ca8" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 42399 } } peers { permanent_uuid: "233a2c69697b4b168b656c682271145c" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 44253 } attrs { promote: false } } peers { permanent_uuid: "c85d05dcb2f94f3f8ff437ee8666c548" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 38037 } attrs { promote: false } } }
I20260805 22:47:34.183156 26103 sys_catalog.cc:458] T 00000000000000000000000000000000 P c85d05dcb2f94f3f8ff437ee8666c548 [sys.catalog]: This master's current role is: FOLLOWER
I20260805 22:47:34.187884 26117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:34.184687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.129:42859 (local address 127.0.0.1:46654)
0805 22:47:34.184950 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:34.184976 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:34.185045 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:34.185221 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:34.185221 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:34.185223 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:47:34.185302 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:34.185304 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:34.186054 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:34.186055 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:34.186942 (+ 887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:34.186945 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:34.187635 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:34.187635 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:34.187701 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:34.187705 (+ 4us) client_negotiation.cc:769] Sending connection context
0805 22:47:34.187759 (+ 54us) client_negotiation.cc:240] Negotiation successful
0805 22:47:34.187801 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":244,"mutex_wait_us":37,"thread_start_us":105,"threads_started":1}
I20260805 22:47:34.187935 26118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:34.184844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46654 (local address 127.14.224.129:42859)
0805 22:47:34.184951 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:34.184953 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:34.185020 (+ 67us) server_negotiation.cc:407] Connection header received
0805 22:47:34.185094 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:34.185095 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:34.185105 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:34.185174 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:47:34.185378 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:34.185976 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:34.187022 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:34.187527 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:34.187593 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:34.187603 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:34.187786 (+ 183us) server_negotiation.cc:299] Negotiation successful
0805 22:47:34.187837 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80,"thread_start_us":57,"threads_started":1}
I20260805 22:47:34.188511 26095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:34.184609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.131:41917 (local address 127.0.0.1:39246)
0805 22:47:34.184727 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:34.184739 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:34.184790 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:34.185028 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:34.185029 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:34.185030 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:47:34.185100 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:34.185102 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:34.186062 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:34.186064 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:34.187304 (+ 1240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:34.187307 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:34.188230 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:34.188231 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:34.188306 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:34.188311 (+ 5us) client_negotiation.cc:769] Sending connection context
0805 22:47:34.188350 (+ 39us) client_negotiation.cc:240] Negotiation successful
0805 22:47:34.188406 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":99,"mutex_wait_us":66}
I20260805 22:47:34.188593 26112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:34.184693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39246 (local address 127.14.224.131:41917)
0805 22:47:34.184886 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:34.184888 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:34.184927 (+ 39us) server_negotiation.cc:407] Connection header received
0805 22:47:34.184953 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:34.184954 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:34.184965 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:34.185025 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:47:34.185176 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:34.185962 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:34.187424 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:34.188059 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:34.188178 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:34.188206 (+ 28us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:34.188477 (+ 271us) server_negotiation.cc:299] Negotiation successful
0805 22:47:34.188529 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":52,"threads_started":1}
I20260805 22:47:34.188642 26119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:34.184898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51758 (local address 127.14.224.130:40547)
0805 22:47:34.185252 (+ 354us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:34.185254 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:34.185262 (+ 8us) server_negotiation.cc:407] Connection header received
0805 22:47:34.185337 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:34.185338 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:34.185348 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:34.185450 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:47:34.185551 (+ 101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:34.186242 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:34.187577 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:34.188107 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:34.188175 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:34.188184 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:34.188438 (+ 254us) server_negotiation.cc:299] Negotiation successful
0805 22:47:34.188495 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":181,"thread_start_us":64,"threads_started":1}
I20260805 22:47:34.188756 26113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:34.184693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.130:40547 (local address 127.0.0.1:51758)
0805 22:47:34.185120 (+ 427us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:34.185129 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:34.185162 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:34.185459 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:34.185460 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:34.185461 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:47:34.185494 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:34.185495 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:34.186325 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:34.186326 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:34.187499 (+ 1173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:34.187500 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:34.188217 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:34.188218 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:34.188279 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:34.188284 (+ 5us) client_negotiation.cc:769] Sending connection context
0805 22:47:34.188329 (+ 45us) client_negotiation.cc:240] Negotiation successful
0805 22:47:34.188373 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":414,"mutex_wait_us":3,"thread_start_us":98,"threads_started":1}
I20260805 22:47:34.188791 25856 tablet_service.cc:1467] Processing CreateTablet for tablet 4103d35b4ec0416a922bfe6fb0350b79 (DEFAULT_TABLE table=test-table [id=0edd98e339a14cc0b3b60f3a7199eefb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:47:34.188920 25856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4103d35b4ec0416a922bfe6fb0350b79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:34.189031 25425 tablet_service.cc:1467] Processing CreateTablet for tablet 4103d35b4ec0416a922bfe6fb0350b79 (DEFAULT_TABLE table=test-table [id=0edd98e339a14cc0b3b60f3a7199eefb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:47:34.189237 25425 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4103d35b4ec0416a922bfe6fb0350b79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:34.190440 26120 tablet_bootstrap.cc:492] T 4103d35b4ec0416a922bfe6fb0350b79 P 407ddbed1bf8493fa6677df269ca521c: Bootstrap starting.
I20260805 22:47:34.190645 25638 tablet_service.cc:1467] Processing CreateTablet for tablet 4103d35b4ec0416a922bfe6fb0350b79 (DEFAULT_TABLE table=test-table [id=0edd98e339a14cc0b3b60f3a7199eefb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:47:34.190771 25638 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4103d35b4ec0416a922bfe6fb0350b79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:34.190907 26120 tablet_bootstrap.cc:654] T 4103d35b4ec0416a922bfe6fb0350b79 P 407ddbed1bf8493fa6677df269ca521c: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:34.191534 26121 tablet_bootstrap.cc:492] T 4103d35b4ec0416a922bfe6fb0350b79 P 936d4bcf12614852a0aede9ed99863a0: Bootstrap starting.
I20260805 22:47:34.191555 26120 tablet_bootstrap.cc:492] T 4103d35b4ec0416a922bfe6fb0350b79 P 407ddbed1bf8493fa6677df269ca521c: No bootstrap required, opened a new log
I20260805 22:47:34.191601 26120 ts_tablet_manager.cc:1397] T 4103d35b4ec0416a922bfe6fb0350b79 P 407ddbed1bf8493fa6677df269ca521c: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260805 22:47:34.191722 26120 raft_consensus.cc:348] T 4103d35b4ec0416a922bfe6fb0350b79 P 407ddbed1bf8493fa6677df269ca521c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "407ddbed1bf8493fa6677df269ca521c" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 41917 } } peers { permanent_uuid: "89b1294014344834957f89fad6b58def" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40547 } } peers { permanent_uuid: "936d4bcf12614852a0aede9ed99863a0" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42859 } }
I20260805 22:47:34.191804 26120 raft_consensus.cc:374] T 4103d35b4ec0416a922bfe6fb0350b79 P 407ddbed1bf8493fa6677df269ca521c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:34.191823 26120 raft_consensus.cc:729] T 4103d35b4ec0416a922bfe6fb0350b79 P 407ddbed1bf8493fa6677df269ca521c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 407ddbed1bf8493fa6677df269ca521c, State: Initialized, Role: FOLLOWER
I20260805 22:47:34.191891 26120 consensus_queue.cc:260] T 4103d35b4ec0416a922bfe6fb0350b79 P 407ddbed1bf8493fa6677df269ca521c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "407ddbed1bf8493fa6677df269ca521c" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 41917 } } peers { permanent_uuid: "89b1294014344834957f89fad6b58def" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40547 } } peers { permanent_uuid: "936d4bcf12614852a0aede9ed99863a0" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42859 } }
I20260805 22:47:34.191939 26121 tablet_bootstrap.cc:654] T 4103d35b4ec0416a922bfe6fb0350b79 P 936d4bcf12614852a0aede9ed99863a0: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:34.192077 26120 ts_tablet_manager.cc:1428] T 4103d35b4ec0416a922bfe6fb0350b79 P 407ddbed1bf8493fa6677df269ca521c: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260805 22:47:34.192086 26131 tablet_bootstrap.cc:492] T 4103d35b4ec0416a922bfe6fb0350b79 P 89b1294014344834957f89fad6b58def: Bootstrap starting.
I20260805 22:47:34.192564 26092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:34.192454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42399 (local address 127.14.224.131:47603)
0805 22:47:34.192496 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:34.192534 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:42399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
I20260805 22:47:34.192909 26131 tablet_bootstrap.cc:654] T 4103d35b4ec0416a922bfe6fb0350b79 P 89b1294014344834957f89fad6b58def: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:34.192946 25963 heartbeater.cc:503] Master 127.14.224.189:44253 was elected leader, sending a full tablet report...
I20260805 22:47:34.193015 26092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:34.192765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42399 (local address 127.14.224.131:54477)
0805 22:47:34.192961 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:34.192989 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:42399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178}
I20260805 22:47:34.193473 26121 tablet_bootstrap.cc:492] T 4103d35b4ec0416a922bfe6fb0350b79 P 936d4bcf12614852a0aede9ed99863a0: No bootstrap required, opened a new log
I20260805 22:47:34.193532 26121 ts_tablet_manager.cc:1397] T 4103d35b4ec0416a922bfe6fb0350b79 P 936d4bcf12614852a0aede9ed99863a0: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260805 22:47:34.193598 26131 tablet_bootstrap.cc:492] T 4103d35b4ec0416a922bfe6fb0350b79 P 89b1294014344834957f89fad6b58def: No bootstrap required, opened a new log
I20260805 22:47:34.193646 26131 ts_tablet_manager.cc:1397] T 4103d35b4ec0416a922bfe6fb0350b79 P 89b1294014344834957f89fad6b58def: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260805 22:47:34.193696 26121 raft_consensus.cc:348] T 4103d35b4ec0416a922bfe6fb0350b79 P 936d4bcf12614852a0aede9ed99863a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "407ddbed1bf8493fa6677df269ca521c" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 41917 } } peers { permanent_uuid: "89b1294014344834957f89fad6b58def" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40547 } } peers { permanent_uuid: "936d4bcf12614852a0aede9ed99863a0" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42859 } }
I20260805 22:47:34.193771 26121 raft_consensus.cc:374] T 4103d35b4ec0416a922bfe6fb0350b79 P 936d4bcf12614852a0aede9ed99863a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:34.193796 26121 raft_consensus.cc:729] T 4103d35b4ec0416a922bfe6fb0350b79 P 936d4bcf12614852a0aede9ed99863a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936d4bcf12614852a0aede9ed99863a0, State: Initialized, Role: FOLLOWER
I20260805 22:47:34.193791 26131 raft_consensus.cc:348] T 4103d35b4ec0416a922bfe6fb0350b79 P 89b1294014344834957f89fad6b58def [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "407ddbed1bf8493fa6677df269ca521c" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 41917 } } peers { permanent_uuid: "89b1294014344834957f89fad6b58def" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40547 } } peers { permanent_uuid: "936d4bcf12614852a0aede9ed99863a0" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42859 } }
I20260805 22:47:34.193856 26131 raft_consensus.cc:374] T 4103d35b4ec0416a922bfe6fb0350b79 P 89b1294014344834957f89fad6b58def [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:34.193845 26121 consensus_queue.cc:260] T 4103d35b4ec0416a922bfe6fb0350b79 P 936d4bcf12614852a0aede9ed99863a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "407ddbed1bf8493fa6677df269ca521c" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 41917 } } peers { permanent_uuid: "89b1294014344834957f89fad6b58def" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40547 } } peers { permanent_uuid: "936d4bcf12614852a0aede9ed99863a0" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42859 } }
I20260805 22:47:34.193883 26131 raft_consensus.cc:729] T 4103d35b4ec0416a922bfe6fb0350b79 P 89b1294014344834957f89fad6b58def [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89b1294014344834957f89fad6b58def, State: Initialized, Role: FOLLOWER
I20260805 22:47:34.193962 26131 consensus_queue.cc:260] T 4103d35b4ec0416a922bfe6fb0350b79 P 89b1294014344834957f89fad6b58def [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "407ddbed1bf8493fa6677df269ca521c" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 41917 } } peers { permanent_uuid: "89b1294014344834957f89fad6b58def" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40547 } } peers { permanent_uuid: "936d4bcf12614852a0aede9ed99863a0" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42859 } }
I20260805 22:47:34.194038 26121 ts_tablet_manager.cc:1428] T 4103d35b4ec0416a922bfe6fb0350b79 P 936d4bcf12614852a0aede9ed99863a0: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260805 22:47:34.194212 26131 ts_tablet_manager.cc:1428] T 4103d35b4ec0416a922bfe6fb0350b79 P 89b1294014344834957f89fad6b58def: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260805 22:47:34.194306 26093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:34.194159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42399 (local address 127.14.224.129:57875)
0805 22:47:34.194248 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:34.194274 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:42399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260805 22:47:34.194547 26091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:34.194441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42399 (local address 127.14.224.130:42179)
0805 22:47:34.194491 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:34.194519 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:42399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260805 22:47:34.194944 26091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:34.194851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42399 (local address 127.14.224.130:56193)
0805 22:47:34.194886 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:34.194920 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:42399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260805 22:47:34.194947 25528 heartbeater.cc:503] Master 127.14.224.189:44253 was elected leader, sending a full tablet report...
I20260805 22:47:34.195008 26093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:34.194891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42399 (local address 127.14.224.129:34377)
0805 22:47:34.194931 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:34.194959 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:42399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
I20260805 22:47:34.372601 26133 raft_consensus.cc:482] T 4103d35b4ec0416a922bfe6fb0350b79 P 407ddbed1bf8493fa6677df269ca521c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:47:34.372714 26133 raft_consensus.cc:504] T 4103d35b4ec0416a922bfe6fb0350b79 P 407ddbed1bf8493fa6677df269ca521c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "407ddbed1bf8493fa6677df269ca521c" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 41917 } } peers { permanent_uuid: "89b1294014344834957f89fad6b58def" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40547 } } peers { permanent_uuid: "936d4bcf12614852a0aede9ed99863a0" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42859 } }
I20260805 22:47:34.372902 26133 leader_election.cc:288] T 4103d35b4ec0416a922bfe6fb0350b79 P 407ddbed1bf8493fa6677df269ca521c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89b1294014344834957f89fad6b58def (127.14.224.130:40547), 936d4bcf12614852a0aede9ed99863a0 (127.14.224.129:42859)
I20260805 22:47:34.373172 25455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4103d35b4ec0416a922bfe6fb0350b79" candidate_uuid: "407ddbed1bf8493fa6677df269ca521c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936d4bcf12614852a0aede9ed99863a0" is_pre_election: true
I20260805 22:47:34.373163 25668 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4103d35b4ec0416a922bfe6fb0350b79" candidate_uuid: "407ddbed1bf8493fa6677df269ca521c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89b1294014344834957f89fad6b58def" is_pre_election: true
I20260805 22:47:34.373266 25668 raft_consensus.cc:2454] T 4103d35b4ec0416a922bfe6fb0350b79 P 89b1294014344834957f89fad6b58def [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 407ddbed1bf8493fa6677df269ca521c in term 0.
I20260805 22:47:34.373267 25455 raft_consensus.cc:2454] T 4103d35b4ec0416a922bfe6fb0350b79 P 936d4bcf12614852a0aede9ed99863a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 407ddbed1bf8493fa6677df269ca521c in term 0.
I20260805 22:47:34.373442 25779 leader_election.cc:302] T 4103d35b4ec0416a922bfe6fb0350b79 P 407ddbed1bf8493fa6677df269ca521c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 407ddbed1bf8493fa6677df269ca521c, 89b1294014344834957f89fad6b58def; no voters:
I20260805 22:47:34.373577 26133 raft_consensus.cc:2781] T 4103d35b4ec0416a922bfe6fb0350b79 P 407ddbed1bf8493fa6677df269ca521c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:47:34.373631 26133 raft_consensus.cc:482] T 4103d35b4ec0416a922bfe6fb0350b79 P 407ddbed1bf8493fa6677df269ca521c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:47:34.373646 26133 raft_consensus.cc:3037] T 4103d35b4ec0416a922bfe6fb0350b79 P 407ddbed1bf8493fa6677df269ca521c [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:34.374413 26133 raft_consensus.cc:504] T 4103d35b4ec0416a922bfe6fb0350b79 P 407ddbed1bf8493fa6677df269ca521c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "407ddbed1bf8493fa6677df269ca521c" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 41917 } } peers { permanent_uuid: "89b1294014344834957f89fad6b58def" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40547 } } peers { permanent_uuid: "936d4bcf12614852a0aede9ed99863a0" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42859 } }
I20260805 22:47:34.374552 26133 leader_election.cc:288] T 4103d35b4ec0416a922bfe6fb0350b79 P 407ddbed1bf8493fa6677df269ca521c [CANDIDATE]: Term 1 election: Requested vote from peers 89b1294014344834957f89fad6b58def (127.14.224.130:40547), 936d4bcf12614852a0aede9ed99863a0 (127.14.224.129:42859)
I20260805 22:47:34.374765 25455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4103d35b4ec0416a922bfe6fb0350b79" candidate_uuid: "407ddbed1bf8493fa6677df269ca521c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936d4bcf12614852a0aede9ed99863a0"
I20260805 22:47:34.374766 25668 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4103d35b4ec0416a922bfe6fb0350b79" candidate_uuid: "407ddbed1bf8493fa6677df269ca521c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89b1294014344834957f89fad6b58def"
I20260805 22:47:34.374855 25455 raft_consensus.cc:3037] T 4103d35b4ec0416a922bfe6fb0350b79 P 936d4bcf12614852a0aede9ed99863a0 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:34.374855 25668 raft_consensus.cc:3037] T 4103d35b4ec0416a922bfe6fb0350b79 P 89b1294014344834957f89fad6b58def [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:34.375694 25455 raft_consensus.cc:2454] T 4103d35b4ec0416a922bfe6fb0350b79 P 936d4bcf12614852a0aede9ed99863a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 407ddbed1bf8493fa6677df269ca521c in term 1.
I20260805 22:47:34.375694 25668 raft_consensus.cc:2454] T 4103d35b4ec0416a922bfe6fb0350b79 P 89b1294014344834957f89fad6b58def [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 407ddbed1bf8493fa6677df269ca521c in term 1.
I20260805 22:47:34.375921 25779 leader_election.cc:302] T 4103d35b4ec0416a922bfe6fb0350b79 P 407ddbed1bf8493fa6677df269ca521c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 407ddbed1bf8493fa6677df269ca521c, 89b1294014344834957f89fad6b58def; no voters:
I20260805 22:47:34.376029 26133 raft_consensus.cc:2781] T 4103d35b4ec0416a922bfe6fb0350b79 P 407ddbed1bf8493fa6677df269ca521c [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:47:34.376194 26133 raft_consensus.cc:686] T 4103d35b4ec0416a922bfe6fb0350b79 P 407ddbed1bf8493fa6677df269ca521c [term 1 LEADER]: Becoming Leader. State: Replica: 407ddbed1bf8493fa6677df269ca521c, State: Running, Role: LEADER
I20260805 22:47:34.376243 26133 consensus_queue.cc:237] T 4103d35b4ec0416a922bfe6fb0350b79 P 407ddbed1bf8493fa6677df269ca521c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "407ddbed1bf8493fa6677df269ca521c" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 41917 } } peers { permanent_uuid: "89b1294014344834957f89fad6b58def" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40547 } } peers { permanent_uuid: "936d4bcf12614852a0aede9ed99863a0" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42859 } }
I20260805 22:47:34.376613 26092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:34.376485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42399 (local address 127.14.224.131:60835)
0805 22:47:34.376538 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:34.376581 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:42399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260805 22:47:34.377110 24977 catalog_manager.cc:5495] T 4103d35b4ec0416a922bfe6fb0350b79 P 407ddbed1bf8493fa6677df269ca521c reported cstate change: term changed from 0 to 1, leader changed from <none> to 407ddbed1bf8493fa6677df269ca521c (127.14.224.131). New cstate: current_term: 1 leader_uuid: "407ddbed1bf8493fa6677df269ca521c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "407ddbed1bf8493fa6677df269ca521c" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 41917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89b1294014344834957f89fad6b58def" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "936d4bcf12614852a0aede9ed99863a0" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42859 } health_report { overall_health: UNKNOWN } } }
W20260805 22:47:34.379978 25529 tablet.cc:2369] T 4103d35b4ec0416a922bfe6fb0350b79 P 936d4bcf12614852a0aede9ed99863a0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:47:34.414063 26112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:34.411919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39258 (local address 127.14.224.131:41917)
0805 22:47:34.411982 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:34.411984 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:34.412027 (+ 43us) server_negotiation.cc:407] Connection header received
0805 22:47:34.412089 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:34.412090 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:34.412100 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:34.412144 (+ 44us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:47:34.412260 (+ 116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:34.412778 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:34.413538 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:34.413734 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:34.413778 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:34.413868 (+ 90us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:47:34.413893 (+ 25us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:47:34.413924 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:34.413966 (+ 42us) server_negotiation.cc:299] Negotiation successful
0805 22:47:34.413984 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260805 22:47:34.415045 25668 raft_consensus.cc:1261] T 4103d35b4ec0416a922bfe6fb0350b79 P 89b1294014344834957f89fad6b58def [term 1 FOLLOWER]: Refusing update from remote peer 407ddbed1bf8493fa6677df269ca521c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:47:34.415063 25455 raft_consensus.cc:1261] T 4103d35b4ec0416a922bfe6fb0350b79 P 936d4bcf12614852a0aede9ed99863a0 [term 1 FOLLOWER]: Refusing update from remote peer 407ddbed1bf8493fa6677df269ca521c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:47:34.415337 26138 consensus_queue.cc:1035] T 4103d35b4ec0416a922bfe6fb0350b79 P 407ddbed1bf8493fa6677df269ca521c [LEADER]: Connected to new peer: Peer: permanent_uuid: "89b1294014344834957f89fad6b58def" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:47:34.415472 26133 consensus_queue.cc:1035] T 4103d35b4ec0416a922bfe6fb0350b79 P 407ddbed1bf8493fa6677df269ca521c [LEADER]: Connected to new peer: Peer: permanent_uuid: "936d4bcf12614852a0aede9ed99863a0" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 42859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:47:34.416019 25743 heartbeater.cc:503] Master 127.14.224.189:44253 was elected leader, sending a full tablet report...
I20260805 22:47:34.416250 26093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:34.416015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42399 (local address 127.14.224.129:40821)
0805 22:47:34.416160 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:34.416216 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:42399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126}
I20260805 22:47:34.416355 26091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:34.416260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42399 (local address 127.14.224.130:53929)
0805 22:47:34.416300 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:34.416328 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:42399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260805 22:47:34.417373 26143 mvcc.cc:205] Tried to move back new op lower bound from 7315333342882041856 to 7315333342725627904. Current Snapshot: MvccSnapshot[applied={T|T < 7315333342882041856}]
I20260805 22:47:34.417610 26092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:34.417362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42399 (local address 127.14.224.131:34651)
0805 22:47:34.417534 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:34.417567 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:42399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152}
I20260805 22:47:34.418087 26093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:34.417972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42399 (local address 127.14.224.129:52287)
0805 22:47:34.418022 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:34.418054 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:42399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260805 22:47:34.418080 26146 mvcc.cc:205] Tried to move back new op lower bound from 7315333342882041856 to 7315333342725627904. Current Snapshot: MvccSnapshot[applied={T|T < 7315333342882041856}]
I20260805 22:47:34.418303 26091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:34.417899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42399 (local address 127.14.224.130:47793)
0805 22:47:34.418246 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:34.418276 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:42399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":329}
I20260805 22:47:34.419865 24977 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57736:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:47:34.419953 24977 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57736:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:47:34.421320 24977 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 233a2c69697b4b168b656c682271145c: Sending DeleteTablet for 3 replicas of tablet 4103d35b4ec0416a922bfe6fb0350b79
I20260805 22:47:34.421710 25856 tablet_service.cc:1514] Processing DeleteTablet for tablet 4103d35b4ec0416a922bfe6fb0350b79 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:47:34 UTC) from {username='oryx', principal='oryx/127.14.224.189@KRBTEST.COM'} at 127.0.0.1:39246
I20260805 22:47:34.421753 25638 tablet_service.cc:1514] Processing DeleteTablet for tablet 4103d35b4ec0416a922bfe6fb0350b79 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:47:34 UTC) from {username='oryx', principal='oryx/127.14.224.189@KRBTEST.COM'} at 127.0.0.1:51758
I20260805 22:47:34.421860 25425 tablet_service.cc:1514] Processing DeleteTablet for tablet 4103d35b4ec0416a922bfe6fb0350b79 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:47:34 UTC) from {username='oryx', principal='oryx/127.14.224.189@KRBTEST.COM'} at 127.0.0.1:46654
I20260805 22:47:34.421967 26156 tablet_replica.cc:330] T 4103d35b4ec0416a922bfe6fb0350b79 P 407ddbed1bf8493fa6677df269ca521c: stopping tablet replica
I20260805 22:47:34.422158 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 25199
I20260805 22:47:34.422057 26156 raft_consensus.cc:2229] T 4103d35b4ec0416a922bfe6fb0350b79 P 407ddbed1bf8493fa6677df269ca521c [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:47:34.442863 26156 raft_consensus.cc:2258] T 4103d35b4ec0416a922bfe6fb0350b79 P 407ddbed1bf8493fa6677df269ca521c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:47:34.443041 26158 tablet_replica.cc:330] T 4103d35b4ec0416a922bfe6fb0350b79 P 89b1294014344834957f89fad6b58def: stopping tablet replica
I20260805 22:47:34.443111 26158 raft_consensus.cc:2229] T 4103d35b4ec0416a922bfe6fb0350b79 P 89b1294014344834957f89fad6b58def [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:47:34.443152 26158 raft_consensus.cc:2258] T 4103d35b4ec0416a922bfe6fb0350b79 P 89b1294014344834957f89fad6b58def [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:47:34.446833 26156 ts_tablet_manager.cc:1905] T 4103d35b4ec0416a922bfe6fb0350b79 P 407ddbed1bf8493fa6677df269ca521c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:47:34.448154 26158 ts_tablet_manager.cc:1905] T 4103d35b4ec0416a922bfe6fb0350b79 P 89b1294014344834957f89fad6b58def: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:47:34.449124 26156 ts_tablet_manager.cc:1918] T 4103d35b4ec0416a922bfe6fb0350b79 P 407ddbed1bf8493fa6677df269ca521c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:47:34.449200 26156 log.cc:1196] T 4103d35b4ec0416a922bfe6fb0350b79 P 407ddbed1bf8493fa6677df269ca521c: Deleting WAL directory at /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-2/wal/wals/4103d35b4ec0416a922bfe6fb0350b79
I20260805 22:47:34.449456 26156 ts_tablet_manager.cc:1939] T 4103d35b4ec0416a922bfe6fb0350b79 P 407ddbed1bf8493fa6677df269ca521c: Deleting consensus metadata
I20260805 22:47:34.449451 26158 ts_tablet_manager.cc:1918] T 4103d35b4ec0416a922bfe6fb0350b79 P 89b1294014344834957f89fad6b58def: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:47:34.449517 26158 log.cc:1196] T 4103d35b4ec0416a922bfe6fb0350b79 P 89b1294014344834957f89fad6b58def: Deleting WAL directory at /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970021300824-15234-0/minicluster-data/ts-1/wal/wals/4103d35b4ec0416a922bfe6fb0350b79
I20260805 22:47:34.449726 26158 ts_tablet_manager.cc:1939] T 4103d35b4ec0416a922bfe6fb0350b79 P 89b1294014344834957f89fad6b58def: Deleting consensus metadata
I20260805 22:47:34.449883 24954 catalog_manager.cc:4841] TS 407ddbed1bf8493fa6677df269ca521c (127.14.224.131:41917): tablet 4103d35b4ec0416a922bfe6fb0350b79 (table test-table [id=0edd98e339a14cc0b3b60f3a7199eefb]) successfully deleted
I20260805 22:47:34.450433 24954 catalog_manager.cc:4841] TS 89b1294014344834957f89fad6b58def (127.14.224.130:40547): tablet 4103d35b4ec0416a922bfe6fb0350b79 (table test-table [id=0edd98e339a14cc0b3b60f3a7199eefb]) successfully deleted
I20260805 22:47:34.452680 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 25534
I20260805 22:47:34.452728 26113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:34.452610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.129:42859 (local address 127.0.0.1:46656)
0805 22:47:34.452664 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:34.452694 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.129:42859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260805 22:47:34.457499 24958 catalog_manager.cc:4584] TS 936d4bcf12614852a0aede9ed99863a0 (127.14.224.129:42859): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4103d35b4ec0416a922bfe6fb0350b79: Network error: Client connection negotiation failed: client connection to 127.14.224.129:42859: connect: Connection refused (error 111)
I20260805 22:47:34.461400 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 25749
I20260805 22:47:34.473948 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 24778
I20260805 22:47:34.487076 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 25053
2026-08-05T22:47:34Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (6520 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:47:34 dist-test-slave-gjrz krb5kdc[26163](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:47:34 dist-test-slave-gjrz krb5kdc[26163](info): set up 2 sockets
Aug 05 22:47:34 dist-test-slave-gjrz krb5kdc[26163](info): commencing operation
krb5kdc: starting...
W20260805 22:47:35.637113 15234 mini_kdc.cc:121] Time spent starting KDC: real 1.120s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Aug 05 22:47:35 dist-test-slave-gjrz krb5kdc[26163](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970055, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:47:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:47:35Z Disabled control of system clock
WARNING: no policy specified for oryx/127.14.224.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.14.224.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.14.224.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/krb5kdc/oryx_127.14.224.190.keytab.
Entry for principal oryx/127.14.224.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/krb5kdc/oryx_127.14.224.190.keytab.
I20260805 22:47:35.766422 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:46777
--webserver_interface=127.14.224.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/krb5kdc/oryx_127.14.224.190.keytab
--principal=oryx/127.14.224.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:43695
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.224.190:46777
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:47:35.851168 26185 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:35.851470 26185 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:35.851507 26185 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:35.852808 26185 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:47:35.852870 26185 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260805 22:47:35.852887 26185 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:35.852905 26185 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:35.852921 26185 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:47:35.852937 26185 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:47:35.854650 26185 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:43695
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.224.190:46777
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/krb5kdc/oryx_127.14.224.190.keytab
--principal=oryx/127.14.224.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:46777
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.224.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26185
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:35.854935 26185 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:35.855159 26185 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:35.860121 26191 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:35.860157 26185 server_base.cc:1034] running on GCE node
W20260805 22:47:35.860121 26192 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:35.860121 26196 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:35.860698 26185 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:35.860980 26185 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:35.862124 26185 hybrid_clock.cc:648] HybridClock initialized: now 1785970055862107 us; error 29 us; skew 500 ppm
Aug 05 22:47:35 dist-test-slave-gjrz krb5kdc[26163](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970055, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.224.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:35.864703 26185 init.cc:377] Logged in from keytab as oryx/127.14.224.190@KRBTEST.COM (short username oryx)
I20260805 22:47:35.865190 26185 webserver.cc:460] Webserver started at http://127.14.224.190:34837/ using document root <none> and password file <none>
I20260805 22:47:35.865398 26185 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:35.865448 26185 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:35.865589 26185 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:35.866698 26185 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/master-0/data/instance:
uuid: "333128fd1e8147f594934b3f9a75e602"
format_stamp: "Formatted at 2026-08-05 22:47:35 on dist-test-slave-gjrz"
server_key: "36a8f9ea9155f3e60f702d76b9f2fc03"
server_key_iv: "c83a7b7d4adb4237ab199675d3148c1d"
server_key_version: "encryptionkey@0"
I20260805 22:47:35.867059 26185 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/master-0/wal/instance:
uuid: "333128fd1e8147f594934b3f9a75e602"
format_stamp: "Formatted at 2026-08-05 22:47:35 on dist-test-slave-gjrz"
server_key: "36a8f9ea9155f3e60f702d76b9f2fc03"
server_key_iv: "c83a7b7d4adb4237ab199675d3148c1d"
server_key_version: "encryptionkey@0"
I20260805 22:47:35.868582 26185 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:47:35.869304 26208 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:35.869457 26185 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260805 22:47:35.869552 26185 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/master-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/master-0/wal
uuid: "333128fd1e8147f594934b3f9a75e602"
format_stamp: "Formatted at 2026-08-05 22:47:35 on dist-test-slave-gjrz"
server_key: "36a8f9ea9155f3e60f702d76b9f2fc03"
server_key_iv: "c83a7b7d4adb4237ab199675d3148c1d"
server_key_version: "encryptionkey@0"
I20260805 22:47:35.869623 26185 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:35.893498 26185 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:35.895888 26185 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:35.896047 26185 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:35.900790 26185 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.190:46777
I20260805 22:47:35.900841 26294 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.190:46777 every 8 connection(s)
I20260805 22:47:35.901201 26185 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
I20260805 22:47:35.901921 26295 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:35.902655 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 26185
I20260805 22:47:35.902741 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/master-0/wal/instance
I20260805 22:47:35.902917 15234 external_mini_cluster.cc:1428] Setting key 1c82d3c0bb7fd9cc255a075c93d8d629
I20260805 22:47:35.904937 26295 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 333128fd1e8147f594934b3f9a75e602: Bootstrap starting.
I20260805 22:47:35.905601 26295 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 333128fd1e8147f594934b3f9a75e602: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:35.905871 26295 log.cc:824] T 00000000000000000000000000000000 P 333128fd1e8147f594934b3f9a75e602: Log is configured to *not* fsync() on all Append() calls
I20260805 22:47:35.906603 26295 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 333128fd1e8147f594934b3f9a75e602: No bootstrap required, opened a new log
I20260805 22:47:35.908535 26295 raft_consensus.cc:348] T 00000000000000000000000000000000 P 333128fd1e8147f594934b3f9a75e602 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "333128fd1e8147f594934b3f9a75e602" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 46777 } }
I20260805 22:47:35.908702 26295 raft_consensus.cc:374] T 00000000000000000000000000000000 P 333128fd1e8147f594934b3f9a75e602 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:35.908735 26295 raft_consensus.cc:729] T 00000000000000000000000000000000 P 333128fd1e8147f594934b3f9a75e602 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 333128fd1e8147f594934b3f9a75e602, State: Initialized, Role: FOLLOWER
I20260805 22:47:35.908874 26295 consensus_queue.cc:260] T 00000000000000000000000000000000 P 333128fd1e8147f594934b3f9a75e602 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "333128fd1e8147f594934b3f9a75e602" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 46777 } }
I20260805 22:47:35.908957 26295 raft_consensus.cc:388] T 00000000000000000000000000000000 P 333128fd1e8147f594934b3f9a75e602 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:47:35.908998 26295 raft_consensus.cc:482] T 00000000000000000000000000000000 P 333128fd1e8147f594934b3f9a75e602 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:47:35.909046 26295 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 333128fd1e8147f594934b3f9a75e602 [term 0 FOLLOWER]: Advancing to term 1
Aug 05 22:47:35 dist-test-slave-gjrz krb5kdc[26163](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970055, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM
I20260805 22:47:35.909657 26295 raft_consensus.cc:504] T 00000000000000000000000000000000 P 333128fd1e8147f594934b3f9a75e602 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "333128fd1e8147f594934b3f9a75e602" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 46777 } }
I20260805 22:47:35.909765 26295 leader_election.cc:302] T 00000000000000000000000000000000 P 333128fd1e8147f594934b3f9a75e602 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 333128fd1e8147f594934b3f9a75e602; no voters:
I20260805 22:47:35.909960 26295 leader_election.cc:288] T 00000000000000000000000000000000 P 333128fd1e8147f594934b3f9a75e602 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:47:35.910008 26303 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 333128fd1e8147f594934b3f9a75e602 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:47:35.910144 26303 raft_consensus.cc:686] T 00000000000000000000000000000000 P 333128fd1e8147f594934b3f9a75e602 [term 1 LEADER]: Becoming Leader. State: Replica: 333128fd1e8147f594934b3f9a75e602, State: Running, Role: LEADER
I20260805 22:47:35.910252 26295 sys_catalog.cc:564] T 00000000000000000000000000000000 P 333128fd1e8147f594934b3f9a75e602 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:47:35.910245 26303 consensus_queue.cc:237] T 00000000000000000000000000000000 P 333128fd1e8147f594934b3f9a75e602 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "333128fd1e8147f594934b3f9a75e602" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 46777 } }
I20260805 22:47:35.910708 26305 sys_catalog.cc:455] T 00000000000000000000000000000000 P 333128fd1e8147f594934b3f9a75e602 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "333128fd1e8147f594934b3f9a75e602" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "333128fd1e8147f594934b3f9a75e602" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 46777 } } }
I20260805 22:47:35.910717 26304 sys_catalog.cc:455] T 00000000000000000000000000000000 P 333128fd1e8147f594934b3f9a75e602 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 333128fd1e8147f594934b3f9a75e602. Latest consensus state: current_term: 1 leader_uuid: "333128fd1e8147f594934b3f9a75e602" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "333128fd1e8147f594934b3f9a75e602" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 46777 } } }
I20260805 22:47:35.910869 26304 sys_catalog.cc:458] T 00000000000000000000000000000000 P 333128fd1e8147f594934b3f9a75e602 [sys.catalog]: This master's current role is: LEADER
I20260805 22:47:35.911099 26312 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:47:35.911104 26305 sys_catalog.cc:458] T 00000000000000000000000000000000 P 333128fd1e8147f594934b3f9a75e602 [sys.catalog]: This master's current role is: LEADER
I20260805 22:47:35.911873 26312 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:47:35.913753 26312 catalog_manager.cc:1347] Generated new cluster ID: 948c113d9b2d4e28b1adc9e3ca6c4e20
I20260805 22:47:35.913810 26312 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:47:35.915660 26299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:35.903502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43386 (local address 127.14.224.190:46777)
0805 22:47:35.903712 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:35.903720 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:35.903749 (+ 29us) server_negotiation.cc:407] Connection header received
0805 22:47:35.904199 (+ 450us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:35.904206 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:35.904259 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:35.904390 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:35.905044 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:35.906225 (+ 1181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:35.907036 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:35.907520 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:35.907626 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:35.910013 (+ 2387us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:35.910018 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:35.910019 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:35.910034 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:35.913772 (+ 3738us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:35.914301 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:35.914304 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:35.914304 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:35.914421 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:35.914641 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:35.914641 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:35.914642 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:35.914944 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:35.915119 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:35.915259 (+ 140us) server_negotiation.cc:299] Negotiation successful
0805 22:47:35.915437 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":91,"threads_started":1}
I20260805 22:47:35.925616 26312 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:47:35.926195 26312 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:47:35.930316 26312 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 333128fd1e8147f594934b3f9a75e602: Generated new TSK 0
I20260805 22:47:35.930523 26312 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.14.224.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.14.224.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.14.224.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/krb5kdc/oryx_127.14.224.129.keytab.
Entry for principal oryx/127.14.224.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/krb5kdc/oryx_127.14.224.129.keytab.
I20260805 22:47:35.966858 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.129:0
--local_ip_for_outbound_sockets=127.14.224.129
--webserver_interface=127.14.224.129
--webserver_port=0
--tserver_master_addrs=127.14.224.190:46777
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/krb5kdc/oryx_127.14.224.129.keytab
--principal=oryx/127.14.224.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:43695
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:47:36.072788 26339 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:36.073021 26339 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:36.073052 26339 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:36.074402 26339 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:36.074462 26339 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:36.074484 26339 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260805 22:47:36.074501 26339 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.129
I20260805 22:47:36.076191 26339 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:43695
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/krb5kdc/oryx_127.14.224.129.keytab
--principal=oryx/127.14.224.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.224.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.14.224.190:46777
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26339
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.129
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:36.076417 26339 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:36.076627 26339 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:36.081826 26345 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:36.081840 26349 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:36.081859 26346 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:36.082019 26339 server_base.cc:1034] running on GCE node
I20260805 22:47:36.082440 26339 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:36.082741 26339 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:36.083904 26339 hybrid_clock.cc:648] HybridClock initialized: now 1785970056083882 us; error 39 us; skew 500 ppm
Aug 05 22:47:36 dist-test-slave-gjrz krb5kdc[26163](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970056, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.224.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:36.086611 26339 init.cc:377] Logged in from keytab as oryx/127.14.224.129@KRBTEST.COM (short username oryx)
I20260805 22:47:36.087069 26339 webserver.cc:460] Webserver started at http://127.14.224.129:45737/ using document root <none> and password file <none>
I20260805 22:47:36.087348 26339 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:36.087411 26339 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:36.087551 26339 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:36.088660 26339 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/ts-0/data/instance:
uuid: "6dcd990050744d38a34e0f692272c33c"
format_stamp: "Formatted at 2026-08-05 22:47:36 on dist-test-slave-gjrz"
server_key: "78f98b24db0bbd1ff295a049719e3256"
server_key_iv: "3d5f26ab66a8db84a4345fbd1cd60764"
server_key_version: "encryptionkey@0"
I20260805 22:47:36.089010 26339 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/ts-0/wal/instance:
uuid: "6dcd990050744d38a34e0f692272c33c"
format_stamp: "Formatted at 2026-08-05 22:47:36 on dist-test-slave-gjrz"
server_key: "78f98b24db0bbd1ff295a049719e3256"
server_key_iv: "3d5f26ab66a8db84a4345fbd1cd60764"
server_key_version: "encryptionkey@0"
I20260805 22:47:36.090386 26339 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260805 22:47:36.091164 26360 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:36.091410 26339 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:47:36.091496 26339 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/ts-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/ts-0/wal
uuid: "6dcd990050744d38a34e0f692272c33c"
format_stamp: "Formatted at 2026-08-05 22:47:36 on dist-test-slave-gjrz"
server_key: "78f98b24db0bbd1ff295a049719e3256"
server_key_iv: "3d5f26ab66a8db84a4345fbd1cd60764"
server_key_version: "encryptionkey@0"
I20260805 22:47:36.091572 26339 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:36.111032 26339 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:36.113241 26339 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:36.113366 26339 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:36.113934 26339 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:47:36.113979 26339 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:36.114012 26339 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:47:36.114029 26339 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:36.120882 26339 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.129:43355
Aug 05 22:47:36 dist-test-slave-gjrz krb5kdc[26163](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970056, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.224.129@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM
I20260805 22:47:36.121038 26529 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.129:43355 every 8 connection(s)
I20260805 22:47:36.121304 26339 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
I20260805 22:47:36.123981 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 26339
I20260805 22:47:36.124090 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/ts-0/wal/instance
I20260805 22:47:36.124300 26299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:36.114435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.129:54857 (local address 127.14.224.190:46777)
0805 22:47:36.114507 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:36.114510 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:36.114673 (+ 163us) server_negotiation.cc:407] Connection header received
0805 22:47:36.115234 (+ 561us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:36.115235 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:36.115248 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:36.115354 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:36.116183 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:36.116953 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:36.118525 (+ 1572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:36.118848 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:36.118923 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:36.121620 (+ 2697us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:36.121622 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:36.121622 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:36.121632 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:36.122841 (+ 1209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:36.123311 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:36.123313 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:36.123314 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:36.123390 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:36.123624 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:36.123624 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:36.123624 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:36.123740 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:36.123826 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:36.124078 (+ 252us) server_negotiation.cc:299] Negotiation successful
0805 22:47:36.124197 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260805 22:47:36.124318 15234 external_mini_cluster.cc:1428] Setting key 52d3a10ef1219735d8bf8a635bb4187c
I20260805 22:47:36.124367 26374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:36.114385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:46777 (local address 127.14.224.129:54857)
0805 22:47:36.114538 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:36.114581 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:36.115126 (+ 545us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:36.115418 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:36.115422 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:36.115764 (+ 342us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:36.116067 (+ 303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:36.116075 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:36.117059 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:36.117061 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:36.118398 (+ 1337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:36.118403 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:36.118939 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:36.118940 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:36.119071 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:36.119632 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:36.119645 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:36.121492 (+ 1847us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:36.122919 (+ 1427us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:36.122925 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:36.122927 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:36.123158 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:36.123453 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:36.123454 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:36.123454 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:36.123572 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:36.123810 (+ 238us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:36.123813 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:36.123932 (+ 119us) client_negotiation.cc:769] Sending connection context
0805 22:47:36.124009 (+ 77us) client_negotiation.cc:240] Negotiation successful
0805 22:47:36.124187 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":83,"threads_started":1}
I20260805 22:47:36.124883 26530 heartbeater.cc:347] Connected to a master server at 127.14.224.190:46777
I20260805 22:47:36.124981 26530 heartbeater.cc:464] Registering TS with master...
I20260805 22:47:36.125180 26530 heartbeater.cc:511] Master 127.14.224.190:46777 requested a full tablet report, sending...
I20260805 22:47:36.125737 26231 ts_manager.cc:194] Registered new tserver with Master: 6dcd990050744d38a34e0f692272c33c (127.14.224.129:43355)
I20260805 22:47:36.126513 26231 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.14.224.129@KRBTEST.COM'} at 127.14.224.129:54857
I20260805 22:47:36.132031 26299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:36.126701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.129:37771 (local address 127.14.224.190:46777)
0805 22:47:36.126749 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:36.126751 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:36.126759 (+ 8us) server_negotiation.cc:407] Connection header received
0805 22:47:36.126780 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:36.126781 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:36.126790 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:36.126846 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:36.127247 (+ 401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:36.127752 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:36.128416 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:36.128624 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:36.128681 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:36.129677 (+ 996us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:36.129679 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:36.129679 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:36.129687 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:36.130933 (+ 1246us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:36.131259 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:36.131282 (+ 23us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:36.131282 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:36.131341 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:36.131517 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:36.131519 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:36.131519 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:36.131638 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:36.131699 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:36.131840 (+ 141us) server_negotiation.cc:299] Negotiation successful
0805 22:47:36.131930 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260805 22:47:36.132053 26538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:36.126016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:46777 (local address 127.14.224.129:37771)
0805 22:47:36.126176 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:36.126188 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:36.126241 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:36.126894 (+ 653us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:36.126895 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:36.127086 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:36.127168 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:36.127169 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:36.127842 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:36.127843 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:36.128343 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:36.128344 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:36.128685 (+ 341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:36.128686 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:36.128749 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:36.129270 (+ 521us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:36.129276 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:36.129591 (+ 315us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:36.131015 (+ 1424us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:36.131016 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:36.131016 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:36.131195 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:36.131399 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:36.131400 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:36.131401 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:36.131465 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:36.131697 (+ 232us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:36.131699 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:36.131751 (+ 52us) client_negotiation.cc:769] Sending connection context
0805 22:47:36.131811 (+ 60us) client_negotiation.cc:240] Negotiation successful
0805 22:47:36.131932 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":86,"threads_started":1}
WARNING: no policy specified for oryx/127.14.224.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.14.224.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.14.224.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/krb5kdc/oryx_127.14.224.130.keytab.
Entry for principal oryx/127.14.224.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/krb5kdc/oryx_127.14.224.130.keytab.
I20260805 22:47:36.155321 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.130:0
--local_ip_for_outbound_sockets=127.14.224.130
--webserver_interface=127.14.224.130
--webserver_port=0
--tserver_master_addrs=127.14.224.190:46777
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/krb5kdc/oryx_127.14.224.130.keytab
--principal=oryx/127.14.224.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:43695
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:47:36.239461 26542 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:36.239679 26542 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:36.239704 26542 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:36.240831 26542 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:36.240866 26542 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:36.240886 26542 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260805 22:47:36.240902 26542 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.130
I20260805 22:47:36.242406 26542 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:43695
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/krb5kdc/oryx_127.14.224.130.keytab
--principal=oryx/127.14.224.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.224.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.14.224.190:46777
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26542
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.130
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:36.242604 26542 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:36.242785 26542 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:36.247627 26550 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:36.247653 26549 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:36.247747 26542 server_base.cc:1034] running on GCE node
W20260805 22:47:36.247625 26552 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:36.248034 26542 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:36.248322 26542 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:36.249493 26542 hybrid_clock.cc:648] HybridClock initialized: now 1785970056249472 us; error 34 us; skew 500 ppm
Aug 05 22:47:36 dist-test-slave-gjrz krb5kdc[26163](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970056, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.224.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:36.252120 26542 init.cc:377] Logged in from keytab as oryx/127.14.224.130@KRBTEST.COM (short username oryx)
I20260805 22:47:36.252581 26542 webserver.cc:460] Webserver started at http://127.14.224.130:39893/ using document root <none> and password file <none>
I20260805 22:47:36.252789 26542 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:36.252837 26542 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:36.252972 26542 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:36.254057 26542 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/ts-1/data/instance:
uuid: "5efee7222d70430aab8d04cd1b357e8a"
format_stamp: "Formatted at 2026-08-05 22:47:36 on dist-test-slave-gjrz"
server_key: "ba35d492355356c4fb210e24f15b3102"
server_key_iv: "27d947efedbadc1958b2fd62a2b8ecb4"
server_key_version: "encryptionkey@0"
I20260805 22:47:36.254432 26542 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/ts-1/wal/instance:
uuid: "5efee7222d70430aab8d04cd1b357e8a"
format_stamp: "Formatted at 2026-08-05 22:47:36 on dist-test-slave-gjrz"
server_key: "ba35d492355356c4fb210e24f15b3102"
server_key_iv: "27d947efedbadc1958b2fd62a2b8ecb4"
server_key_version: "encryptionkey@0"
I20260805 22:47:36.255833 26542 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260805 22:47:36.256592 26561 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:36.256778 26542 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260805 22:47:36.256879 26542 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/ts-1/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/ts-1/wal
uuid: "5efee7222d70430aab8d04cd1b357e8a"
format_stamp: "Formatted at 2026-08-05 22:47:36 on dist-test-slave-gjrz"
server_key: "ba35d492355356c4fb210e24f15b3102"
server_key_iv: "27d947efedbadc1958b2fd62a2b8ecb4"
server_key_version: "encryptionkey@0"
I20260805 22:47:36.256946 26542 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:36.297010 26542 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:36.299320 26542 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:36.299444 26542 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:36.299932 26542 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:47:36.299978 26542 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:36.300002 26542 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:47:36.300014 26542 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 05 22:47:36 dist-test-slave-gjrz krb5kdc[26163](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970056, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.224.130@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM
I20260805 22:47:36.306761 26542 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.130:39785
I20260805 22:47:36.306838 26730 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.130:39785 every 8 connection(s)
I20260805 22:47:36.307148 26542 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
I20260805 22:47:36.309783 26299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:36.300471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:34523 (local address 127.14.224.190:46777)
0805 22:47:36.300517 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:36.300519 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:36.300796 (+ 277us) server_negotiation.cc:407] Connection header received
0805 22:47:36.301413 (+ 617us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:36.301415 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:36.301427 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:36.301483 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:36.302459 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:36.303322 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:36.304473 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:36.304686 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:36.304745 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:36.307074 (+ 2329us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:36.307076 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:36.307076 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:36.307085 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:36.308481 (+ 1396us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:36.308865 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:36.308866 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:36.308866 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:36.308918 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:36.309188 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:36.309189 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:36.309190 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:36.309332 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:36.309405 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:36.309643 (+ 238us) server_negotiation.cc:299] Negotiation successful
0805 22:47:36.309714 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260805 22:47:36.309962 26574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:36.300458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:46777 (local address 127.14.224.130:34523)
0805 22:47:36.300654 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:36.300701 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:36.301275 (+ 574us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:36.301613 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:36.301618 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:36.302015 (+ 397us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:36.302338 (+ 323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:36.302346 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:36.303440 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:36.303441 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:36.304385 (+ 944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:36.304389 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:36.304768 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:36.304769 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:36.304906 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:36.305509 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:36.305519 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:36.306966 (+ 1447us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:36.308565 (+ 1599us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:36.308571 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:36.308573 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:36.308802 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:36.308964 (+ 162us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:36.308965 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:36.308965 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:36.309097 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:36.309396 (+ 299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:36.309399 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:36.309521 (+ 122us) client_negotiation.cc:769] Sending connection context
0805 22:47:36.309605 (+ 84us) client_negotiation.cc:240] Negotiation successful
0805 22:47:36.309750 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":96,"threads_started":1}
I20260805 22:47:36.310460 26732 heartbeater.cc:347] Connected to a master server at 127.14.224.190:46777
I20260805 22:47:36.310555 26732 heartbeater.cc:464] Registering TS with master...
I20260805 22:47:36.310750 26732 heartbeater.cc:511] Master 127.14.224.190:46777 requested a full tablet report, sending...
I20260805 22:47:36.311192 26229 ts_manager.cc:194] Registered new tserver with Master: 5efee7222d70430aab8d04cd1b357e8a (127.14.224.130:39785)
I20260805 22:47:36.311712 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 26542
I20260805 22:47:36.311770 26229 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.14.224.130@KRBTEST.COM'} at 127.14.224.130:34523
I20260805 22:47:36.311825 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/ts-1/wal/instance
I20260805 22:47:36.312062 15234 external_mini_cluster.cc:1428] Setting key 901ffeb81f797ceed10b240edb711b28
I20260805 22:47:36.317803 26299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:36.311920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:58405 (local address 127.14.224.190:46777)
0805 22:47:36.311963 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:36.311964 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:36.311971 (+ 7us) server_negotiation.cc:407] Connection header received
0805 22:47:36.311988 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:36.311989 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:36.311997 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:36.312041 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:36.312470 (+ 429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:36.313047 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:36.313745 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:36.313945 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:36.314002 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:36.314992 (+ 990us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:36.314993 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:36.314994 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:36.315002 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:36.316412 (+ 1410us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:36.316850 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:36.316853 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:36.316853 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:36.316929 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:36.317171 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:36.317172 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:36.317172 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:36.317360 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:36.317425 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:36.317646 (+ 221us) server_negotiation.cc:299] Negotiation successful
0805 22:47:36.317732 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260805 22:47:36.317840 26740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:36.311583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:46777 (local address 127.14.224.130:58405)
0805 22:47:36.311750 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:36.311761 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:36.311818 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:36.312056 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:36.312057 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:36.312306 (+ 249us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:36.312368 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:36.312371 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:36.313161 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:36.313162 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:36.313663 (+ 501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:36.313664 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:36.314010 (+ 346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:36.314011 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:36.314078 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:36.314578 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:36.314583 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:36.314891 (+ 308us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:36.316514 (+ 1623us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:36.316515 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:36.316516 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:36.316742 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:36.317004 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:36.317005 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:36.317006 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:36.317079 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:36.317439 (+ 360us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:36.317440 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:36.317504 (+ 64us) client_negotiation.cc:769] Sending connection context
0805 22:47:36.317588 (+ 84us) client_negotiation.cc:240] Negotiation successful
0805 22:47:36.317720 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":101,"threads_started":1}
WARNING: no policy specified for oryx/127.14.224.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.14.224.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.14.224.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/krb5kdc/oryx_127.14.224.131.keytab.
Entry for principal oryx/127.14.224.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/krb5kdc/oryx_127.14.224.131.keytab.
I20260805 22:47:36.342519 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.131:0
--local_ip_for_outbound_sockets=127.14.224.131
--webserver_interface=127.14.224.131
--webserver_port=0
--tserver_master_addrs=127.14.224.190:46777
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/krb5kdc/oryx_127.14.224.131.keytab
--principal=oryx/127.14.224.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:43695
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:47:36.426765 26743 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:36.427003 26743 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:36.427037 26743 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:36.428432 26743 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:36.428489 26743 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:36.428520 26743 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260805 22:47:36.428546 26743 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.131
I20260805 22:47:36.430269 26743 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:43695
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/krb5kdc/oryx_127.14.224.131.keytab
--principal=oryx/127.14.224.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.224.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.14.224.190:46777
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26743
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.131
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:36.430558 26743 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:36.430814 26743 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:36.435921 26755 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:36.436055 26743 server_base.cc:1034] running on GCE node
W20260805 22:47:36.435954 26758 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:36.435985 26756 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:36.436363 26743 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:36.436599 26743 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:36.437764 26743 hybrid_clock.cc:648] HybridClock initialized: now 1785970056437742 us; error 39 us; skew 500 ppm
Aug 05 22:47:36 dist-test-slave-gjrz krb5kdc[26163](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970056, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.224.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:36.440407 26743 init.cc:377] Logged in from keytab as oryx/127.14.224.131@KRBTEST.COM (short username oryx)
I20260805 22:47:36.440900 26743 webserver.cc:460] Webserver started at http://127.14.224.131:44273/ using document root <none> and password file <none>
I20260805 22:47:36.441114 26743 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:36.441166 26743 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:36.441303 26743 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:36.442448 26743 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/ts-2/data/instance:
uuid: "7fd09b52184c425597059beece124998"
format_stamp: "Formatted at 2026-08-05 22:47:36 on dist-test-slave-gjrz"
server_key: "3023a0d1cc3c6becc6d99ca5cc1ba919"
server_key_iv: "a368f3b736e64bf8132a3ed30a649cd3"
server_key_version: "encryptionkey@0"
I20260805 22:47:36.442806 26743 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/ts-2/wal/instance:
uuid: "7fd09b52184c425597059beece124998"
format_stamp: "Formatted at 2026-08-05 22:47:36 on dist-test-slave-gjrz"
server_key: "3023a0d1cc3c6becc6d99ca5cc1ba919"
server_key_iv: "a368f3b736e64bf8132a3ed30a649cd3"
server_key_version: "encryptionkey@0"
I20260805 22:47:36.444406 26743 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260805 22:47:36.445209 26772 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:36.445370 26743 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260805 22:47:36.445482 26743 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/ts-2/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/ts-2/wal
uuid: "7fd09b52184c425597059beece124998"
format_stamp: "Formatted at 2026-08-05 22:47:36 on dist-test-slave-gjrz"
server_key: "3023a0d1cc3c6becc6d99ca5cc1ba919"
server_key_iv: "a368f3b736e64bf8132a3ed30a649cd3"
server_key_version: "encryptionkey@0"
I20260805 22:47:36.445559 26743 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:36.461323 26743 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:36.463230 26743 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:36.463389 26743 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:36.463943 26743 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:47:36.463986 26743 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:36.464010 26743 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:47:36.464022 26743 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 05 22:47:36 dist-test-slave-gjrz krb5kdc[26163](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970056, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.224.131@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM
I20260805 22:47:36.470722 26743 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.131:46871
I20260805 22:47:36.470808 26963 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.131:46871 every 8 connection(s)
I20260805 22:47:36.471095 26743 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
I20260805 22:47:36.473798 26299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:36.464478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:46451 (local address 127.14.224.190:46777)
0805 22:47:36.464534 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:36.464537 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:36.464777 (+ 240us) server_negotiation.cc:407] Connection header received
0805 22:47:36.465273 (+ 496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:36.465275 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:36.465290 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:36.465359 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:36.466206 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:36.466962 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:36.468152 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:36.468445 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:36.468520 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:36.470984 (+ 2464us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:36.470985 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:36.470986 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:36.470994 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:36.472433 (+ 1439us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:36.472814 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:36.472814 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:36.472815 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:36.472859 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:36.473106 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:36.473107 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:36.473108 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:36.473256 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:36.473316 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:36.473620 (+ 304us) server_negotiation.cc:299] Negotiation successful
0805 22:47:36.473706 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260805 22:47:36.473953 26788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:36.464486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:46777 (local address 127.14.224.131:46451)
0805 22:47:36.464647 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:36.464684 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:36.465166 (+ 482us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:36.465431 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:36.465435 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:36.465773 (+ 338us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:36.466101 (+ 328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:36.466109 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:36.467089 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:36.467090 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:36.468061 (+ 971us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:36.468064 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:36.468552 (+ 488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:36.468554 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:36.468714 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:36.469188 (+ 474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:36.469199 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:36.470900 (+ 1701us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:36.472500 (+ 1600us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:36.472506 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:36.472508 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:36.472755 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:36.472902 (+ 147us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:36.472903 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:36.472903 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:36.473022 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:36.473315 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:36.473322 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:36.473468 (+ 146us) client_negotiation.cc:769] Sending connection context
0805 22:47:36.473580 (+ 112us) client_negotiation.cc:240] Negotiation successful
0805 22:47:36.473742 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":87,"threads_started":1}
I20260805 22:47:36.474664 26964 heartbeater.cc:347] Connected to a master server at 127.14.224.190:46777
I20260805 22:47:36.474767 26964 heartbeater.cc:464] Registering TS with master...
I20260805 22:47:36.474983 26964 heartbeater.cc:511] Master 127.14.224.190:46777 requested a full tablet report, sending...
I20260805 22:47:36.475435 26229 ts_manager.cc:194] Registered new tserver with Master: 7fd09b52184c425597059beece124998 (127.14.224.131:46871)
I20260805 22:47:36.475941 26229 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.14.224.131@KRBTEST.COM'} at 127.14.224.131:46451
I20260805 22:47:36.478600 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 26743
I20260805 22:47:36.478703 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/ts-2/wal/instance
I20260805 22:47:36.478907 15234 external_mini_cluster.cc:1428] Setting key 1a098afbe61641c6ecf3b68fe6318333
I20260805 22:47:36.479859 15234 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 22:47:36.483397 26971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:36.476240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:46777 (local address 127.14.224.131:57553)
0805 22:47:36.476948 (+ 708us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:36.476959 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:36.477029 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:36.477154 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:36.477155 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:36.477376 (+ 221us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:36.477451 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:36.477454 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:36.478395 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:36.478397 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:36.479258 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:36.479284 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:36.479773 (+ 489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:36.479775 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:36.479847 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:36.480315 (+ 468us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:36.480321 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:36.480705 (+ 384us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:36.482441 (+ 1736us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:36.482442 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:36.482443 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:36.482618 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:36.482822 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:36.482823 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:36.482823 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:36.482871 (+ 48us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:36.483106 (+ 235us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:36.483106 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:36.483146 (+ 40us) client_negotiation.cc:769] Sending connection context
0805 22:47:36.483190 (+ 44us) client_negotiation.cc:240] Negotiation successful
0805 22:47:36.483311 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":684,"thread_start_us":66,"threads_started":1}
I20260805 22:47:36.483419 26299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:36.476314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:57553 (local address 127.14.224.190:46777)
0805 22:47:36.476357 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:36.476359 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:36.477027 (+ 668us) server_negotiation.cc:407] Connection header received
0805 22:47:36.477080 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:36.477081 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:36.477090 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:36.477141 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:36.477546 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:36.478268 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:36.479389 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:36.479696 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:36.479756 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:36.480792 (+ 1036us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:36.480794 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:36.480794 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:36.480801 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:36.482343 (+ 1542us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:36.482683 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:36.482685 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:36.482685 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:36.482757 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:36.482919 (+ 162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:36.482920 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:36.482920 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:36.483051 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:36.483115 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:36.483224 (+ 109us) server_negotiation.cc:299] Negotiation successful
0805 22:47:36.483328 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
Aug 05 22:47:36 dist-test-slave-gjrz krb5kdc[26163](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970056, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 05 22:47:36 dist-test-slave-gjrz krb5kdc[26163](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:47:36 dist-test-slave-gjrz krb5kdc[26163](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
W20260805 22:47:36.503605 26299 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:47:36.497867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43390 (local address 127.14.224.190:46777)
0805 22:47:36.497948 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:36.497950 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:36.497960 (+ 10us) server_negotiation.cc:407] Connection header received
0805 22:47:36.497987 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:36.497988 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:36.497999 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:36.498050 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:36.498697 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:36.499233 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:36.500023 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:36.500227 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:36.500287 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:36.503515 (+ 3228us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43390: BlockingRecv error: recv got EOF from 127.0.0.1:43390 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 05 22:47:36 dist-test-slave-gjrz krb5kdc[26163](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970056, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM
I20260805 22:47:36.511112 26299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:36.504568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43396 (local address 127.14.224.190:46777)
0805 22:47:36.504637 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:36.504639 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:36.504685 (+ 46us) server_negotiation.cc:407] Connection header received
0805 22:47:36.504733 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:36.504734 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:36.504743 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:36.504790 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:36.505247 (+ 457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:36.505740 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:36.506358 (+ 618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:36.506541 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:36.506587 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:36.508796 (+ 2209us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:36.508798 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:36.508798 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:36.508806 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:36.510055 (+ 1249us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:36.510452 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:36.510453 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:36.510453 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:36.510520 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:36.510666 (+ 146us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:36.510667 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:36.510667 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:36.510790 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:36.510874 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:36.510974 (+ 100us) server_negotiation.cc:299] Negotiation successful
0805 22:47:36.511036 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260805 22:47:36.512672 26229 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43396:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:47:36.514307 26229 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:47:36.520572 26997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:36.516748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56390 (local address 127.14.224.131:46871)
0805 22:47:36.516952 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:36.516957 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:36.516968 (+ 11us) server_negotiation.cc:407] Connection header received
0805 22:47:36.517088 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:36.517091 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:36.517110 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:36.517200 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:47:36.517363 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:36.518214 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:36.519376 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:36.520123 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:36.520220 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:36.520280 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:36.520421 (+ 141us) server_negotiation.cc:299] Negotiation successful
0805 22:47:36.520469 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":176,"thread_start_us":105,"threads_started":1}
I20260805 22:47:36.520569 26993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:36.516647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.131:46871 (local address 127.0.0.1:56390)
0805 22:47:36.516806 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:36.516859 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:36.516927 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:36.517203 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:36.517207 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:36.517209 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:47:36.517290 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:36.517292 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:36.518296 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:36.518297 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:36.519241 (+ 944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:36.519244 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:36.520208 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:36.520209 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:36.520308 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:36.520324 (+ 16us) client_negotiation.cc:769] Sending connection context
0805 22:47:36.520398 (+ 74us) client_negotiation.cc:240] Negotiation successful
0805 22:47:36.520448 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"mutex_wait_us":3,"thread_start_us":54,"threads_started":1}
I20260805 22:47:36.520947 26995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:36.516653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.130:39785 (local address 127.0.0.1:52512)
0805 22:47:36.517015 (+ 362us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:36.517025 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:36.517067 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:36.517545 (+ 478us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:36.517546 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:36.517548 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:47:36.517600 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:36.517601 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:36.518529 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:36.518529 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:36.519748 (+ 1219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:36.519749 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:36.520703 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:36.520704 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:36.520776 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:36.520780 (+ 4us) client_negotiation.cc:769] Sending connection context
0805 22:47:36.520831 (+ 51us) client_negotiation.cc:240] Negotiation successful
0805 22:47:36.520871 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":344,"thread_start_us":110,"threads_started":1}
I20260805 22:47:36.521003 27000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:36.517139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52512 (local address 127.14.224.130:39785)
0805 22:47:36.517320 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:36.517325 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:36.517334 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:47:36.517369 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:36.517371 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:36.517384 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:36.517480 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:47:36.517668 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:36.518436 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:36.519824 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:36.520524 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:36.520609 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:36.520662 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:36.520855 (+ 193us) server_negotiation.cc:299] Negotiation successful
0805 22:47:36.520899 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":81,"threads_started":1}
I20260805 22:47:36.521667 26633 tablet_service.cc:1467] Processing CreateTablet for tablet e671b734b4ca4ec09a253eabbcf6fa68 (DEFAULT_TABLE table=test-table [id=c3d7d7e0b63843a6b115f09fba1b3295]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:47:36.521667 26852 tablet_service.cc:1467] Processing CreateTablet for tablet e671b734b4ca4ec09a253eabbcf6fa68 (DEFAULT_TABLE table=test-table [id=c3d7d7e0b63843a6b115f09fba1b3295]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:47:36.522099 26633 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e671b734b4ca4ec09a253eabbcf6fa68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:36.522095 26852 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e671b734b4ca4ec09a253eabbcf6fa68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:36.523927 26996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:36.516655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.129:43355 (local address 127.0.0.1:49956)
0805 22:47:36.517133 (+ 478us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:36.517141 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:36.517179 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:36.518298 (+ 1119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:36.518298 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:36.518301 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:47:36.518378 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:36.518379 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:36.519698 (+ 1319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:36.519699 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:36.520552 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:36.520555 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:36.523673 (+ 3118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:36.523674 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:36.523748 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:36.523754 (+ 6us) client_negotiation.cc:769] Sending connection context
0805 22:47:36.523807 (+ 53us) client_negotiation.cc:240] Negotiation successful
0805 22:47:36.523852 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":464,"mutex_wait_us":19,"thread_start_us":107,"threads_started":1}
I20260805 22:47:36.523957 26999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:36.516934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49956 (local address 127.14.224.129:43355)
0805 22:47:36.517137 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:36.517141 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:36.517226 (+ 85us) server_negotiation.cc:407] Connection header received
0805 22:47:36.517265 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:36.517268 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:36.517282 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:36.517357 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:47:36.518460 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:36.519608 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:36.520645 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:36.523588 (+ 2943us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:36.523679 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:36.523739 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:36.523824 (+ 85us) server_negotiation.cc:299] Negotiation successful
0805 22:47:36.523861 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":96,"threads_started":1}
I20260805 22:47:36.524780 26428 tablet_service.cc:1467] Processing CreateTablet for tablet e671b734b4ca4ec09a253eabbcf6fa68 (DEFAULT_TABLE table=test-table [id=c3d7d7e0b63843a6b115f09fba1b3295]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:47:36.525169 26428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e671b734b4ca4ec09a253eabbcf6fa68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:36.526135 27004 tablet_bootstrap.cc:492] T e671b734b4ca4ec09a253eabbcf6fa68 P 7fd09b52184c425597059beece124998: Bootstrap starting.
I20260805 22:47:36.526304 27005 tablet_bootstrap.cc:492] T e671b734b4ca4ec09a253eabbcf6fa68 P 5efee7222d70430aab8d04cd1b357e8a: Bootstrap starting.
I20260805 22:47:36.526844 27005 tablet_bootstrap.cc:654] T e671b734b4ca4ec09a253eabbcf6fa68 P 5efee7222d70430aab8d04cd1b357e8a: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:36.526847 27004 tablet_bootstrap.cc:654] T e671b734b4ca4ec09a253eabbcf6fa68 P 7fd09b52184c425597059beece124998: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:36.527082 27005 log.cc:824] T e671b734b4ca4ec09a253eabbcf6fa68 P 5efee7222d70430aab8d04cd1b357e8a: Log is configured to *not* fsync() on all Append() calls
I20260805 22:47:36.527169 27004 log.cc:824] T e671b734b4ca4ec09a253eabbcf6fa68 P 7fd09b52184c425597059beece124998: Log is configured to *not* fsync() on all Append() calls
I20260805 22:47:36.527967 27005 tablet_bootstrap.cc:492] T e671b734b4ca4ec09a253eabbcf6fa68 P 5efee7222d70430aab8d04cd1b357e8a: No bootstrap required, opened a new log
I20260805 22:47:36.528057 27005 ts_tablet_manager.cc:1397] T e671b734b4ca4ec09a253eabbcf6fa68 P 5efee7222d70430aab8d04cd1b357e8a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260805 22:47:36.528997 27011 tablet_bootstrap.cc:492] T e671b734b4ca4ec09a253eabbcf6fa68 P 6dcd990050744d38a34e0f692272c33c: Bootstrap starting.
I20260805 22:47:36.529562 27011 tablet_bootstrap.cc:654] T e671b734b4ca4ec09a253eabbcf6fa68 P 6dcd990050744d38a34e0f692272c33c: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:36.529834 27011 log.cc:824] T e671b734b4ca4ec09a253eabbcf6fa68 P 6dcd990050744d38a34e0f692272c33c: Log is configured to *not* fsync() on all Append() calls
I20260805 22:47:36.529866 27005 raft_consensus.cc:348] T e671b734b4ca4ec09a253eabbcf6fa68 P 5efee7222d70430aab8d04cd1b357e8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fd09b52184c425597059beece124998" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46871 } } peers { permanent_uuid: "5efee7222d70430aab8d04cd1b357e8a" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 39785 } } peers { permanent_uuid: "6dcd990050744d38a34e0f692272c33c" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 43355 } }
I20260805 22:47:36.530027 27005 raft_consensus.cc:374] T e671b734b4ca4ec09a253eabbcf6fa68 P 5efee7222d70430aab8d04cd1b357e8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:36.530074 27005 raft_consensus.cc:729] T e671b734b4ca4ec09a253eabbcf6fa68 P 5efee7222d70430aab8d04cd1b357e8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5efee7222d70430aab8d04cd1b357e8a, State: Initialized, Role: FOLLOWER
I20260805 22:47:36.530198 27005 consensus_queue.cc:260] T e671b734b4ca4ec09a253eabbcf6fa68 P 5efee7222d70430aab8d04cd1b357e8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fd09b52184c425597059beece124998" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46871 } } peers { permanent_uuid: "5efee7222d70430aab8d04cd1b357e8a" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 39785 } } peers { permanent_uuid: "6dcd990050744d38a34e0f692272c33c" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 43355 } }
I20260805 22:47:36.530494 27005 ts_tablet_manager.cc:1428] T e671b734b4ca4ec09a253eabbcf6fa68 P 5efee7222d70430aab8d04cd1b357e8a: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260805 22:47:36.530503 26732 heartbeater.cc:503] Master 127.14.224.190:46777 was elected leader, sending a full tablet report...
I20260805 22:47:36.530632 27011 tablet_bootstrap.cc:492] T e671b734b4ca4ec09a253eabbcf6fa68 P 6dcd990050744d38a34e0f692272c33c: No bootstrap required, opened a new log
I20260805 22:47:36.530699 27011 ts_tablet_manager.cc:1397] T e671b734b4ca4ec09a253eabbcf6fa68 P 6dcd990050744d38a34e0f692272c33c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260805 22:47:36.531023 27004 tablet_bootstrap.cc:492] T e671b734b4ca4ec09a253eabbcf6fa68 P 7fd09b52184c425597059beece124998: No bootstrap required, opened a new log
I20260805 22:47:36.531100 27004 ts_tablet_manager.cc:1397] T e671b734b4ca4ec09a253eabbcf6fa68 P 7fd09b52184c425597059beece124998: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20260805 22:47:36.532694 27011 raft_consensus.cc:348] T e671b734b4ca4ec09a253eabbcf6fa68 P 6dcd990050744d38a34e0f692272c33c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fd09b52184c425597059beece124998" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46871 } } peers { permanent_uuid: "5efee7222d70430aab8d04cd1b357e8a" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 39785 } } peers { permanent_uuid: "6dcd990050744d38a34e0f692272c33c" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 43355 } }
I20260805 22:47:36.532873 27011 raft_consensus.cc:374] T e671b734b4ca4ec09a253eabbcf6fa68 P 6dcd990050744d38a34e0f692272c33c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:36.532907 27011 raft_consensus.cc:729] T e671b734b4ca4ec09a253eabbcf6fa68 P 6dcd990050744d38a34e0f692272c33c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6dcd990050744d38a34e0f692272c33c, State: Initialized, Role: FOLLOWER
I20260805 22:47:36.533037 27011 consensus_queue.cc:260] T e671b734b4ca4ec09a253eabbcf6fa68 P 6dcd990050744d38a34e0f692272c33c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fd09b52184c425597059beece124998" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46871 } } peers { permanent_uuid: "5efee7222d70430aab8d04cd1b357e8a" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 39785 } } peers { permanent_uuid: "6dcd990050744d38a34e0f692272c33c" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 43355 } }
I20260805 22:47:36.533111 27004 raft_consensus.cc:348] T e671b734b4ca4ec09a253eabbcf6fa68 P 7fd09b52184c425597059beece124998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fd09b52184c425597059beece124998" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46871 } } peers { permanent_uuid: "5efee7222d70430aab8d04cd1b357e8a" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 39785 } } peers { permanent_uuid: "6dcd990050744d38a34e0f692272c33c" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 43355 } }
I20260805 22:47:36.533267 27004 raft_consensus.cc:374] T e671b734b4ca4ec09a253eabbcf6fa68 P 7fd09b52184c425597059beece124998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:36.533322 27011 ts_tablet_manager.cc:1428] T e671b734b4ca4ec09a253eabbcf6fa68 P 6dcd990050744d38a34e0f692272c33c: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260805 22:47:36.533358 26530 heartbeater.cc:503] Master 127.14.224.190:46777 was elected leader, sending a full tablet report...
I20260805 22:47:36.533308 27004 raft_consensus.cc:729] T e671b734b4ca4ec09a253eabbcf6fa68 P 7fd09b52184c425597059beece124998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fd09b52184c425597059beece124998, State: Initialized, Role: FOLLOWER
I20260805 22:47:36.533677 27004 consensus_queue.cc:260] T e671b734b4ca4ec09a253eabbcf6fa68 P 7fd09b52184c425597059beece124998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fd09b52184c425597059beece124998" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46871 } } peers { permanent_uuid: "5efee7222d70430aab8d04cd1b357e8a" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 39785 } } peers { permanent_uuid: "6dcd990050744d38a34e0f692272c33c" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 43355 } }
I20260805 22:47:36.533975 26964 heartbeater.cc:503] Master 127.14.224.190:46777 was elected leader, sending a full tablet report...
I20260805 22:47:36.534080 27004 ts_tablet_manager.cc:1428] T e671b734b4ca4ec09a253eabbcf6fa68 P 7fd09b52184c425597059beece124998: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
W20260805 22:47:36.557793 26734 tablet.cc:2369] T e671b734b4ca4ec09a253eabbcf6fa68 P 5efee7222d70430aab8d04cd1b357e8a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260805 22:47:36.622061 26531 tablet.cc:2369] T e671b734b4ca4ec09a253eabbcf6fa68 P 6dcd990050744d38a34e0f692272c33c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260805 22:47:36.721869 26965 tablet.cc:2369] T e671b734b4ca4ec09a253eabbcf6fa68 P 7fd09b52184c425597059beece124998: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:47:36.759296 27015 raft_consensus.cc:482] T e671b734b4ca4ec09a253eabbcf6fa68 P 6dcd990050744d38a34e0f692272c33c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:47:36.759464 27015 raft_consensus.cc:504] T e671b734b4ca4ec09a253eabbcf6fa68 P 6dcd990050744d38a34e0f692272c33c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fd09b52184c425597059beece124998" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46871 } } peers { permanent_uuid: "5efee7222d70430aab8d04cd1b357e8a" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 39785 } } peers { permanent_uuid: "6dcd990050744d38a34e0f692272c33c" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 43355 } }
I20260805 22:47:36.759820 27015 leader_election.cc:288] T e671b734b4ca4ec09a253eabbcf6fa68 P 6dcd990050744d38a34e0f692272c33c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fd09b52184c425597059beece124998 (127.14.224.131:46871), 5efee7222d70430aab8d04cd1b357e8a (127.14.224.130:39785)
I20260805 22:47:36.762749 26997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:36.760086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.129:44081 (local address 127.14.224.131:46871)
0805 22:47:36.760137 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:36.760139 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:36.760241 (+ 102us) server_negotiation.cc:407] Connection header received
0805 22:47:36.760291 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:36.760293 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:36.760302 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:36.760349 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:47:36.760510 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:36.760991 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:36.762055 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:36.762423 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:36.762490 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:36.762499 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:36.762636 (+ 137us) server_negotiation.cc:299] Negotiation successful
0805 22:47:36.762671 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260805 22:47:36.762750 27000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:36.760099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.129:38683 (local address 127.14.224.130:39785)
0805 22:47:36.760150 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:36.760152 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:36.760265 (+ 113us) server_negotiation.cc:407] Connection header received
0805 22:47:36.760316 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:36.760317 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:36.760324 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:36.760378 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:47:36.760552 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:36.761008 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:36.762051 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:36.762413 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:36.762475 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:36.762485 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:36.762642 (+ 157us) server_negotiation.cc:299] Negotiation successful
0805 22:47:36.762680 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260805 22:47:36.762786 27019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:36.760012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.131:46871 (local address 127.14.224.129:44081)
0805 22:47:36.760155 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:36.760165 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:36.760230 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:36.760362 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:36.760363 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:36.760365 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:47:36.760458 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:36.760460 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:36.761071 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:36.761072 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:36.761950 (+ 878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:36.761954 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:36.762499 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:36.762500 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:36.762564 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:36.762568 (+ 4us) client_negotiation.cc:769] Sending connection context
0805 22:47:36.762615 (+ 47us) client_negotiation.cc:240] Negotiation successful
0805 22:47:36.762663 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"mutex_wait_us":38,"thread_start_us":103,"threads_started":1}
I20260805 22:47:36.762780 27020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:36.760012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.130:39785 (local address 127.14.224.129:38683)
0805 22:47:36.760183 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:36.760193 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:36.760264 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:36.760420 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:36.760421 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:36.760423 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:47:36.760486 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:36.760488 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:36.761085 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:36.761086 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:36.761952 (+ 866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:36.761955 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:36.762490 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:36.762491 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:36.762571 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:36.762575 (+ 4us) client_negotiation.cc:769] Sending connection context
0805 22:47:36.762625 (+ 50us) client_negotiation.cc:240] Negotiation successful
0805 22:47:36.762669 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"mutex_wait_us":44,"thread_start_us":65,"threads_started":1}
I20260805 22:47:36.763247 26878 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e671b734b4ca4ec09a253eabbcf6fa68" candidate_uuid: "6dcd990050744d38a34e0f692272c33c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fd09b52184c425597059beece124998" is_pre_election: true
I20260805 22:47:36.763338 26667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e671b734b4ca4ec09a253eabbcf6fa68" candidate_uuid: "6dcd990050744d38a34e0f692272c33c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5efee7222d70430aab8d04cd1b357e8a" is_pre_election: true
I20260805 22:47:36.763466 26667 raft_consensus.cc:2454] T e671b734b4ca4ec09a253eabbcf6fa68 P 5efee7222d70430aab8d04cd1b357e8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6dcd990050744d38a34e0f692272c33c in term 0.
I20260805 22:47:36.763466 26878 raft_consensus.cc:2454] T e671b734b4ca4ec09a253eabbcf6fa68 P 7fd09b52184c425597059beece124998 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6dcd990050744d38a34e0f692272c33c in term 0.
I20260805 22:47:36.763710 26362 leader_election.cc:302] T e671b734b4ca4ec09a253eabbcf6fa68 P 6dcd990050744d38a34e0f692272c33c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6dcd990050744d38a34e0f692272c33c, 7fd09b52184c425597059beece124998; no voters:
I20260805 22:47:36.763865 27015 raft_consensus.cc:2781] T e671b734b4ca4ec09a253eabbcf6fa68 P 6dcd990050744d38a34e0f692272c33c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:47:36.763947 27015 raft_consensus.cc:482] T e671b734b4ca4ec09a253eabbcf6fa68 P 6dcd990050744d38a34e0f692272c33c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:47:36.763967 27015 raft_consensus.cc:3037] T e671b734b4ca4ec09a253eabbcf6fa68 P 6dcd990050744d38a34e0f692272c33c [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:36.764681 27015 raft_consensus.cc:504] T e671b734b4ca4ec09a253eabbcf6fa68 P 6dcd990050744d38a34e0f692272c33c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fd09b52184c425597059beece124998" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46871 } } peers { permanent_uuid: "5efee7222d70430aab8d04cd1b357e8a" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 39785 } } peers { permanent_uuid: "6dcd990050744d38a34e0f692272c33c" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 43355 } }
I20260805 22:47:36.764820 27015 leader_election.cc:288] T e671b734b4ca4ec09a253eabbcf6fa68 P 6dcd990050744d38a34e0f692272c33c [CANDIDATE]: Term 1 election: Requested vote from peers 7fd09b52184c425597059beece124998 (127.14.224.131:46871), 5efee7222d70430aab8d04cd1b357e8a (127.14.224.130:39785)
I20260805 22:47:36.764957 26878 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e671b734b4ca4ec09a253eabbcf6fa68" candidate_uuid: "6dcd990050744d38a34e0f692272c33c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fd09b52184c425597059beece124998"
I20260805 22:47:36.765002 26667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e671b734b4ca4ec09a253eabbcf6fa68" candidate_uuid: "6dcd990050744d38a34e0f692272c33c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5efee7222d70430aab8d04cd1b357e8a"
I20260805 22:47:36.765043 26878 raft_consensus.cc:3037] T e671b734b4ca4ec09a253eabbcf6fa68 P 7fd09b52184c425597059beece124998 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:36.765077 26667 raft_consensus.cc:3037] T e671b734b4ca4ec09a253eabbcf6fa68 P 5efee7222d70430aab8d04cd1b357e8a [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:36.765761 26667 raft_consensus.cc:2454] T e671b734b4ca4ec09a253eabbcf6fa68 P 5efee7222d70430aab8d04cd1b357e8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6dcd990050744d38a34e0f692272c33c in term 1.
I20260805 22:47:36.765810 26878 raft_consensus.cc:2454] T e671b734b4ca4ec09a253eabbcf6fa68 P 7fd09b52184c425597059beece124998 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6dcd990050744d38a34e0f692272c33c in term 1.
I20260805 22:47:36.765977 26361 leader_election.cc:302] T e671b734b4ca4ec09a253eabbcf6fa68 P 6dcd990050744d38a34e0f692272c33c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5efee7222d70430aab8d04cd1b357e8a, 6dcd990050744d38a34e0f692272c33c; no voters:
I20260805 22:47:36.766080 27015 raft_consensus.cc:2781] T e671b734b4ca4ec09a253eabbcf6fa68 P 6dcd990050744d38a34e0f692272c33c [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:47:36.766191 27015 raft_consensus.cc:686] T e671b734b4ca4ec09a253eabbcf6fa68 P 6dcd990050744d38a34e0f692272c33c [term 1 LEADER]: Becoming Leader. State: Replica: 6dcd990050744d38a34e0f692272c33c, State: Running, Role: LEADER
I20260805 22:47:36.766286 27015 consensus_queue.cc:237] T e671b734b4ca4ec09a253eabbcf6fa68 P 6dcd990050744d38a34e0f692272c33c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fd09b52184c425597059beece124998" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46871 } } peers { permanent_uuid: "5efee7222d70430aab8d04cd1b357e8a" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 39785 } } peers { permanent_uuid: "6dcd990050744d38a34e0f692272c33c" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 43355 } }
I20260805 22:47:36.767210 26229 catalog_manager.cc:5495] T e671b734b4ca4ec09a253eabbcf6fa68 P 6dcd990050744d38a34e0f692272c33c reported cstate change: term changed from 0 to 1, leader changed from <none> to 6dcd990050744d38a34e0f692272c33c (127.14.224.129). New cstate: current_term: 1 leader_uuid: "6dcd990050744d38a34e0f692272c33c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fd09b52184c425597059beece124998" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5efee7222d70430aab8d04cd1b357e8a" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 39785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6dcd990050744d38a34e0f692272c33c" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 43355 } health_report { overall_health: HEALTHY } } }
I20260805 22:47:36.805612 26999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:36.803458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49970 (local address 127.14.224.129:43355)
0805 22:47:36.803500 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:36.803503 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:36.803528 (+ 25us) server_negotiation.cc:407] Connection header received
0805 22:47:36.803564 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:36.803565 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:36.803583 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:36.803636 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:47:36.803748 (+ 112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:36.804255 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:36.805032 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:36.805210 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:36.805253 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:36.805368 (+ 115us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:47:36.805469 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:47:36.805524 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:36.805536 (+ 12us) server_negotiation.cc:299] Negotiation successful
0805 22:47:36.805552 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260805 22:47:36.807488 26878 raft_consensus.cc:1261] T e671b734b4ca4ec09a253eabbcf6fa68 P 7fd09b52184c425597059beece124998 [term 1 FOLLOWER]: Refusing update from remote peer 6dcd990050744d38a34e0f692272c33c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:47:36.807512 26667 raft_consensus.cc:1261] T e671b734b4ca4ec09a253eabbcf6fa68 P 5efee7222d70430aab8d04cd1b357e8a [term 1 FOLLOWER]: Refusing update from remote peer 6dcd990050744d38a34e0f692272c33c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:47:36.807865 27021 consensus_queue.cc:1035] T e671b734b4ca4ec09a253eabbcf6fa68 P 6dcd990050744d38a34e0f692272c33c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5efee7222d70430aab8d04cd1b357e8a" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 39785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:47:36.807998 27015 consensus_queue.cc:1035] T e671b734b4ca4ec09a253eabbcf6fa68 P 6dcd990050744d38a34e0f692272c33c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fd09b52184c425597059beece124998" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:47:36.812870 26231 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43396:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:47:36.812985 26231 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43396:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:47:36.813942 26231 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 333128fd1e8147f594934b3f9a75e602: Sending DeleteTablet for 3 replicas of tablet e671b734b4ca4ec09a253eabbcf6fa68
I20260805 22:47:36.814378 26428 tablet_service.cc:1514] Processing DeleteTablet for tablet e671b734b4ca4ec09a253eabbcf6fa68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:47:36 UTC) from {username='oryx', principal='oryx/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:49956
I20260805 22:47:36.814357 26633 tablet_service.cc:1514] Processing DeleteTablet for tablet e671b734b4ca4ec09a253eabbcf6fa68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:47:36 UTC) from {username='oryx', principal='oryx/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:52512
I20260805 22:47:36.814625 26852 tablet_service.cc:1514] Processing DeleteTablet for tablet e671b734b4ca4ec09a253eabbcf6fa68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:47:36 UTC) from {username='oryx', principal='oryx/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:56390
I20260805 22:47:36.814678 27039 tablet_replica.cc:330] T e671b734b4ca4ec09a253eabbcf6fa68 P 5efee7222d70430aab8d04cd1b357e8a: stopping tablet replica
I20260805 22:47:36.814666 26231 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43396:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260805 22:47:36.814792 27039 raft_consensus.cc:2229] T e671b734b4ca4ec09a253eabbcf6fa68 P 5efee7222d70430aab8d04cd1b357e8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:47:36.814908 27039 raft_consensus.cc:2258] T e671b734b4ca4ec09a253eabbcf6fa68 P 5efee7222d70430aab8d04cd1b357e8a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260805 22:47:36.814903 26231 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:47:36.815143 27041 tablet_replica.cc:330] T e671b734b4ca4ec09a253eabbcf6fa68 P 7fd09b52184c425597059beece124998: stopping tablet replica
I20260805 22:47:36.815335 27040 tablet_replica.cc:330] T e671b734b4ca4ec09a253eabbcf6fa68 P 6dcd990050744d38a34e0f692272c33c: stopping tablet replica
I20260805 22:47:36.815649 27039 ts_tablet_manager.cc:1905] T e671b734b4ca4ec09a253eabbcf6fa68 P 5efee7222d70430aab8d04cd1b357e8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:47:36.815836 27040 raft_consensus.cc:2229] T e671b734b4ca4ec09a253eabbcf6fa68 P 6dcd990050744d38a34e0f692272c33c [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:47:36.815691 27041 raft_consensus.cc:2229] T e671b734b4ca4ec09a253eabbcf6fa68 P 7fd09b52184c425597059beece124998 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:47:36.816903 26633 tablet_service.cc:1467] Processing CreateTablet for tablet 62a5756cec854f6884305072e50c6007 (DEFAULT_TABLE table=test-table [id=85831849c2d14af7a707f93ac616fec8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:47:36.817003 26633 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 62a5756cec854f6884305072e50c6007. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:36.817523 27039 ts_tablet_manager.cc:1918] T e671b734b4ca4ec09a253eabbcf6fa68 P 5efee7222d70430aab8d04cd1b357e8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:47:36.817595 27039 log.cc:1196] T e671b734b4ca4ec09a253eabbcf6fa68 P 5efee7222d70430aab8d04cd1b357e8a: Deleting WAL directory at /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/ts-1/wal/wals/e671b734b4ca4ec09a253eabbcf6fa68
I20260805 22:47:36.817844 27039 ts_tablet_manager.cc:1939] T e671b734b4ca4ec09a253eabbcf6fa68 P 5efee7222d70430aab8d04cd1b357e8a: Deleting consensus metadata
I20260805 22:47:36.818171 27005 tablet_bootstrap.cc:492] T 62a5756cec854f6884305072e50c6007 P 5efee7222d70430aab8d04cd1b357e8a: Bootstrap starting.
I20260805 22:47:36.818511 26209 catalog_manager.cc:4841] TS 5efee7222d70430aab8d04cd1b357e8a (127.14.224.130:39785): tablet e671b734b4ca4ec09a253eabbcf6fa68 (table test-table [id=c3d7d7e0b63843a6b115f09fba1b3295]) successfully deleted
I20260805 22:47:36.818599 27005 tablet_bootstrap.cc:654] T 62a5756cec854f6884305072e50c6007 P 5efee7222d70430aab8d04cd1b357e8a: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:36.818790 26852 tablet_service.cc:1467] Processing CreateTablet for tablet 62a5756cec854f6884305072e50c6007 (DEFAULT_TABLE table=test-table [id=85831849c2d14af7a707f93ac616fec8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:47:36.816803 26428 tablet_service.cc:1467] Processing CreateTablet for tablet 62a5756cec854f6884305072e50c6007 (DEFAULT_TABLE table=test-table [id=85831849c2d14af7a707f93ac616fec8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:47:36.818926 26852 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 62a5756cec854f6884305072e50c6007. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:36.818985 26428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 62a5756cec854f6884305072e50c6007. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:36.819739 27041 raft_consensus.cc:2258] T e671b734b4ca4ec09a253eabbcf6fa68 P 7fd09b52184c425597059beece124998 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:47:36.820362 27041 ts_tablet_manager.cc:1905] T e671b734b4ca4ec09a253eabbcf6fa68 P 7fd09b52184c425597059beece124998: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:47:36.820521 27004 tablet_bootstrap.cc:492] T 62a5756cec854f6884305072e50c6007 P 7fd09b52184c425597059beece124998: Bootstrap starting.
I20260805 22:47:36.820674 27011 tablet_bootstrap.cc:492] T 62a5756cec854f6884305072e50c6007 P 6dcd990050744d38a34e0f692272c33c: Bootstrap starting.
I20260805 22:47:36.820930 27004 tablet_bootstrap.cc:654] T 62a5756cec854f6884305072e50c6007 P 7fd09b52184c425597059beece124998: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:36.821056 27005 tablet_bootstrap.cc:492] T 62a5756cec854f6884305072e50c6007 P 5efee7222d70430aab8d04cd1b357e8a: No bootstrap required, opened a new log
I20260805 22:47:36.821099 27011 tablet_bootstrap.cc:654] T 62a5756cec854f6884305072e50c6007 P 6dcd990050744d38a34e0f692272c33c: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:36.821105 27005 ts_tablet_manager.cc:1397] T 62a5756cec854f6884305072e50c6007 P 5efee7222d70430aab8d04cd1b357e8a: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260805 22:47:36.821260 27005 raft_consensus.cc:348] T 62a5756cec854f6884305072e50c6007 P 5efee7222d70430aab8d04cd1b357e8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dcd990050744d38a34e0f692272c33c" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 43355 } } peers { permanent_uuid: "5efee7222d70430aab8d04cd1b357e8a" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 39785 } } peers { permanent_uuid: "7fd09b52184c425597059beece124998" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46871 } }
I20260805 22:47:36.821331 27005 raft_consensus.cc:374] T 62a5756cec854f6884305072e50c6007 P 5efee7222d70430aab8d04cd1b357e8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:36.821350 27005 raft_consensus.cc:729] T 62a5756cec854f6884305072e50c6007 P 5efee7222d70430aab8d04cd1b357e8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5efee7222d70430aab8d04cd1b357e8a, State: Initialized, Role: FOLLOWER
I20260805 22:47:36.821398 27005 consensus_queue.cc:260] T 62a5756cec854f6884305072e50c6007 P 5efee7222d70430aab8d04cd1b357e8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dcd990050744d38a34e0f692272c33c" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 43355 } } peers { permanent_uuid: "5efee7222d70430aab8d04cd1b357e8a" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 39785 } } peers { permanent_uuid: "7fd09b52184c425597059beece124998" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46871 } }
I20260805 22:47:36.821480 27005 ts_tablet_manager.cc:1428] T 62a5756cec854f6884305072e50c6007 P 5efee7222d70430aab8d04cd1b357e8a: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:36.822157 27040 raft_consensus.cc:2258] T e671b734b4ca4ec09a253eabbcf6fa68 P 6dcd990050744d38a34e0f692272c33c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:47:36.822605 27011 tablet_bootstrap.cc:492] T 62a5756cec854f6884305072e50c6007 P 6dcd990050744d38a34e0f692272c33c: No bootstrap required, opened a new log
I20260805 22:47:36.822657 27011 ts_tablet_manager.cc:1397] T 62a5756cec854f6884305072e50c6007 P 6dcd990050744d38a34e0f692272c33c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260805 22:47:36.822806 27040 ts_tablet_manager.cc:1905] T e671b734b4ca4ec09a253eabbcf6fa68 P 6dcd990050744d38a34e0f692272c33c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:47:36.822834 27041 ts_tablet_manager.cc:1918] T e671b734b4ca4ec09a253eabbcf6fa68 P 7fd09b52184c425597059beece124998: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:47:36.822793 27011 raft_consensus.cc:348] T 62a5756cec854f6884305072e50c6007 P 6dcd990050744d38a34e0f692272c33c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dcd990050744d38a34e0f692272c33c" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 43355 } } peers { permanent_uuid: "5efee7222d70430aab8d04cd1b357e8a" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 39785 } } peers { permanent_uuid: "7fd09b52184c425597059beece124998" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46871 } }
I20260805 22:47:36.822911 27004 tablet_bootstrap.cc:492] T 62a5756cec854f6884305072e50c6007 P 7fd09b52184c425597059beece124998: No bootstrap required, opened a new log
I20260805 22:47:36.822921 27041 log.cc:1196] T e671b734b4ca4ec09a253eabbcf6fa68 P 7fd09b52184c425597059beece124998: Deleting WAL directory at /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/ts-2/wal/wals/e671b734b4ca4ec09a253eabbcf6fa68
I20260805 22:47:36.822943 27011 raft_consensus.cc:374] T 62a5756cec854f6884305072e50c6007 P 6dcd990050744d38a34e0f692272c33c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:36.822963 27004 ts_tablet_manager.cc:1397] T 62a5756cec854f6884305072e50c6007 P 7fd09b52184c425597059beece124998: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.000s
I20260805 22:47:36.822973 27011 raft_consensus.cc:729] T 62a5756cec854f6884305072e50c6007 P 6dcd990050744d38a34e0f692272c33c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6dcd990050744d38a34e0f692272c33c, State: Initialized, Role: FOLLOWER
I20260805 22:47:36.823016 27011 consensus_queue.cc:260] T 62a5756cec854f6884305072e50c6007 P 6dcd990050744d38a34e0f692272c33c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dcd990050744d38a34e0f692272c33c" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 43355 } } peers { permanent_uuid: "5efee7222d70430aab8d04cd1b357e8a" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 39785 } } peers { permanent_uuid: "7fd09b52184c425597059beece124998" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46871 } }
I20260805 22:47:36.823122 27011 ts_tablet_manager.cc:1428] T 62a5756cec854f6884305072e50c6007 P 6dcd990050744d38a34e0f692272c33c: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260805 22:47:36.823120 27004 raft_consensus.cc:348] T 62a5756cec854f6884305072e50c6007 P 7fd09b52184c425597059beece124998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dcd990050744d38a34e0f692272c33c" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 43355 } } peers { permanent_uuid: "5efee7222d70430aab8d04cd1b357e8a" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 39785 } } peers { permanent_uuid: "7fd09b52184c425597059beece124998" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46871 } }
I20260805 22:47:36.823189 27004 raft_consensus.cc:374] T 62a5756cec854f6884305072e50c6007 P 7fd09b52184c425597059beece124998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:36.823208 27004 raft_consensus.cc:729] T 62a5756cec854f6884305072e50c6007 P 7fd09b52184c425597059beece124998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fd09b52184c425597059beece124998, State: Initialized, Role: FOLLOWER
I20260805 22:47:36.823220 27041 ts_tablet_manager.cc:1939] T e671b734b4ca4ec09a253eabbcf6fa68 P 7fd09b52184c425597059beece124998: Deleting consensus metadata
I20260805 22:47:36.823283 27004 consensus_queue.cc:260] T 62a5756cec854f6884305072e50c6007 P 7fd09b52184c425597059beece124998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dcd990050744d38a34e0f692272c33c" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 43355 } } peers { permanent_uuid: "5efee7222d70430aab8d04cd1b357e8a" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 39785 } } peers { permanent_uuid: "7fd09b52184c425597059beece124998" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46871 } }
I20260805 22:47:36.823375 27004 ts_tablet_manager.cc:1428] T 62a5756cec854f6884305072e50c6007 P 7fd09b52184c425597059beece124998: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:36.823812 26210 catalog_manager.cc:4841] TS 7fd09b52184c425597059beece124998 (127.14.224.131:46871): tablet e671b734b4ca4ec09a253eabbcf6fa68 (table test-table [id=c3d7d7e0b63843a6b115f09fba1b3295]) successfully deleted
I20260805 22:47:36.824430 27040 ts_tablet_manager.cc:1918] T e671b734b4ca4ec09a253eabbcf6fa68 P 6dcd990050744d38a34e0f692272c33c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:47:36.824503 27040 log.cc:1196] T e671b734b4ca4ec09a253eabbcf6fa68 P 6dcd990050744d38a34e0f692272c33c: Deleting WAL directory at /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/ts-0/wal/wals/e671b734b4ca4ec09a253eabbcf6fa68
I20260805 22:47:36.824728 27040 ts_tablet_manager.cc:1939] T e671b734b4ca4ec09a253eabbcf6fa68 P 6dcd990050744d38a34e0f692272c33c: Deleting consensus metadata
I20260805 22:47:36.825073 26214 catalog_manager.cc:4841] TS 6dcd990050744d38a34e0f692272c33c (127.14.224.129:43355): tablet e671b734b4ca4ec09a253eabbcf6fa68 (table test-table [id=c3d7d7e0b63843a6b115f09fba1b3295]) successfully deleted
I20260805 22:47:37.024938 27014 raft_consensus.cc:482] T 62a5756cec854f6884305072e50c6007 P 5efee7222d70430aab8d04cd1b357e8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:47:37.025043 27014 raft_consensus.cc:504] T 62a5756cec854f6884305072e50c6007 P 5efee7222d70430aab8d04cd1b357e8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dcd990050744d38a34e0f692272c33c" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 43355 } } peers { permanent_uuid: "5efee7222d70430aab8d04cd1b357e8a" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 39785 } } peers { permanent_uuid: "7fd09b52184c425597059beece124998" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46871 } }
I20260805 22:47:37.025418 27014 leader_election.cc:288] T 62a5756cec854f6884305072e50c6007 P 5efee7222d70430aab8d04cd1b357e8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6dcd990050744d38a34e0f692272c33c (127.14.224.129:43355), 7fd09b52184c425597059beece124998 (127.14.224.131:46871)
I20260805 22:47:37.028420 26999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:37.025853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:37193 (local address 127.14.224.129:43355)
0805 22:47:37.025905 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:37.025907 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:37.025914 (+ 7us) server_negotiation.cc:407] Connection header received
0805 22:47:37.025942 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:37.025943 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:37.025954 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:37.026004 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:47:37.026161 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:37.026650 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:37.027695 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:37.028072 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:37.028137 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:37.028148 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:37.028303 (+ 155us) server_negotiation.cc:299] Negotiation successful
0805 22:47:37.028346 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260805 22:47:37.028435 27053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:37.025656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.129:43355 (local address 127.14.224.130:37193)
0805 22:47:37.025768 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:37.025778 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:37.025834 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:37.026016 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:37.026017 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:37.026019 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:47:37.026102 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:37.026104 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:37.026722 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:37.026723 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:37.027596 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:37.027600 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:37.028167 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:37.028168 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:37.028241 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:37.028245 (+ 4us) client_negotiation.cc:769] Sending connection context
0805 22:47:37.028292 (+ 47us) client_negotiation.cc:240] Negotiation successful
0805 22:47:37.028338 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":62,"threads_started":1}
I20260805 22:47:37.028430 26997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:37.025848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:60555 (local address 127.14.224.131:46871)
0805 22:47:37.025895 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:37.025897 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:37.025904 (+ 7us) server_negotiation.cc:407] Connection header received
0805 22:47:37.026016 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:37.026018 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:37.026033 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:37.026116 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:47:37.026295 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:37.026778 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:37.027756 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:37.028124 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:37.028187 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:37.028196 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:37.028323 (+ 127us) server_negotiation.cc:299] Negotiation successful
0805 22:47:37.028364 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260805 22:47:37.028457 27051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:37.025635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.131:46871 (local address 127.14.224.130:60555)
0805 22:47:37.025742 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:37.025755 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:37.025826 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:37.026134 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:37.026135 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:37.026138 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:47:37.026220 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:37.026222 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:37.026853 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:37.026854 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:37.027674 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:37.027677 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:37.028196 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:37.028197 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:37.028264 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:37.028267 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:47:37.028311 (+ 44us) client_negotiation.cc:240] Negotiation successful
0805 22:47:37.028354 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":87,"thread_start_us":57,"threads_started":1}
I20260805 22:47:37.028754 26455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62a5756cec854f6884305072e50c6007" candidate_uuid: "5efee7222d70430aab8d04cd1b357e8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dcd990050744d38a34e0f692272c33c" is_pre_election: true
I20260805 22:47:37.028908 26455 raft_consensus.cc:2454] T 62a5756cec854f6884305072e50c6007 P 6dcd990050744d38a34e0f692272c33c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5efee7222d70430aab8d04cd1b357e8a in term 0.
I20260805 22:47:37.029213 26566 leader_election.cc:302] T 62a5756cec854f6884305072e50c6007 P 5efee7222d70430aab8d04cd1b357e8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5efee7222d70430aab8d04cd1b357e8a, 6dcd990050744d38a34e0f692272c33c; no voters:
I20260805 22:47:37.029245 26878 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62a5756cec854f6884305072e50c6007" candidate_uuid: "5efee7222d70430aab8d04cd1b357e8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fd09b52184c425597059beece124998" is_pre_election: true
I20260805 22:47:37.029340 26878 raft_consensus.cc:2454] T 62a5756cec854f6884305072e50c6007 P 7fd09b52184c425597059beece124998 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5efee7222d70430aab8d04cd1b357e8a in term 0.
I20260805 22:47:37.029386 27014 raft_consensus.cc:2781] T 62a5756cec854f6884305072e50c6007 P 5efee7222d70430aab8d04cd1b357e8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:47:37.029444 27014 raft_consensus.cc:482] T 62a5756cec854f6884305072e50c6007 P 5efee7222d70430aab8d04cd1b357e8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:47:37.029475 27014 raft_consensus.cc:3037] T 62a5756cec854f6884305072e50c6007 P 5efee7222d70430aab8d04cd1b357e8a [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:37.030364 27014 raft_consensus.cc:504] T 62a5756cec854f6884305072e50c6007 P 5efee7222d70430aab8d04cd1b357e8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dcd990050744d38a34e0f692272c33c" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 43355 } } peers { permanent_uuid: "5efee7222d70430aab8d04cd1b357e8a" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 39785 } } peers { permanent_uuid: "7fd09b52184c425597059beece124998" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46871 } }
I20260805 22:47:37.030539 27014 leader_election.cc:288] T 62a5756cec854f6884305072e50c6007 P 5efee7222d70430aab8d04cd1b357e8a [CANDIDATE]: Term 1 election: Requested vote from peers 6dcd990050744d38a34e0f692272c33c (127.14.224.129:43355), 7fd09b52184c425597059beece124998 (127.14.224.131:46871)
I20260805 22:47:37.030764 26455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62a5756cec854f6884305072e50c6007" candidate_uuid: "5efee7222d70430aab8d04cd1b357e8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dcd990050744d38a34e0f692272c33c"
I20260805 22:47:37.030773 26878 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62a5756cec854f6884305072e50c6007" candidate_uuid: "5efee7222d70430aab8d04cd1b357e8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fd09b52184c425597059beece124998"
I20260805 22:47:37.030849 26455 raft_consensus.cc:3037] T 62a5756cec854f6884305072e50c6007 P 6dcd990050744d38a34e0f692272c33c [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:37.030855 26878 raft_consensus.cc:3037] T 62a5756cec854f6884305072e50c6007 P 7fd09b52184c425597059beece124998 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:37.031626 26878 raft_consensus.cc:2454] T 62a5756cec854f6884305072e50c6007 P 7fd09b52184c425597059beece124998 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5efee7222d70430aab8d04cd1b357e8a in term 1.
I20260805 22:47:37.031653 26455 raft_consensus.cc:2454] T 62a5756cec854f6884305072e50c6007 P 6dcd990050744d38a34e0f692272c33c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5efee7222d70430aab8d04cd1b357e8a in term 1.
I20260805 22:47:37.031842 26566 leader_election.cc:302] T 62a5756cec854f6884305072e50c6007 P 5efee7222d70430aab8d04cd1b357e8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5efee7222d70430aab8d04cd1b357e8a, 6dcd990050744d38a34e0f692272c33c; no voters:
I20260805 22:47:37.031980 27014 raft_consensus.cc:2781] T 62a5756cec854f6884305072e50c6007 P 5efee7222d70430aab8d04cd1b357e8a [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:47:37.032094 27014 raft_consensus.cc:686] T 62a5756cec854f6884305072e50c6007 P 5efee7222d70430aab8d04cd1b357e8a [term 1 LEADER]: Becoming Leader. State: Replica: 5efee7222d70430aab8d04cd1b357e8a, State: Running, Role: LEADER
I20260805 22:47:37.032173 27014 consensus_queue.cc:237] T 62a5756cec854f6884305072e50c6007 P 5efee7222d70430aab8d04cd1b357e8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dcd990050744d38a34e0f692272c33c" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 43355 } } peers { permanent_uuid: "5efee7222d70430aab8d04cd1b357e8a" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 39785 } } peers { permanent_uuid: "7fd09b52184c425597059beece124998" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46871 } }
I20260805 22:47:37.033013 26231 catalog_manager.cc:5495] T 62a5756cec854f6884305072e50c6007 P 5efee7222d70430aab8d04cd1b357e8a reported cstate change: term changed from 0 to 1, leader changed from <none> to 5efee7222d70430aab8d04cd1b357e8a (127.14.224.130). New cstate: current_term: 1 leader_uuid: "5efee7222d70430aab8d04cd1b357e8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dcd990050744d38a34e0f692272c33c" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 43355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5efee7222d70430aab8d04cd1b357e8a" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 39785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7fd09b52184c425597059beece124998" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46871 } health_report { overall_health: UNKNOWN } } }
Aug 05 22:47:37 dist-test-slave-gjrz krb5kdc[26163](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970055, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.224.190@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM
I20260805 22:47:37.079051 27065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:37.072186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43398 (local address 127.14.224.190:46777)
0805 22:47:37.072353 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:37.072355 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:37.072365 (+ 10us) server_negotiation.cc:407] Connection header received
0805 22:47:37.072441 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:37.072442 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:37.072452 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:37.072505 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:37.072930 (+ 425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:37.073437 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:37.074124 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:37.074338 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:37.074387 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:37.076568 (+ 2181us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:37.076570 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:37.076570 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:37.076577 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:37.077984 (+ 1407us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:37.078408 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:37.078409 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:37.078409 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:37.078475 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:37.078631 (+ 156us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:37.078631 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:37.078631 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:37.078741 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:37.078793 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:37.078890 (+ 97us) server_negotiation.cc:299] Negotiation successful
0805 22:47:37.078971 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":97,"threads_started":1}
I20260805 22:47:37.079320 27064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:37.072145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:46777 (local address 127.0.0.1:43398)
0805 22:47:37.072302 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:37.072315 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:37.072380 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:37.072513 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:37.072513 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:37.072819 (+ 306us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:37.072869 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:37.072871 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:37.073509 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:37.073510 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:37.074050 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:37.074053 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:37.074392 (+ 339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:37.074393 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:37.074432 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:37.074874 (+ 442us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:37.074878 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:37.076461 (+ 1583us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:37.078085 (+ 1624us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:37.078102 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:37.078104 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:37.078330 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:37.078529 (+ 199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:37.078529 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:37.078530 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:37.078587 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:37.078777 (+ 190us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:37.078783 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:37.078827 (+ 44us) client_negotiation.cc:769] Sending connection context
0805 22:47:37.078873 (+ 46us) client_negotiation.cc:240] Negotiation successful
0805 22:47:37.079028 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"mutex_wait_us":57,"thread_start_us":80,"threads_started":1}
I20260805 22:47:37.081264 26231 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:43398:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260805 22:47:37.081468 26231 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:47:37.082856 26633 tablet_service.cc:1467] Processing CreateTablet for tablet 1cfa3437a6e641039bb78c469b4095a6 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=52b45c3305734cc993f16701ee7fa39b]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260805 22:47:37.082845 26428 tablet_service.cc:1467] Processing CreateTablet for tablet 1cfa3437a6e641039bb78c469b4095a6 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=52b45c3305734cc993f16701ee7fa39b]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260805 22:47:37.082922 26852 tablet_service.cc:1467] Processing CreateTablet for tablet 1cfa3437a6e641039bb78c469b4095a6 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=52b45c3305734cc993f16701ee7fa39b]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260805 22:47:37.083027 26633 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1cfa3437a6e641039bb78c469b4095a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:37.083027 26428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1cfa3437a6e641039bb78c469b4095a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:37.083084 26852 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1cfa3437a6e641039bb78c469b4095a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:37.084410 27004 tablet_bootstrap.cc:492] T 1cfa3437a6e641039bb78c469b4095a6 P 7fd09b52184c425597059beece124998: Bootstrap starting.
I20260805 22:47:37.084585 27005 tablet_bootstrap.cc:492] T 1cfa3437a6e641039bb78c469b4095a6 P 5efee7222d70430aab8d04cd1b357e8a: Bootstrap starting.
I20260805 22:47:37.084599 27011 tablet_bootstrap.cc:492] T 1cfa3437a6e641039bb78c469b4095a6 P 6dcd990050744d38a34e0f692272c33c: Bootstrap starting.
I20260805 22:47:37.084863 27011 tablet_bootstrap.cc:654] T 1cfa3437a6e641039bb78c469b4095a6 P 6dcd990050744d38a34e0f692272c33c: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:37.084885 27004 tablet_bootstrap.cc:654] T 1cfa3437a6e641039bb78c469b4095a6 P 7fd09b52184c425597059beece124998: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:37.084970 27005 tablet_bootstrap.cc:654] T 1cfa3437a6e641039bb78c469b4095a6 P 5efee7222d70430aab8d04cd1b357e8a: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:37.085412 27011 tablet_bootstrap.cc:492] T 1cfa3437a6e641039bb78c469b4095a6 P 6dcd990050744d38a34e0f692272c33c: No bootstrap required, opened a new log
I20260805 22:47:37.085469 27011 ts_tablet_manager.cc:1397] T 1cfa3437a6e641039bb78c469b4095a6 P 6dcd990050744d38a34e0f692272c33c: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260805 22:47:37.085593 27011 raft_consensus.cc:348] T 1cfa3437a6e641039bb78c469b4095a6 P 6dcd990050744d38a34e0f692272c33c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dcd990050744d38a34e0f692272c33c" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 43355 } } peers { permanent_uuid: "5efee7222d70430aab8d04cd1b357e8a" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 39785 } } peers { permanent_uuid: "7fd09b52184c425597059beece124998" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46871 } }
I20260805 22:47:37.085659 27011 raft_consensus.cc:374] T 1cfa3437a6e641039bb78c469b4095a6 P 6dcd990050744d38a34e0f692272c33c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:37.085677 27011 raft_consensus.cc:729] T 1cfa3437a6e641039bb78c469b4095a6 P 6dcd990050744d38a34e0f692272c33c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6dcd990050744d38a34e0f692272c33c, State: Initialized, Role: FOLLOWER
I20260805 22:47:37.085700 27005 tablet_bootstrap.cc:492] T 1cfa3437a6e641039bb78c469b4095a6 P 5efee7222d70430aab8d04cd1b357e8a: No bootstrap required, opened a new log
I20260805 22:47:37.085718 27011 consensus_queue.cc:260] T 1cfa3437a6e641039bb78c469b4095a6 P 6dcd990050744d38a34e0f692272c33c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dcd990050744d38a34e0f692272c33c" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 43355 } } peers { permanent_uuid: "5efee7222d70430aab8d04cd1b357e8a" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 39785 } } peers { permanent_uuid: "7fd09b52184c425597059beece124998" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46871 } }
I20260805 22:47:37.085753 27005 ts_tablet_manager.cc:1397] T 1cfa3437a6e641039bb78c469b4095a6 P 5efee7222d70430aab8d04cd1b357e8a: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260805 22:47:37.085812 27011 ts_tablet_manager.cc:1428] T 1cfa3437a6e641039bb78c469b4095a6 P 6dcd990050744d38a34e0f692272c33c: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260805 22:47:37.085903 27015 tablet_replica.cc:439] T 1cfa3437a6e641039bb78c469b4095a6 P 6dcd990050744d38a34e0f692272c33c: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dcd990050744d38a34e0f692272c33c" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 43355 } } peers { permanent_uuid: "5efee7222d70430aab8d04cd1b357e8a" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 39785 } } peers { permanent_uuid: "7fd09b52184c425597059beece124998" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46871 } } }
I20260805 22:47:37.085892 27005 raft_consensus.cc:348] T 1cfa3437a6e641039bb78c469b4095a6 P 5efee7222d70430aab8d04cd1b357e8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dcd990050744d38a34e0f692272c33c" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 43355 } } peers { permanent_uuid: "5efee7222d70430aab8d04cd1b357e8a" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 39785 } } peers { permanent_uuid: "7fd09b52184c425597059beece124998" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46871 } }
I20260805 22:47:37.085973 27005 raft_consensus.cc:374] T 1cfa3437a6e641039bb78c469b4095a6 P 5efee7222d70430aab8d04cd1b357e8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:37.085992 27005 raft_consensus.cc:729] T 1cfa3437a6e641039bb78c469b4095a6 P 5efee7222d70430aab8d04cd1b357e8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5efee7222d70430aab8d04cd1b357e8a, State: Initialized, Role: FOLLOWER
I20260805 22:47:37.085978 27015 tablet_replica.cc:442] T 1cfa3437a6e641039bb78c469b4095a6 P 6dcd990050744d38a34e0f692272c33c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 22:47:37.086040 27005 consensus_queue.cc:260] T 1cfa3437a6e641039bb78c469b4095a6 P 5efee7222d70430aab8d04cd1b357e8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dcd990050744d38a34e0f692272c33c" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 43355 } } peers { permanent_uuid: "5efee7222d70430aab8d04cd1b357e8a" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 39785 } } peers { permanent_uuid: "7fd09b52184c425597059beece124998" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46871 } }
I20260805 22:47:37.086136 27005 ts_tablet_manager.cc:1428] T 1cfa3437a6e641039bb78c469b4095a6 P 5efee7222d70430aab8d04cd1b357e8a: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:37.086273 27014 tablet_replica.cc:439] T 1cfa3437a6e641039bb78c469b4095a6 P 5efee7222d70430aab8d04cd1b357e8a: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dcd990050744d38a34e0f692272c33c" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 43355 } } peers { permanent_uuid: "5efee7222d70430aab8d04cd1b357e8a" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 39785 } } peers { permanent_uuid: "7fd09b52184c425597059beece124998" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46871 } } }
I20260805 22:47:37.086359 27014 tablet_replica.cc:442] T 1cfa3437a6e641039bb78c469b4095a6 P 5efee7222d70430aab8d04cd1b357e8a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 22:47:37.086374 27004 tablet_bootstrap.cc:492] T 1cfa3437a6e641039bb78c469b4095a6 P 7fd09b52184c425597059beece124998: No bootstrap required, opened a new log
I20260805 22:47:37.086426 27004 ts_tablet_manager.cc:1397] T 1cfa3437a6e641039bb78c469b4095a6 P 7fd09b52184c425597059beece124998: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260805 22:47:37.086575 27004 raft_consensus.cc:348] T 1cfa3437a6e641039bb78c469b4095a6 P 7fd09b52184c425597059beece124998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dcd990050744d38a34e0f692272c33c" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 43355 } } peers { permanent_uuid: "5efee7222d70430aab8d04cd1b357e8a" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 39785 } } peers { permanent_uuid: "7fd09b52184c425597059beece124998" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46871 } }
I20260805 22:47:37.086652 27004 raft_consensus.cc:374] T 1cfa3437a6e641039bb78c469b4095a6 P 7fd09b52184c425597059beece124998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:37.086679 27004 raft_consensus.cc:729] T 1cfa3437a6e641039bb78c469b4095a6 P 7fd09b52184c425597059beece124998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fd09b52184c425597059beece124998, State: Initialized, Role: FOLLOWER
I20260805 22:47:37.086721 27004 consensus_queue.cc:260] T 1cfa3437a6e641039bb78c469b4095a6 P 7fd09b52184c425597059beece124998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dcd990050744d38a34e0f692272c33c" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 43355 } } peers { permanent_uuid: "5efee7222d70430aab8d04cd1b357e8a" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 39785 } } peers { permanent_uuid: "7fd09b52184c425597059beece124998" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46871 } }
I20260805 22:47:37.086822 27004 ts_tablet_manager.cc:1428] T 1cfa3437a6e641039bb78c469b4095a6 P 7fd09b52184c425597059beece124998: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:37.086870 27016 tablet_replica.cc:439] T 1cfa3437a6e641039bb78c469b4095a6 P 7fd09b52184c425597059beece124998: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dcd990050744d38a34e0f692272c33c" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 43355 } } peers { permanent_uuid: "5efee7222d70430aab8d04cd1b357e8a" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 39785 } } peers { permanent_uuid: "7fd09b52184c425597059beece124998" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46871 } } }
I20260805 22:47:37.086970 27016 tablet_replica.cc:442] T 1cfa3437a6e641039bb78c469b4095a6 P 7fd09b52184c425597059beece124998: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 22:47:37.149075 27016 raft_consensus.cc:482] T 1cfa3437a6e641039bb78c469b4095a6 P 7fd09b52184c425597059beece124998 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:47:37.149204 27016 raft_consensus.cc:504] T 1cfa3437a6e641039bb78c469b4095a6 P 7fd09b52184c425597059beece124998 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dcd990050744d38a34e0f692272c33c" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 43355 } } peers { permanent_uuid: "5efee7222d70430aab8d04cd1b357e8a" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 39785 } } peers { permanent_uuid: "7fd09b52184c425597059beece124998" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46871 } }
I20260805 22:47:37.149569 27016 leader_election.cc:288] T 1cfa3437a6e641039bb78c469b4095a6 P 7fd09b52184c425597059beece124998 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6dcd990050744d38a34e0f692272c33c (127.14.224.129:43355), 5efee7222d70430aab8d04cd1b357e8a (127.14.224.130:39785)
I20260805 22:47:37.153548 27000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:37.149877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:35799 (local address 127.14.224.130:39785)
0805 22:47:37.149923 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:37.149925 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:37.149968 (+ 43us) server_negotiation.cc:407] Connection header received
0805 22:47:37.150070 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:37.150071 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:37.150080 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:37.150147 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:47:37.150336 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:37.151076 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:37.152625 (+ 1549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:37.153183 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:37.153262 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:37.153272 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:37.153431 (+ 159us) server_negotiation.cc:299] Negotiation successful
0805 22:47:37.153470 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260805 22:47:37.153548 26999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:37.149815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:56155 (local address 127.14.224.129:43355)
0805 22:47:37.149929 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:37.149931 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:37.149996 (+ 65us) server_negotiation.cc:407] Connection header received
0805 22:47:37.150070 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:37.150071 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:37.150081 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:37.150147 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:47:37.150321 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:37.151086 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:37.152644 (+ 1558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:37.153183 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:37.153262 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:37.153272 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:37.153431 (+ 159us) server_negotiation.cc:299] Negotiation successful
0805 22:47:37.153471 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260805 22:47:37.153594 27070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:37.149750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.129:43355 (local address 127.14.224.131:56155)
0805 22:47:37.149929 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:37.149938 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:37.150002 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:37.150161 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:37.150162 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:37.150164 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:47:37.150248 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:37.150251 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:37.151172 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:37.151172 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:37.152521 (+ 1349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:37.152525 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:37.153272 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:37.153273 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:37.153356 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:37.153362 (+ 6us) client_negotiation.cc:769] Sending connection context
0805 22:47:37.153418 (+ 56us) client_negotiation.cc:240] Negotiation successful
0805 22:47:37.153482 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"mutex_wait_us":59,"spinlock_wait_cycles":15232,"thread_start_us":86,"threads_started":1}
I20260805 22:47:37.153596 27071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:37.149791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.130:39785 (local address 127.14.224.131:35799)
0805 22:47:37.149898 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:37.149910 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:37.150002 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:37.150161 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:37.150162 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:37.150165 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:47:37.150276 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:37.150277 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:37.151183 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:37.151184 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:37.152520 (+ 1336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:37.152525 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:37.153274 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:37.153275 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:37.153358 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:37.153361 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:47:37.153418 (+ 57us) client_negotiation.cc:240] Negotiation successful
0805 22:47:37.153469 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":90,"mutex_wait_us":63,"thread_start_us":75,"threads_started":1}
I20260805 22:47:37.153985 26455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1cfa3437a6e641039bb78c469b4095a6" candidate_uuid: "7fd09b52184c425597059beece124998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dcd990050744d38a34e0f692272c33c" is_pre_election: true
I20260805 22:47:37.154048 26667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1cfa3437a6e641039bb78c469b4095a6" candidate_uuid: "7fd09b52184c425597059beece124998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5efee7222d70430aab8d04cd1b357e8a" is_pre_election: true
I20260805 22:47:37.154098 26455 raft_consensus.cc:2454] T 1cfa3437a6e641039bb78c469b4095a6 P 6dcd990050744d38a34e0f692272c33c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7fd09b52184c425597059beece124998 in term 0.
I20260805 22:47:37.154140 26667 raft_consensus.cc:2454] T 1cfa3437a6e641039bb78c469b4095a6 P 5efee7222d70430aab8d04cd1b357e8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7fd09b52184c425597059beece124998 in term 0.
I20260805 22:47:37.154318 26778 leader_election.cc:302] T 1cfa3437a6e641039bb78c469b4095a6 P 7fd09b52184c425597059beece124998 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6dcd990050744d38a34e0f692272c33c, 7fd09b52184c425597059beece124998; no voters:
I20260805 22:47:37.154469 27016 raft_consensus.cc:2781] T 1cfa3437a6e641039bb78c469b4095a6 P 7fd09b52184c425597059beece124998 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:47:37.154518 27016 raft_consensus.cc:482] T 1cfa3437a6e641039bb78c469b4095a6 P 7fd09b52184c425597059beece124998 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:47:37.154544 27016 raft_consensus.cc:3037] T 1cfa3437a6e641039bb78c469b4095a6 P 7fd09b52184c425597059beece124998 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:37.155349 27016 raft_consensus.cc:504] T 1cfa3437a6e641039bb78c469b4095a6 P 7fd09b52184c425597059beece124998 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dcd990050744d38a34e0f692272c33c" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 43355 } } peers { permanent_uuid: "5efee7222d70430aab8d04cd1b357e8a" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 39785 } } peers { permanent_uuid: "7fd09b52184c425597059beece124998" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46871 } }
I20260805 22:47:37.155494 27016 leader_election.cc:288] T 1cfa3437a6e641039bb78c469b4095a6 P 7fd09b52184c425597059beece124998 [CANDIDATE]: Term 1 election: Requested vote from peers 6dcd990050744d38a34e0f692272c33c (127.14.224.129:43355), 5efee7222d70430aab8d04cd1b357e8a (127.14.224.130:39785)
I20260805 22:47:37.155697 26455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1cfa3437a6e641039bb78c469b4095a6" candidate_uuid: "7fd09b52184c425597059beece124998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dcd990050744d38a34e0f692272c33c"
I20260805 22:47:37.155797 26455 raft_consensus.cc:3037] T 1cfa3437a6e641039bb78c469b4095a6 P 6dcd990050744d38a34e0f692272c33c [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:37.155768 26667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1cfa3437a6e641039bb78c469b4095a6" candidate_uuid: "7fd09b52184c425597059beece124998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5efee7222d70430aab8d04cd1b357e8a"
I20260805 22:47:37.155838 26667 raft_consensus.cc:3037] T 1cfa3437a6e641039bb78c469b4095a6 P 5efee7222d70430aab8d04cd1b357e8a [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:37.156610 26455 raft_consensus.cc:2454] T 1cfa3437a6e641039bb78c469b4095a6 P 6dcd990050744d38a34e0f692272c33c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fd09b52184c425597059beece124998 in term 1.
I20260805 22:47:37.156605 26667 raft_consensus.cc:2454] T 1cfa3437a6e641039bb78c469b4095a6 P 5efee7222d70430aab8d04cd1b357e8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fd09b52184c425597059beece124998 in term 1.
I20260805 22:47:37.156800 26774 leader_election.cc:302] T 1cfa3437a6e641039bb78c469b4095a6 P 7fd09b52184c425597059beece124998 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5efee7222d70430aab8d04cd1b357e8a, 7fd09b52184c425597059beece124998; no voters:
I20260805 22:47:37.156894 27016 raft_consensus.cc:2781] T 1cfa3437a6e641039bb78c469b4095a6 P 7fd09b52184c425597059beece124998 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:47:37.157047 27016 raft_consensus.cc:686] T 1cfa3437a6e641039bb78c469b4095a6 P 7fd09b52184c425597059beece124998 [term 1 LEADER]: Becoming Leader. State: Replica: 7fd09b52184c425597059beece124998, State: Running, Role: LEADER
I20260805 22:47:37.157125 27016 consensus_queue.cc:237] T 1cfa3437a6e641039bb78c469b4095a6 P 7fd09b52184c425597059beece124998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dcd990050744d38a34e0f692272c33c" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 43355 } } peers { permanent_uuid: "5efee7222d70430aab8d04cd1b357e8a" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 39785 } } peers { permanent_uuid: "7fd09b52184c425597059beece124998" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46871 } }
I20260805 22:47:37.157521 27072 tablet_replica.cc:439] T 1cfa3437a6e641039bb78c469b4095a6 P 7fd09b52184c425597059beece124998: TxnStatusTablet state changed. Reason: New leader 7fd09b52184c425597059beece124998. Latest consensus state: current_term: 1 leader_uuid: "7fd09b52184c425597059beece124998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dcd990050744d38a34e0f692272c33c" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 43355 } } peers { permanent_uuid: "5efee7222d70430aab8d04cd1b357e8a" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 39785 } } peers { permanent_uuid: "7fd09b52184c425597059beece124998" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46871 } } }
I20260805 22:47:37.157608 27072 tablet_replica.cc:442] T 1cfa3437a6e641039bb78c469b4095a6 P 7fd09b52184c425597059beece124998: This TxnStatusTablet replica's current role is: LEADER
I20260805 22:47:37.157820 27074 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260805 22:47:37.157917 27074 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260805 22:47:37.157861 26231 catalog_manager.cc:5495] T 1cfa3437a6e641039bb78c469b4095a6 P 7fd09b52184c425597059beece124998 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7fd09b52184c425597059beece124998 (127.14.224.131). New cstate: current_term: 1 leader_uuid: "7fd09b52184c425597059beece124998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dcd990050744d38a34e0f692272c33c" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 43355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5efee7222d70430aab8d04cd1b357e8a" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 39785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7fd09b52184c425597059beece124998" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46871 } health_report { overall_health: HEALTHY } } }
I20260805 22:47:37.181727 26997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:37.179300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56406 (local address 127.14.224.131:46871)
0805 22:47:37.179347 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:37.179349 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:37.179360 (+ 11us) server_negotiation.cc:407] Connection header received
0805 22:47:37.179404 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:37.179405 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:37.179425 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:37.179480 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:47:37.179617 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:37.180171 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:37.180967 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:37.181159 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:37.181215 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:37.181403 (+ 188us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:47:37.181505 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:47:37.181568 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:37.181626 (+ 58us) server_negotiation.cc:299] Negotiation successful
0805 22:47:37.181646 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260805 22:47:37.181744 27064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:37.179122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.131:46871 (local address 127.0.0.1:56406)
0805 22:47:37.179238 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:37.179252 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:37.179329 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:37.179495 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:37.179496 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:37.179498 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0805 22:47:37.179556 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:37.179559 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:37.180296 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:37.180297 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:37.180886 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:37.180888 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:37.181230 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:37.181231 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:37.181299 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:37.181315 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0805 22:47:37.181571 (+ 256us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0805 22:47:37.181580 (+ 9us) client_negotiation.cc:769] Sending connection context
0805 22:47:37.181623 (+ 43us) client_negotiation.cc:240] Negotiation successful
0805 22:47:37.181680 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":64}
I20260805 22:47:37.182952 26667 raft_consensus.cc:1261] T 1cfa3437a6e641039bb78c469b4095a6 P 5efee7222d70430aab8d04cd1b357e8a [term 1 FOLLOWER]: Refusing update from remote peer 7fd09b52184c425597059beece124998: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:47:37.183012 26455 raft_consensus.cc:1261] T 1cfa3437a6e641039bb78c469b4095a6 P 6dcd990050744d38a34e0f692272c33c [term 1 FOLLOWER]: Refusing update from remote peer 7fd09b52184c425597059beece124998: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:47:37.183249 27072 consensus_queue.cc:1035] T 1cfa3437a6e641039bb78c469b4095a6 P 7fd09b52184c425597059beece124998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5efee7222d70430aab8d04cd1b357e8a" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 39785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:47:37.183420 27016 consensus_queue.cc:1035] T 1cfa3437a6e641039bb78c469b4095a6 P 7fd09b52184c425597059beece124998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6dcd990050744d38a34e0f692272c33c" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 43355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:47:37.184109 27015 tablet_replica.cc:439] T 1cfa3437a6e641039bb78c469b4095a6 P 6dcd990050744d38a34e0f692272c33c: TxnStatusTablet state changed. Reason: New leader 7fd09b52184c425597059beece124998. Latest consensus state: current_term: 1 leader_uuid: "7fd09b52184c425597059beece124998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dcd990050744d38a34e0f692272c33c" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 43355 } } peers { permanent_uuid: "5efee7222d70430aab8d04cd1b357e8a" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 39785 } } peers { permanent_uuid: "7fd09b52184c425597059beece124998" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46871 } } }
I20260805 22:47:37.184203 27015 tablet_replica.cc:442] T 1cfa3437a6e641039bb78c469b4095a6 P 6dcd990050744d38a34e0f692272c33c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 22:47:37.184157 27014 tablet_replica.cc:439] T 1cfa3437a6e641039bb78c469b4095a6 P 5efee7222d70430aab8d04cd1b357e8a: TxnStatusTablet state changed. Reason: New leader 7fd09b52184c425597059beece124998. Latest consensus state: current_term: 1 leader_uuid: "7fd09b52184c425597059beece124998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dcd990050744d38a34e0f692272c33c" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 43355 } } peers { permanent_uuid: "5efee7222d70430aab8d04cd1b357e8a" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 39785 } } peers { permanent_uuid: "7fd09b52184c425597059beece124998" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46871 } } }
I20260805 22:47:37.184254 27014 tablet_replica.cc:442] T 1cfa3437a6e641039bb78c469b4095a6 P 5efee7222d70430aab8d04cd1b357e8a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 22:47:37.185014 27016 tablet_replica.cc:439] T 1cfa3437a6e641039bb78c469b4095a6 P 7fd09b52184c425597059beece124998: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7fd09b52184c425597059beece124998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dcd990050744d38a34e0f692272c33c" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 43355 } } peers { permanent_uuid: "5efee7222d70430aab8d04cd1b357e8a" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 39785 } } peers { permanent_uuid: "7fd09b52184c425597059beece124998" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46871 } } }
I20260805 22:47:37.185104 27016 tablet_replica.cc:442] T 1cfa3437a6e641039bb78c469b4095a6 P 7fd09b52184c425597059beece124998: This TxnStatusTablet replica's current role is: LEADER
I20260805 22:47:37.185164 27027 mvcc.cc:205] Tried to move back new op lower bound from 7315333354219302912 to 7315333354116190208. Current Snapshot: MvccSnapshot[applied={T|T < 7315333354219302912 or (T in {7315333354219302912})}]
I20260805 22:47:37.185295 27016 tablet_replica.cc:439] T 1cfa3437a6e641039bb78c469b4095a6 P 7fd09b52184c425597059beece124998: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7fd09b52184c425597059beece124998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dcd990050744d38a34e0f692272c33c" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 43355 } } peers { permanent_uuid: "5efee7222d70430aab8d04cd1b357e8a" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 39785 } } peers { permanent_uuid: "7fd09b52184c425597059beece124998" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46871 } } }
I20260805 22:47:37.185374 27016 tablet_replica.cc:442] T 1cfa3437a6e641039bb78c469b4095a6 P 7fd09b52184c425597059beece124998: This TxnStatusTablet replica's current role is: LEADER
I20260805 22:47:37.185595 27024 mvcc.cc:205] Tried to move back new op lower bound from 7315333354219302912 to 7315333354116190208. Current Snapshot: MvccSnapshot[applied={T|T < 7315333354219302912}]
I20260805 22:47:37.185686 27028 mvcc.cc:205] Tried to move back new op lower bound from 7315333354219302912 to 7315333354116190208. Current Snapshot: MvccSnapshot[applied={T|T < 7315333354219302912}]
I20260805 22:47:37.185768 27015 tablet_replica.cc:439] T 1cfa3437a6e641039bb78c469b4095a6 P 6dcd990050744d38a34e0f692272c33c: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7fd09b52184c425597059beece124998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dcd990050744d38a34e0f692272c33c" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 43355 } } peers { permanent_uuid: "5efee7222d70430aab8d04cd1b357e8a" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 39785 } } peers { permanent_uuid: "7fd09b52184c425597059beece124998" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46871 } } }
I20260805 22:47:37.185848 27015 tablet_replica.cc:442] T 1cfa3437a6e641039bb78c469b4095a6 P 6dcd990050744d38a34e0f692272c33c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 22:47:37.185925 27014 tablet_replica.cc:439] T 1cfa3437a6e641039bb78c469b4095a6 P 5efee7222d70430aab8d04cd1b357e8a: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7fd09b52184c425597059beece124998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dcd990050744d38a34e0f692272c33c" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 43355 } } peers { permanent_uuid: "5efee7222d70430aab8d04cd1b357e8a" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 39785 } } peers { permanent_uuid: "7fd09b52184c425597059beece124998" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46871 } } }
I20260805 22:47:37.186003 27014 tablet_replica.cc:442] T 1cfa3437a6e641039bb78c469b4095a6 P 5efee7222d70430aab8d04cd1b357e8a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 22:47:37.190115 27000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:37.187472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52528 (local address 127.14.224.130:39785)
0805 22:47:37.187512 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:37.187514 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:37.187560 (+ 46us) server_negotiation.cc:407] Connection header received
0805 22:47:37.187637 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:37.187638 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:37.187657 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:37.187731 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:47:37.187855 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:37.188315 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:37.189372 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:37.189601 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:37.189653 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:37.189806 (+ 153us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:47:37.189907 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:47:37.189953 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:37.190004 (+ 51us) server_negotiation.cc:299] Negotiation successful
0805 22:47:37.190022 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260805 22:47:37.195602 26997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:37.192797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:44763 (local address 127.14.224.131:46871)
0805 22:47:37.192847 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:37.192849 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:37.192970 (+ 121us) server_negotiation.cc:407] Connection header received
0805 22:47:37.193019 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:37.193020 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:37.193030 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:37.193094 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:47:37.193216 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:37.193985 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:37.194796 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:37.195106 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:37.195176 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:37.195349 (+ 173us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:47:37.195386 (+ 37us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:47:37.195443 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:37.195502 (+ 59us) server_negotiation.cc:299] Negotiation successful
0805 22:47:37.195524 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260805 22:47:37.195604 27081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:37.192726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.131:46871 (local address 127.14.224.130:44763)
0805 22:47:37.192903 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:37.192914 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:37.192974 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:37.193097 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:37.193098 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:37.193099 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0805 22:47:37.193169 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:37.193171 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:37.194057 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:37.194058 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:37.194735 (+ 677us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:37.194739 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:37.195174 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:37.195175 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:37.195222 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:37.195237 (+ 15us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0805 22:47:37.195446 (+ 209us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0805 22:47:37.195447 (+ 1us) client_negotiation.cc:769] Sending connection context
0805 22:47:37.195478 (+ 31us) client_negotiation.cc:240] Negotiation successful
0805 22:47:37.195520 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":99,"threads_started":1}
I20260805 22:47:37.198153 26878 raft_consensus.cc:1261] T 62a5756cec854f6884305072e50c6007 P 7fd09b52184c425597059beece124998 [term 1 FOLLOWER]: Refusing update from remote peer 5efee7222d70430aab8d04cd1b357e8a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:47:37.198211 26455 raft_consensus.cc:1261] T 62a5756cec854f6884305072e50c6007 P 6dcd990050744d38a34e0f692272c33c [term 1 FOLLOWER]: Refusing update from remote peer 5efee7222d70430aab8d04cd1b357e8a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:47:37.198441 27055 consensus_queue.cc:1035] T 62a5756cec854f6884305072e50c6007 P 5efee7222d70430aab8d04cd1b357e8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fd09b52184c425597059beece124998" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:47:37.198575 27014 consensus_queue.cc:1035] T 62a5756cec854f6884305072e50c6007 P 5efee7222d70430aab8d04cd1b357e8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6dcd990050744d38a34e0f692272c33c" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 43355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:47:37.210470 27086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:37.205183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.130:39785 (local address 127.14.224.131:34049)
0805 22:47:37.207412 (+ 2229us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:37.207426 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:37.207495 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:37.207638 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:37.207639 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:37.207640 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0805 22:47:37.207712 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:37.207714 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:37.208329 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:37.208330 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:37.209342 (+ 1012us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:37.209346 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:37.209904 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:37.209905 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:37.209976 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:37.210001 (+ 25us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0805 22:47:37.210238 (+ 237us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0805 22:47:37.210242 (+ 4us) client_negotiation.cc:769] Sending connection context
0805 22:47:37.210332 (+ 90us) client_negotiation.cc:240] Negotiation successful
0805 22:47:37.210388 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2170,"thread_start_us":92,"threads_started":1}
I20260805 22:47:37.210641 27000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:37.205216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:34049 (local address 127.14.224.130:39785)
0805 22:47:37.205259 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:37.205261 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:37.207482 (+ 2221us) server_negotiation.cc:407] Connection header received
0805 22:47:37.207553 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:37.207554 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:37.207566 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:37.207630 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:47:37.207773 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:37.208248 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:37.209512 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:37.209752 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:37.209835 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:37.210100 (+ 265us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:47:37.210145 (+ 45us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:47:37.210207 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:37.210531 (+ 324us) server_negotiation.cc:299] Negotiation successful
0805 22:47:37.210564 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260805 22:47:37.218819 26231 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43396:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:47:37.218936 26231 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43396:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:47:37.219578 26231 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 333128fd1e8147f594934b3f9a75e602: Sending DeleteTablet for 3 replicas of tablet 62a5756cec854f6884305072e50c6007
I20260805 22:47:37.219870 26633 tablet_service.cc:1514] Processing DeleteTablet for tablet 62a5756cec854f6884305072e50c6007 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:47:37 UTC) from {username='oryx', principal='oryx/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:52512
I20260805 22:47:37.219888 26852 tablet_service.cc:1514] Processing DeleteTablet for tablet 62a5756cec854f6884305072e50c6007 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:47:37 UTC) from {username='oryx', principal='oryx/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:56390
I20260805 22:47:37.219890 26428 tablet_service.cc:1514] Processing DeleteTablet for tablet 62a5756cec854f6884305072e50c6007 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:47:37 UTC) from {username='oryx', principal='oryx/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:49956
I20260805 22:47:37.219971 27039 tablet_replica.cc:330] T 62a5756cec854f6884305072e50c6007 P 5efee7222d70430aab8d04cd1b357e8a: stopping tablet replica
I20260805 22:47:37.219982 27040 tablet_replica.cc:330] T 62a5756cec854f6884305072e50c6007 P 6dcd990050744d38a34e0f692272c33c: stopping tablet replica
I20260805 22:47:37.220013 27039 raft_consensus.cc:2229] T 62a5756cec854f6884305072e50c6007 P 5efee7222d70430aab8d04cd1b357e8a [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:47:37.220032 27040 raft_consensus.cc:2229] T 62a5756cec854f6884305072e50c6007 P 6dcd990050744d38a34e0f692272c33c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:47:37.220063 27040 raft_consensus.cc:2258] T 62a5756cec854f6884305072e50c6007 P 6dcd990050744d38a34e0f692272c33c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:47:37.220098 27039 raft_consensus.cc:2258] T 62a5756cec854f6884305072e50c6007 P 5efee7222d70430aab8d04cd1b357e8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:47:37.220165 27041 tablet_replica.cc:330] T 62a5756cec854f6884305072e50c6007 P 7fd09b52184c425597059beece124998: stopping tablet replica
I20260805 22:47:37.220225 27041 raft_consensus.cc:2229] T 62a5756cec854f6884305072e50c6007 P 7fd09b52184c425597059beece124998 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:47:37.220259 27041 raft_consensus.cc:2258] T 62a5756cec854f6884305072e50c6007 P 7fd09b52184c425597059beece124998 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:47:37.220635 27040 ts_tablet_manager.cc:1905] T 62a5756cec854f6884305072e50c6007 P 6dcd990050744d38a34e0f692272c33c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:47:37.220695 27041 ts_tablet_manager.cc:1905] T 62a5756cec854f6884305072e50c6007 P 7fd09b52184c425597059beece124998: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:47:37.222559 27039 ts_tablet_manager.cc:1905] T 62a5756cec854f6884305072e50c6007 P 5efee7222d70430aab8d04cd1b357e8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:47:37.223482 27041 ts_tablet_manager.cc:1918] T 62a5756cec854f6884305072e50c6007 P 7fd09b52184c425597059beece124998: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260805 22:47:37.223551 27041 log.cc:1196] T 62a5756cec854f6884305072e50c6007 P 7fd09b52184c425597059beece124998: Deleting WAL directory at /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/ts-2/wal/wals/62a5756cec854f6884305072e50c6007
I20260805 22:47:37.223771 27041 ts_tablet_manager.cc:1939] T 62a5756cec854f6884305072e50c6007 P 7fd09b52184c425597059beece124998: Deleting consensus metadata
I20260805 22:47:37.224149 26210 catalog_manager.cc:4841] TS 7fd09b52184c425597059beece124998 (127.14.224.131:46871): tablet 62a5756cec854f6884305072e50c6007 (table test-table [id=85831849c2d14af7a707f93ac616fec8]) successfully deleted
I20260805 22:47:37.224454 27039 ts_tablet_manager.cc:1918] T 62a5756cec854f6884305072e50c6007 P 5efee7222d70430aab8d04cd1b357e8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260805 22:47:37.224519 27039 log.cc:1196] T 62a5756cec854f6884305072e50c6007 P 5efee7222d70430aab8d04cd1b357e8a: Deleting WAL directory at /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/ts-1/wal/wals/62a5756cec854f6884305072e50c6007
I20260805 22:47:37.224704 27039 ts_tablet_manager.cc:1939] T 62a5756cec854f6884305072e50c6007 P 5efee7222d70430aab8d04cd1b357e8a: Deleting consensus metadata
I20260805 22:47:37.225005 27040 ts_tablet_manager.cc:1918] T 62a5756cec854f6884305072e50c6007 P 6dcd990050744d38a34e0f692272c33c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260805 22:47:37.225011 26209 catalog_manager.cc:4841] TS 5efee7222d70430aab8d04cd1b357e8a (127.14.224.130:39785): tablet 62a5756cec854f6884305072e50c6007 (table test-table [id=85831849c2d14af7a707f93ac616fec8]) successfully deleted
I20260805 22:47:37.225072 27040 log.cc:1196] T 62a5756cec854f6884305072e50c6007 P 6dcd990050744d38a34e0f692272c33c: Deleting WAL directory at /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/ts-0/wal/wals/62a5756cec854f6884305072e50c6007
I20260805 22:47:37.225255 27040 ts_tablet_manager.cc:1939] T 62a5756cec854f6884305072e50c6007 P 6dcd990050744d38a34e0f692272c33c: Deleting consensus metadata
I20260805 22:47:37.225607 26214 catalog_manager.cc:4841] TS 6dcd990050744d38a34e0f692272c33c (127.14.224.129:43355): tablet 62a5756cec854f6884305072e50c6007 (table test-table [id=85831849c2d14af7a707f93ac616fec8]) successfully deleted
Aug 05 22:47:37 dist-test-slave-gjrz krb5kdc[26163](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970057, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 05 22:47:37 dist-test-slave-gjrz krb5kdc[26163](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:47:37 dist-test-slave-gjrz krb5kdc[26163](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
W20260805 22:47:37.248711 27065 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:47:37.243161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43412 (local address 127.14.224.190:46777)
0805 22:47:37.243234 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:37.243237 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:37.243332 (+ 95us) server_negotiation.cc:407] Connection header received
0805 22:47:37.243417 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:37.243418 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:37.243432 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:37.243480 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:37.244046 (+ 566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:37.244546 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:37.245322 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:37.245542 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:37.245578 (+ 36us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:37.248656 (+ 3078us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43412: BlockingRecv error: recv got EOF from 127.0.0.1:43412 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
Aug 05 22:47:37 dist-test-slave-gjrz krb5kdc[26163](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970057, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM
I20260805 22:47:37.256983 27065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:37.249914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43428 (local address 127.14.224.190:46777)
0805 22:47:37.249956 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:37.249958 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:37.250132 (+ 174us) server_negotiation.cc:407] Connection header received
0805 22:47:37.250201 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:37.250202 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:37.250213 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:37.250259 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:37.250725 (+ 466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:37.251215 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:37.252048 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:37.252267 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:37.252325 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:37.254507 (+ 2182us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:37.254509 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:37.254509 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:37.254517 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:37.255914 (+ 1397us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:37.256251 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:37.256252 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:37.256252 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:37.256307 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:37.256479 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:37.256480 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:37.256480 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:37.256591 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:37.256692 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:37.256794 (+ 102us) server_negotiation.cc:299] Negotiation successful
0805 22:47:37.256881 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260805 22:47:37.258553 26231 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43428:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:47:37.258733 26231 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:47:37.260138 26428 tablet_service.cc:1467] Processing CreateTablet for tablet b73159c3361142e28c9370cc7fe713bd (DEFAULT_TABLE table=test-table [id=0722cb96ba4e4bb4b98a86cea357e8e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:47:37.260164 26852 tablet_service.cc:1467] Processing CreateTablet for tablet b73159c3361142e28c9370cc7fe713bd (DEFAULT_TABLE table=test-table [id=0722cb96ba4e4bb4b98a86cea357e8e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:47:37.260290 26428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b73159c3361142e28c9370cc7fe713bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:37.260290 26852 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b73159c3361142e28c9370cc7fe713bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:37.261667 27004 tablet_bootstrap.cc:492] T b73159c3361142e28c9370cc7fe713bd P 7fd09b52184c425597059beece124998: Bootstrap starting.
I20260805 22:47:37.262113 27004 tablet_bootstrap.cc:654] T b73159c3361142e28c9370cc7fe713bd P 7fd09b52184c425597059beece124998: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:37.262449 27011 tablet_bootstrap.cc:492] T b73159c3361142e28c9370cc7fe713bd P 6dcd990050744d38a34e0f692272c33c: Bootstrap starting.
I20260805 22:47:37.262761 27011 tablet_bootstrap.cc:654] T b73159c3361142e28c9370cc7fe713bd P 6dcd990050744d38a34e0f692272c33c: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:37.263365 27004 tablet_bootstrap.cc:492] T b73159c3361142e28c9370cc7fe713bd P 7fd09b52184c425597059beece124998: No bootstrap required, opened a new log
I20260805 22:47:37.263365 26633 tablet_service.cc:1467] Processing CreateTablet for tablet b73159c3361142e28c9370cc7fe713bd (DEFAULT_TABLE table=test-table [id=0722cb96ba4e4bb4b98a86cea357e8e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:47:37.263417 27004 ts_tablet_manager.cc:1397] T b73159c3361142e28c9370cc7fe713bd P 7fd09b52184c425597059beece124998: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260805 22:47:37.263487 26633 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b73159c3361142e28c9370cc7fe713bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:37.263571 27004 raft_consensus.cc:348] T b73159c3361142e28c9370cc7fe713bd P 7fd09b52184c425597059beece124998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dcd990050744d38a34e0f692272c33c" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 43355 } } peers { permanent_uuid: "5efee7222d70430aab8d04cd1b357e8a" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 39785 } } peers { permanent_uuid: "7fd09b52184c425597059beece124998" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46871 } }
I20260805 22:47:37.263652 27004 raft_consensus.cc:374] T b73159c3361142e28c9370cc7fe713bd P 7fd09b52184c425597059beece124998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:37.263670 27004 raft_consensus.cc:729] T b73159c3361142e28c9370cc7fe713bd P 7fd09b52184c425597059beece124998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fd09b52184c425597059beece124998, State: Initialized, Role: FOLLOWER
I20260805 22:47:37.263711 27004 consensus_queue.cc:260] T b73159c3361142e28c9370cc7fe713bd P 7fd09b52184c425597059beece124998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dcd990050744d38a34e0f692272c33c" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 43355 } } peers { permanent_uuid: "5efee7222d70430aab8d04cd1b357e8a" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 39785 } } peers { permanent_uuid: "7fd09b52184c425597059beece124998" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46871 } }
I20260805 22:47:37.263796 27004 ts_tablet_manager.cc:1428] T b73159c3361142e28c9370cc7fe713bd P 7fd09b52184c425597059beece124998: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:37.264894 27005 tablet_bootstrap.cc:492] T b73159c3361142e28c9370cc7fe713bd P 5efee7222d70430aab8d04cd1b357e8a: Bootstrap starting.
I20260805 22:47:37.265193 27011 tablet_bootstrap.cc:492] T b73159c3361142e28c9370cc7fe713bd P 6dcd990050744d38a34e0f692272c33c: No bootstrap required, opened a new log
I20260805 22:47:37.265240 27011 ts_tablet_manager.cc:1397] T b73159c3361142e28c9370cc7fe713bd P 6dcd990050744d38a34e0f692272c33c: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260805 22:47:37.265307 27005 tablet_bootstrap.cc:654] T b73159c3361142e28c9370cc7fe713bd P 5efee7222d70430aab8d04cd1b357e8a: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:37.265370 27011 raft_consensus.cc:348] T b73159c3361142e28c9370cc7fe713bd P 6dcd990050744d38a34e0f692272c33c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dcd990050744d38a34e0f692272c33c" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 43355 } } peers { permanent_uuid: "5efee7222d70430aab8d04cd1b357e8a" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 39785 } } peers { permanent_uuid: "7fd09b52184c425597059beece124998" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46871 } }
I20260805 22:47:37.265450 27011 raft_consensus.cc:374] T b73159c3361142e28c9370cc7fe713bd P 6dcd990050744d38a34e0f692272c33c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:37.265468 27011 raft_consensus.cc:729] T b73159c3361142e28c9370cc7fe713bd P 6dcd990050744d38a34e0f692272c33c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6dcd990050744d38a34e0f692272c33c, State: Initialized, Role: FOLLOWER
I20260805 22:47:37.265514 27011 consensus_queue.cc:260] T b73159c3361142e28c9370cc7fe713bd P 6dcd990050744d38a34e0f692272c33c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dcd990050744d38a34e0f692272c33c" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 43355 } } peers { permanent_uuid: "5efee7222d70430aab8d04cd1b357e8a" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 39785 } } peers { permanent_uuid: "7fd09b52184c425597059beece124998" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46871 } }
I20260805 22:47:37.265600 27011 ts_tablet_manager.cc:1428] T b73159c3361142e28c9370cc7fe713bd P 6dcd990050744d38a34e0f692272c33c: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:37.266499 27005 tablet_bootstrap.cc:492] T b73159c3361142e28c9370cc7fe713bd P 5efee7222d70430aab8d04cd1b357e8a: No bootstrap required, opened a new log
I20260805 22:47:37.266549 27005 ts_tablet_manager.cc:1397] T b73159c3361142e28c9370cc7fe713bd P 5efee7222d70430aab8d04cd1b357e8a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260805 22:47:37.266705 27005 raft_consensus.cc:348] T b73159c3361142e28c9370cc7fe713bd P 5efee7222d70430aab8d04cd1b357e8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dcd990050744d38a34e0f692272c33c" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 43355 } } peers { permanent_uuid: "5efee7222d70430aab8d04cd1b357e8a" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 39785 } } peers { permanent_uuid: "7fd09b52184c425597059beece124998" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46871 } }
I20260805 22:47:37.266774 27005 raft_consensus.cc:374] T b73159c3361142e28c9370cc7fe713bd P 5efee7222d70430aab8d04cd1b357e8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:37.266790 27005 raft_consensus.cc:729] T b73159c3361142e28c9370cc7fe713bd P 5efee7222d70430aab8d04cd1b357e8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5efee7222d70430aab8d04cd1b357e8a, State: Initialized, Role: FOLLOWER
I20260805 22:47:37.266829 27005 consensus_queue.cc:260] T b73159c3361142e28c9370cc7fe713bd P 5efee7222d70430aab8d04cd1b357e8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dcd990050744d38a34e0f692272c33c" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 43355 } } peers { permanent_uuid: "5efee7222d70430aab8d04cd1b357e8a" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 39785 } } peers { permanent_uuid: "7fd09b52184c425597059beece124998" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46871 } }
I20260805 22:47:37.266907 27005 ts_tablet_manager.cc:1428] T b73159c3361142e28c9370cc7fe713bd P 5efee7222d70430aab8d04cd1b357e8a: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:37.355873 27015 raft_consensus.cc:482] T b73159c3361142e28c9370cc7fe713bd P 6dcd990050744d38a34e0f692272c33c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:47:37.355991 27015 raft_consensus.cc:504] T b73159c3361142e28c9370cc7fe713bd P 6dcd990050744d38a34e0f692272c33c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dcd990050744d38a34e0f692272c33c" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 43355 } } peers { permanent_uuid: "5efee7222d70430aab8d04cd1b357e8a" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 39785 } } peers { permanent_uuid: "7fd09b52184c425597059beece124998" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46871 } }
I20260805 22:47:37.356155 27015 leader_election.cc:288] T b73159c3361142e28c9370cc7fe713bd P 6dcd990050744d38a34e0f692272c33c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5efee7222d70430aab8d04cd1b357e8a (127.14.224.130:39785), 7fd09b52184c425597059beece124998 (127.14.224.131:46871)
I20260805 22:47:37.356415 26878 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b73159c3361142e28c9370cc7fe713bd" candidate_uuid: "6dcd990050744d38a34e0f692272c33c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fd09b52184c425597059beece124998" is_pre_election: true
I20260805 22:47:37.356431 26667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b73159c3361142e28c9370cc7fe713bd" candidate_uuid: "6dcd990050744d38a34e0f692272c33c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5efee7222d70430aab8d04cd1b357e8a" is_pre_election: true
I20260805 22:47:37.356516 26878 raft_consensus.cc:2454] T b73159c3361142e28c9370cc7fe713bd P 7fd09b52184c425597059beece124998 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6dcd990050744d38a34e0f692272c33c in term 0.
I20260805 22:47:37.356544 26667 raft_consensus.cc:2454] T b73159c3361142e28c9370cc7fe713bd P 5efee7222d70430aab8d04cd1b357e8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6dcd990050744d38a34e0f692272c33c in term 0.
I20260805 22:47:37.356703 26362 leader_election.cc:302] T b73159c3361142e28c9370cc7fe713bd P 6dcd990050744d38a34e0f692272c33c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6dcd990050744d38a34e0f692272c33c, 7fd09b52184c425597059beece124998; no voters:
I20260805 22:47:37.356815 27015 raft_consensus.cc:2781] T b73159c3361142e28c9370cc7fe713bd P 6dcd990050744d38a34e0f692272c33c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:47:37.356874 27015 raft_consensus.cc:482] T b73159c3361142e28c9370cc7fe713bd P 6dcd990050744d38a34e0f692272c33c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:47:37.356894 27015 raft_consensus.cc:3037] T b73159c3361142e28c9370cc7fe713bd P 6dcd990050744d38a34e0f692272c33c [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:37.357831 27015 raft_consensus.cc:504] T b73159c3361142e28c9370cc7fe713bd P 6dcd990050744d38a34e0f692272c33c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dcd990050744d38a34e0f692272c33c" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 43355 } } peers { permanent_uuid: "5efee7222d70430aab8d04cd1b357e8a" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 39785 } } peers { permanent_uuid: "7fd09b52184c425597059beece124998" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46871 } }
I20260805 22:47:37.358012 27015 leader_election.cc:288] T b73159c3361142e28c9370cc7fe713bd P 6dcd990050744d38a34e0f692272c33c [CANDIDATE]: Term 1 election: Requested vote from peers 5efee7222d70430aab8d04cd1b357e8a (127.14.224.130:39785), 7fd09b52184c425597059beece124998 (127.14.224.131:46871)
I20260805 22:47:37.358173 26878 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b73159c3361142e28c9370cc7fe713bd" candidate_uuid: "6dcd990050744d38a34e0f692272c33c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fd09b52184c425597059beece124998"
I20260805 22:47:37.358204 26667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b73159c3361142e28c9370cc7fe713bd" candidate_uuid: "6dcd990050744d38a34e0f692272c33c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5efee7222d70430aab8d04cd1b357e8a"
I20260805 22:47:37.358273 26878 raft_consensus.cc:3037] T b73159c3361142e28c9370cc7fe713bd P 7fd09b52184c425597059beece124998 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:37.358278 26667 raft_consensus.cc:3037] T b73159c3361142e28c9370cc7fe713bd P 5efee7222d70430aab8d04cd1b357e8a [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:37.359069 26667 raft_consensus.cc:2454] T b73159c3361142e28c9370cc7fe713bd P 5efee7222d70430aab8d04cd1b357e8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6dcd990050744d38a34e0f692272c33c in term 1.
I20260805 22:47:37.359069 26878 raft_consensus.cc:2454] T b73159c3361142e28c9370cc7fe713bd P 7fd09b52184c425597059beece124998 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6dcd990050744d38a34e0f692272c33c in term 1.
I20260805 22:47:37.359292 26361 leader_election.cc:302] T b73159c3361142e28c9370cc7fe713bd P 6dcd990050744d38a34e0f692272c33c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5efee7222d70430aab8d04cd1b357e8a, 6dcd990050744d38a34e0f692272c33c; no voters:
I20260805 22:47:37.359401 27015 raft_consensus.cc:2781] T b73159c3361142e28c9370cc7fe713bd P 6dcd990050744d38a34e0f692272c33c [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:47:37.359519 27015 raft_consensus.cc:686] T b73159c3361142e28c9370cc7fe713bd P 6dcd990050744d38a34e0f692272c33c [term 1 LEADER]: Becoming Leader. State: Replica: 6dcd990050744d38a34e0f692272c33c, State: Running, Role: LEADER
I20260805 22:47:37.359577 27015 consensus_queue.cc:237] T b73159c3361142e28c9370cc7fe713bd P 6dcd990050744d38a34e0f692272c33c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dcd990050744d38a34e0f692272c33c" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 43355 } } peers { permanent_uuid: "5efee7222d70430aab8d04cd1b357e8a" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 39785 } } peers { permanent_uuid: "7fd09b52184c425597059beece124998" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46871 } }
I20260805 22:47:37.360208 26231 catalog_manager.cc:5495] T b73159c3361142e28c9370cc7fe713bd P 6dcd990050744d38a34e0f692272c33c reported cstate change: term changed from 0 to 1, leader changed from <none> to 6dcd990050744d38a34e0f692272c33c (127.14.224.129). New cstate: current_term: 1 leader_uuid: "6dcd990050744d38a34e0f692272c33c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dcd990050744d38a34e0f692272c33c" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 43355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5efee7222d70430aab8d04cd1b357e8a" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 39785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7fd09b52184c425597059beece124998" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46871 } health_report { overall_health: UNKNOWN } } }
I20260805 22:47:37.384804 26999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:37.382618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49984 (local address 127.14.224.129:43355)
0805 22:47:37.382678 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:37.382680 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:37.382688 (+ 8us) server_negotiation.cc:407] Connection header received
0805 22:47:37.382715 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:37.382716 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:37.382727 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:37.382774 (+ 47us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:47:37.382900 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:37.383424 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:37.384170 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:37.384364 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:37.384421 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:37.384563 (+ 142us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:47:37.384596 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:47:37.384636 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:37.384701 (+ 65us) server_negotiation.cc:299] Negotiation successful
0805 22:47:37.384723 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260805 22:47:37.385620 26667 raft_consensus.cc:1261] T b73159c3361142e28c9370cc7fe713bd P 5efee7222d70430aab8d04cd1b357e8a [term 1 FOLLOWER]: Refusing update from remote peer 6dcd990050744d38a34e0f692272c33c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:47:37.385620 26878 raft_consensus.cc:1261] T b73159c3361142e28c9370cc7fe713bd P 7fd09b52184c425597059beece124998 [term 1 FOLLOWER]: Refusing update from remote peer 6dcd990050744d38a34e0f692272c33c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:47:37.385850 27118 consensus_queue.cc:1035] T b73159c3361142e28c9370cc7fe713bd P 6dcd990050744d38a34e0f692272c33c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fd09b52184c425597059beece124998" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:47:37.385972 27015 consensus_queue.cc:1035] T b73159c3361142e28c9370cc7fe713bd P 6dcd990050744d38a34e0f692272c33c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5efee7222d70430aab8d04cd1b357e8a" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 39785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:47:37.388792 26230 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43428:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:47:37.388885 26230 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43428:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:47:37.389550 26230 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 333128fd1e8147f594934b3f9a75e602: Sending DeleteTablet for 3 replicas of tablet b73159c3361142e28c9370cc7fe713bd
I20260805 22:47:37.389828 26852 tablet_service.cc:1514] Processing DeleteTablet for tablet b73159c3361142e28c9370cc7fe713bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:47:37 UTC) from {username='oryx', principal='oryx/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:56390
I20260805 22:47:37.389837 26633 tablet_service.cc:1514] Processing DeleteTablet for tablet b73159c3361142e28c9370cc7fe713bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:47:37 UTC) from {username='oryx', principal='oryx/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:52512
I20260805 22:47:37.389844 26428 tablet_service.cc:1514] Processing DeleteTablet for tablet b73159c3361142e28c9370cc7fe713bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:47:37 UTC) from {username='oryx', principal='oryx/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:49956
I20260805 22:47:37.389966 27039 tablet_replica.cc:330] T b73159c3361142e28c9370cc7fe713bd P 5efee7222d70430aab8d04cd1b357e8a: stopping tablet replica
I20260805 22:47:37.389983 27041 tablet_replica.cc:330] T b73159c3361142e28c9370cc7fe713bd P 7fd09b52184c425597059beece124998: stopping tablet replica
I20260805 22:47:37.390017 27039 raft_consensus.cc:2229] T b73159c3361142e28c9370cc7fe713bd P 5efee7222d70430aab8d04cd1b357e8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:47:37.390053 27041 raft_consensus.cc:2229] T b73159c3361142e28c9370cc7fe713bd P 7fd09b52184c425597059beece124998 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:47:37.390067 27039 raft_consensus.cc:2258] T b73159c3361142e28c9370cc7fe713bd P 5efee7222d70430aab8d04cd1b357e8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:47:37.390110 27041 raft_consensus.cc:2258] T b73159c3361142e28c9370cc7fe713bd P 7fd09b52184c425597059beece124998 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:47:37.390185 27040 tablet_replica.cc:330] T b73159c3361142e28c9370cc7fe713bd P 6dcd990050744d38a34e0f692272c33c: stopping tablet replica
I20260805 22:47:37.390249 27040 raft_consensus.cc:2229] T b73159c3361142e28c9370cc7fe713bd P 6dcd990050744d38a34e0f692272c33c [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:47:37.390296 27040 raft_consensus.cc:2258] T b73159c3361142e28c9370cc7fe713bd P 6dcd990050744d38a34e0f692272c33c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:47:37.390342 27039 ts_tablet_manager.cc:1905] T b73159c3361142e28c9370cc7fe713bd P 5efee7222d70430aab8d04cd1b357e8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:47:37.390588 27040 ts_tablet_manager.cc:1905] T b73159c3361142e28c9370cc7fe713bd P 6dcd990050744d38a34e0f692272c33c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:47:37.390650 27041 ts_tablet_manager.cc:1905] T b73159c3361142e28c9370cc7fe713bd P 7fd09b52184c425597059beece124998: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:47:37.390784 26230 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43428:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:47:37.390959 26230 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:47:37.392030 27039 ts_tablet_manager.cc:1918] T b73159c3361142e28c9370cc7fe713bd P 5efee7222d70430aab8d04cd1b357e8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:47:37.392094 27039 log.cc:1196] T b73159c3361142e28c9370cc7fe713bd P 5efee7222d70430aab8d04cd1b357e8a: Deleting WAL directory at /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/ts-1/wal/wals/b73159c3361142e28c9370cc7fe713bd
I20260805 22:47:37.392102 27041 ts_tablet_manager.cc:1918] T b73159c3361142e28c9370cc7fe713bd P 7fd09b52184c425597059beece124998: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:47:37.392148 27041 log.cc:1196] T b73159c3361142e28c9370cc7fe713bd P 7fd09b52184c425597059beece124998: Deleting WAL directory at /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/ts-2/wal/wals/b73159c3361142e28c9370cc7fe713bd
I20260805 22:47:37.392302 27039 ts_tablet_manager.cc:1939] T b73159c3361142e28c9370cc7fe713bd P 5efee7222d70430aab8d04cd1b357e8a: Deleting consensus metadata
I20260805 22:47:37.392328 27041 ts_tablet_manager.cc:1939] T b73159c3361142e28c9370cc7fe713bd P 7fd09b52184c425597059beece124998: Deleting consensus metadata
I20260805 22:47:37.392349 27040 ts_tablet_manager.cc:1918] T b73159c3361142e28c9370cc7fe713bd P 6dcd990050744d38a34e0f692272c33c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:47:37.392405 27040 log.cc:1196] T b73159c3361142e28c9370cc7fe713bd P 6dcd990050744d38a34e0f692272c33c: Deleting WAL directory at /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/ts-0/wal/wals/b73159c3361142e28c9370cc7fe713bd
I20260805 22:47:37.392622 27040 ts_tablet_manager.cc:1939] T b73159c3361142e28c9370cc7fe713bd P 6dcd990050744d38a34e0f692272c33c: Deleting consensus metadata
I20260805 22:47:37.392956 26428 tablet_service.cc:1467] Processing CreateTablet for tablet ccfb9e44c4aa4059bb843dfa870e5cda (DEFAULT_TABLE table=test-table [id=1293bac3d24b47e7a216003d3def5e43]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:47:37.392951 26210 catalog_manager.cc:4841] TS 7fd09b52184c425597059beece124998 (127.14.224.131:46871): tablet b73159c3361142e28c9370cc7fe713bd (table test-table [id=0722cb96ba4e4bb4b98a86cea357e8e6]) successfully deleted
I20260805 22:47:37.393003 26852 tablet_service.cc:1467] Processing CreateTablet for tablet ccfb9e44c4aa4059bb843dfa870e5cda (DEFAULT_TABLE table=test-table [id=1293bac3d24b47e7a216003d3def5e43]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:47:37.392969 26214 catalog_manager.cc:4841] TS 6dcd990050744d38a34e0f692272c33c (127.14.224.129:43355): tablet b73159c3361142e28c9370cc7fe713bd (table test-table [id=0722cb96ba4e4bb4b98a86cea357e8e6]) successfully deleted
I20260805 22:47:37.393072 26428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ccfb9e44c4aa4059bb843dfa870e5cda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:37.393111 26852 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ccfb9e44c4aa4059bb843dfa870e5cda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:37.393235 26209 catalog_manager.cc:4841] TS 5efee7222d70430aab8d04cd1b357e8a (127.14.224.130:39785): tablet b73159c3361142e28c9370cc7fe713bd (table test-table [id=0722cb96ba4e4bb4b98a86cea357e8e6]) successfully deleted
I20260805 22:47:37.393390 26633 tablet_service.cc:1467] Processing CreateTablet for tablet ccfb9e44c4aa4059bb843dfa870e5cda (DEFAULT_TABLE table=test-table [id=1293bac3d24b47e7a216003d3def5e43]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:47:37.393496 26633 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ccfb9e44c4aa4059bb843dfa870e5cda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:37.394129 27011 tablet_bootstrap.cc:492] T ccfb9e44c4aa4059bb843dfa870e5cda P 6dcd990050744d38a34e0f692272c33c: Bootstrap starting.
I20260805 22:47:37.394357 27004 tablet_bootstrap.cc:492] T ccfb9e44c4aa4059bb843dfa870e5cda P 7fd09b52184c425597059beece124998: Bootstrap starting.
I20260805 22:47:37.394460 27011 tablet_bootstrap.cc:654] T ccfb9e44c4aa4059bb843dfa870e5cda P 6dcd990050744d38a34e0f692272c33c: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:37.394670 27004 tablet_bootstrap.cc:654] T ccfb9e44c4aa4059bb843dfa870e5cda P 7fd09b52184c425597059beece124998: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:37.394757 27005 tablet_bootstrap.cc:492] T ccfb9e44c4aa4059bb843dfa870e5cda P 5efee7222d70430aab8d04cd1b357e8a: Bootstrap starting.
I20260805 22:47:37.395076 27005 tablet_bootstrap.cc:654] T ccfb9e44c4aa4059bb843dfa870e5cda P 5efee7222d70430aab8d04cd1b357e8a: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:37.395296 27004 tablet_bootstrap.cc:492] T ccfb9e44c4aa4059bb843dfa870e5cda P 7fd09b52184c425597059beece124998: No bootstrap required, opened a new log
I20260805 22:47:37.395342 27004 ts_tablet_manager.cc:1397] T ccfb9e44c4aa4059bb843dfa870e5cda P 7fd09b52184c425597059beece124998: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260805 22:47:37.395494 27004 raft_consensus.cc:348] T ccfb9e44c4aa4059bb843dfa870e5cda P 7fd09b52184c425597059beece124998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dcd990050744d38a34e0f692272c33c" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 43355 } } peers { permanent_uuid: "5efee7222d70430aab8d04cd1b357e8a" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 39785 } } peers { permanent_uuid: "7fd09b52184c425597059beece124998" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46871 } }
I20260805 22:47:37.395569 27004 raft_consensus.cc:374] T ccfb9e44c4aa4059bb843dfa870e5cda P 7fd09b52184c425597059beece124998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:37.395588 27004 raft_consensus.cc:729] T ccfb9e44c4aa4059bb843dfa870e5cda P 7fd09b52184c425597059beece124998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fd09b52184c425597059beece124998, State: Initialized, Role: FOLLOWER
I20260805 22:47:37.395646 27005 tablet_bootstrap.cc:492] T ccfb9e44c4aa4059bb843dfa870e5cda P 5efee7222d70430aab8d04cd1b357e8a: No bootstrap required, opened a new log
I20260805 22:47:37.395635 27004 consensus_queue.cc:260] T ccfb9e44c4aa4059bb843dfa870e5cda P 7fd09b52184c425597059beece124998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dcd990050744d38a34e0f692272c33c" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 43355 } } peers { permanent_uuid: "5efee7222d70430aab8d04cd1b357e8a" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 39785 } } peers { permanent_uuid: "7fd09b52184c425597059beece124998" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46871 } }
I20260805 22:47:37.395685 27005 ts_tablet_manager.cc:1397] T ccfb9e44c4aa4059bb843dfa870e5cda P 5efee7222d70430aab8d04cd1b357e8a: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260805 22:47:37.395738 27004 ts_tablet_manager.cc:1428] T ccfb9e44c4aa4059bb843dfa870e5cda P 7fd09b52184c425597059beece124998: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:37.395814 27011 tablet_bootstrap.cc:492] T ccfb9e44c4aa4059bb843dfa870e5cda P 6dcd990050744d38a34e0f692272c33c: No bootstrap required, opened a new log
I20260805 22:47:37.395792 27005 raft_consensus.cc:348] T ccfb9e44c4aa4059bb843dfa870e5cda P 5efee7222d70430aab8d04cd1b357e8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dcd990050744d38a34e0f692272c33c" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 43355 } } peers { permanent_uuid: "5efee7222d70430aab8d04cd1b357e8a" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 39785 } } peers { permanent_uuid: "7fd09b52184c425597059beece124998" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46871 } }
I20260805 22:47:37.395852 27005 raft_consensus.cc:374] T ccfb9e44c4aa4059bb843dfa870e5cda P 5efee7222d70430aab8d04cd1b357e8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:37.395860 27011 ts_tablet_manager.cc:1397] T ccfb9e44c4aa4059bb843dfa870e5cda P 6dcd990050744d38a34e0f692272c33c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260805 22:47:37.395870 27005 raft_consensus.cc:729] T ccfb9e44c4aa4059bb843dfa870e5cda P 5efee7222d70430aab8d04cd1b357e8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5efee7222d70430aab8d04cd1b357e8a, State: Initialized, Role: FOLLOWER
I20260805 22:47:37.395923 27005 consensus_queue.cc:260] T ccfb9e44c4aa4059bb843dfa870e5cda P 5efee7222d70430aab8d04cd1b357e8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dcd990050744d38a34e0f692272c33c" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 43355 } } peers { permanent_uuid: "5efee7222d70430aab8d04cd1b357e8a" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 39785 } } peers { permanent_uuid: "7fd09b52184c425597059beece124998" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46871 } }
I20260805 22:47:37.396003 27005 ts_tablet_manager.cc:1428] T ccfb9e44c4aa4059bb843dfa870e5cda P 5efee7222d70430aab8d04cd1b357e8a: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:37.395967 27011 raft_consensus.cc:348] T ccfb9e44c4aa4059bb843dfa870e5cda P 6dcd990050744d38a34e0f692272c33c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dcd990050744d38a34e0f692272c33c" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 43355 } } peers { permanent_uuid: "5efee7222d70430aab8d04cd1b357e8a" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 39785 } } peers { permanent_uuid: "7fd09b52184c425597059beece124998" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46871 } }
I20260805 22:47:37.396034 27011 raft_consensus.cc:374] T ccfb9e44c4aa4059bb843dfa870e5cda P 6dcd990050744d38a34e0f692272c33c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:37.396054 27011 raft_consensus.cc:729] T ccfb9e44c4aa4059bb843dfa870e5cda P 6dcd990050744d38a34e0f692272c33c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6dcd990050744d38a34e0f692272c33c, State: Initialized, Role: FOLLOWER
I20260805 22:47:37.396090 27011 consensus_queue.cc:260] T ccfb9e44c4aa4059bb843dfa870e5cda P 6dcd990050744d38a34e0f692272c33c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dcd990050744d38a34e0f692272c33c" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 43355 } } peers { permanent_uuid: "5efee7222d70430aab8d04cd1b357e8a" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 39785 } } peers { permanent_uuid: "7fd09b52184c425597059beece124998" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46871 } }
I20260805 22:47:37.396168 27011 ts_tablet_manager.cc:1428] T ccfb9e44c4aa4059bb843dfa870e5cda P 6dcd990050744d38a34e0f692272c33c: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:37.705533 27090 raft_consensus.cc:482] T ccfb9e44c4aa4059bb843dfa870e5cda P 7fd09b52184c425597059beece124998 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:47:37.705651 27090 raft_consensus.cc:504] T ccfb9e44c4aa4059bb843dfa870e5cda P 7fd09b52184c425597059beece124998 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dcd990050744d38a34e0f692272c33c" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 43355 } } peers { permanent_uuid: "5efee7222d70430aab8d04cd1b357e8a" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 39785 } } peers { permanent_uuid: "7fd09b52184c425597059beece124998" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46871 } }
I20260805 22:47:37.705806 27090 leader_election.cc:288] T ccfb9e44c4aa4059bb843dfa870e5cda P 7fd09b52184c425597059beece124998 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6dcd990050744d38a34e0f692272c33c (127.14.224.129:43355), 5efee7222d70430aab8d04cd1b357e8a (127.14.224.130:39785)
I20260805 22:47:37.706070 26455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ccfb9e44c4aa4059bb843dfa870e5cda" candidate_uuid: "7fd09b52184c425597059beece124998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dcd990050744d38a34e0f692272c33c" is_pre_election: true
I20260805 22:47:37.706066 26667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ccfb9e44c4aa4059bb843dfa870e5cda" candidate_uuid: "7fd09b52184c425597059beece124998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5efee7222d70430aab8d04cd1b357e8a" is_pre_election: true
I20260805 22:47:37.706171 26667 raft_consensus.cc:2454] T ccfb9e44c4aa4059bb843dfa870e5cda P 5efee7222d70430aab8d04cd1b357e8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7fd09b52184c425597059beece124998 in term 0.
I20260805 22:47:37.706171 26455 raft_consensus.cc:2454] T ccfb9e44c4aa4059bb843dfa870e5cda P 6dcd990050744d38a34e0f692272c33c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7fd09b52184c425597059beece124998 in term 0.
I20260805 22:47:37.706329 26774 leader_election.cc:302] T ccfb9e44c4aa4059bb843dfa870e5cda P 7fd09b52184c425597059beece124998 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5efee7222d70430aab8d04cd1b357e8a, 7fd09b52184c425597059beece124998; no voters:
I20260805 22:47:37.706456 27090 raft_consensus.cc:2781] T ccfb9e44c4aa4059bb843dfa870e5cda P 7fd09b52184c425597059beece124998 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:47:37.706502 27090 raft_consensus.cc:482] T ccfb9e44c4aa4059bb843dfa870e5cda P 7fd09b52184c425597059beece124998 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:47:37.706519 27090 raft_consensus.cc:3037] T ccfb9e44c4aa4059bb843dfa870e5cda P 7fd09b52184c425597059beece124998 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:37.707418 27090 raft_consensus.cc:504] T ccfb9e44c4aa4059bb843dfa870e5cda P 7fd09b52184c425597059beece124998 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dcd990050744d38a34e0f692272c33c" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 43355 } } peers { permanent_uuid: "5efee7222d70430aab8d04cd1b357e8a" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 39785 } } peers { permanent_uuid: "7fd09b52184c425597059beece124998" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46871 } }
I20260805 22:47:37.707556 27090 leader_election.cc:288] T ccfb9e44c4aa4059bb843dfa870e5cda P 7fd09b52184c425597059beece124998 [CANDIDATE]: Term 1 election: Requested vote from peers 6dcd990050744d38a34e0f692272c33c (127.14.224.129:43355), 5efee7222d70430aab8d04cd1b357e8a (127.14.224.130:39785)
I20260805 22:47:37.707732 26455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ccfb9e44c4aa4059bb843dfa870e5cda" candidate_uuid: "7fd09b52184c425597059beece124998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dcd990050744d38a34e0f692272c33c"
I20260805 22:47:37.707731 26667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ccfb9e44c4aa4059bb843dfa870e5cda" candidate_uuid: "7fd09b52184c425597059beece124998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5efee7222d70430aab8d04cd1b357e8a"
I20260805 22:47:37.707818 26667 raft_consensus.cc:3037] T ccfb9e44c4aa4059bb843dfa870e5cda P 5efee7222d70430aab8d04cd1b357e8a [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:37.707818 26455 raft_consensus.cc:3037] T ccfb9e44c4aa4059bb843dfa870e5cda P 6dcd990050744d38a34e0f692272c33c [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:37.708586 26667 raft_consensus.cc:2454] T ccfb9e44c4aa4059bb843dfa870e5cda P 5efee7222d70430aab8d04cd1b357e8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fd09b52184c425597059beece124998 in term 1.
I20260805 22:47:37.708586 26455 raft_consensus.cc:2454] T ccfb9e44c4aa4059bb843dfa870e5cda P 6dcd990050744d38a34e0f692272c33c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fd09b52184c425597059beece124998 in term 1.
I20260805 22:47:37.708810 26778 leader_election.cc:302] T ccfb9e44c4aa4059bb843dfa870e5cda P 7fd09b52184c425597059beece124998 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6dcd990050744d38a34e0f692272c33c, 7fd09b52184c425597059beece124998; no voters:
I20260805 22:47:37.708981 27090 raft_consensus.cc:2781] T ccfb9e44c4aa4059bb843dfa870e5cda P 7fd09b52184c425597059beece124998 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:47:37.709053 27090 raft_consensus.cc:686] T ccfb9e44c4aa4059bb843dfa870e5cda P 7fd09b52184c425597059beece124998 [term 1 LEADER]: Becoming Leader. State: Replica: 7fd09b52184c425597059beece124998, State: Running, Role: LEADER
I20260805 22:47:37.709110 27090 consensus_queue.cc:237] T ccfb9e44c4aa4059bb843dfa870e5cda P 7fd09b52184c425597059beece124998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dcd990050744d38a34e0f692272c33c" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 43355 } } peers { permanent_uuid: "5efee7222d70430aab8d04cd1b357e8a" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 39785 } } peers { permanent_uuid: "7fd09b52184c425597059beece124998" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46871 } }
I20260805 22:47:37.709702 26231 catalog_manager.cc:5495] T ccfb9e44c4aa4059bb843dfa870e5cda P 7fd09b52184c425597059beece124998 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7fd09b52184c425597059beece124998 (127.14.224.131). New cstate: current_term: 1 leader_uuid: "7fd09b52184c425597059beece124998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dcd990050744d38a34e0f692272c33c" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 43355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5efee7222d70430aab8d04cd1b357e8a" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 39785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7fd09b52184c425597059beece124998" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46871 } health_report { overall_health: HEALTHY } } }
I20260805 22:47:37.754499 27139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:37.752295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56414 (local address 127.14.224.131:46871)
0805 22:47:37.752393 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:37.752395 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:37.752402 (+ 7us) server_negotiation.cc:407] Connection header received
0805 22:47:37.752423 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:37.752424 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:37.752436 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:37.752489 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:47:37.752619 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:37.753110 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:37.753833 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:37.754055 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:37.754120 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:37.754251 (+ 131us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:47:37.754287 (+ 36us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:47:37.754328 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:37.754390 (+ 62us) server_negotiation.cc:299] Negotiation successful
0805 22:47:37.754412 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79,"thread_start_us":49,"threads_started":1}
I20260805 22:47:37.759081 27143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:37.756569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.131:46871 (local address 127.14.224.131:46135)
0805 22:47:37.756706 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:37.756717 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:37.756779 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:37.756890 (+ 111us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:37.756890 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:37.756892 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0805 22:47:37.757015 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:37.757020 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:37.757810 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:37.757812 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:37.758374 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:37.758375 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:37.758708 (+ 333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:37.758709 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:37.758761 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:37.758766 (+ 5us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0805 22:47:37.758902 (+ 136us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0805 22:47:37.758904 (+ 2us) client_negotiation.cc:769] Sending connection context
0805 22:47:37.758946 (+ 42us) client_negotiation.cc:240] Negotiation successful
0805 22:47:37.758993 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":90,"threads_started":1}
I20260805 22:47:37.759081 27139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:37.756687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:46135 (local address 127.14.224.131:46871)
0805 22:47:37.756762 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:37.756764 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:37.756773 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:47:37.756831 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:37.756831 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:37.756843 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:37.756887 (+ 44us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:47:37.757193 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:37.757733 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:37.758454 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:37.758643 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:37.758704 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:37.758824 (+ 120us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:47:37.758856 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:47:37.758897 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:37.758948 (+ 51us) server_negotiation.cc:299] Negotiation successful
0805 22:47:37.758974 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":57}
I20260805 22:47:37.761230 26667 raft_consensus.cc:1261] T ccfb9e44c4aa4059bb843dfa870e5cda P 5efee7222d70430aab8d04cd1b357e8a [term 1 FOLLOWER]: Refusing update from remote peer 7fd09b52184c425597059beece124998: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:47:37.761322 26455 raft_consensus.cc:1261] T ccfb9e44c4aa4059bb843dfa870e5cda P 6dcd990050744d38a34e0f692272c33c [term 1 FOLLOWER]: Refusing update from remote peer 7fd09b52184c425597059beece124998: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:47:37.761507 27072 consensus_queue.cc:1035] T ccfb9e44c4aa4059bb843dfa870e5cda P 7fd09b52184c425597059beece124998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5efee7222d70430aab8d04cd1b357e8a" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 39785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:47:37.761638 27138 consensus_queue.cc:1035] T ccfb9e44c4aa4059bb843dfa870e5cda P 7fd09b52184c425597059beece124998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6dcd990050744d38a34e0f692272c33c" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 43355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:47:37.772569 26231 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43428:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:47:37.772708 26231 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43428:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:47:37.773444 26231 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 333128fd1e8147f594934b3f9a75e602: Sending DeleteTablet for 3 replicas of tablet ccfb9e44c4aa4059bb843dfa870e5cda
I20260805 22:47:37.773736 26633 tablet_service.cc:1514] Processing DeleteTablet for tablet ccfb9e44c4aa4059bb843dfa870e5cda with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:47:37 UTC) from {username='oryx', principal='oryx/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:52512
I20260805 22:47:37.773748 26428 tablet_service.cc:1514] Processing DeleteTablet for tablet ccfb9e44c4aa4059bb843dfa870e5cda with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:47:37 UTC) from {username='oryx', principal='oryx/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:49956
I20260805 22:47:37.773846 27040 tablet_replica.cc:330] T ccfb9e44c4aa4059bb843dfa870e5cda P 6dcd990050744d38a34e0f692272c33c: stopping tablet replica
I20260805 22:47:37.773900 27040 raft_consensus.cc:2229] T ccfb9e44c4aa4059bb843dfa870e5cda P 6dcd990050744d38a34e0f692272c33c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:47:37.773952 27040 raft_consensus.cc:2258] T ccfb9e44c4aa4059bb843dfa870e5cda P 6dcd990050744d38a34e0f692272c33c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:47:37.773998 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 26339
I20260805 22:47:37.780637 26852 tablet_service.cc:1514] Processing DeleteTablet for tablet ccfb9e44c4aa4059bb843dfa870e5cda with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:47:37 UTC) from {username='oryx', principal='oryx/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:56390
I20260805 22:47:37.780829 27041 tablet_replica.cc:330] T ccfb9e44c4aa4059bb843dfa870e5cda P 7fd09b52184c425597059beece124998: stopping tablet replica
I20260805 22:47:37.780917 27041 raft_consensus.cc:2229] T ccfb9e44c4aa4059bb843dfa870e5cda P 7fd09b52184c425597059beece124998 [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:47:37.781060 27041 raft_consensus.cc:2258] T ccfb9e44c4aa4059bb843dfa870e5cda P 7fd09b52184c425597059beece124998 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:47:37.781415 27041 ts_tablet_manager.cc:1905] T ccfb9e44c4aa4059bb843dfa870e5cda P 7fd09b52184c425597059beece124998: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:47:37.782989 27041 ts_tablet_manager.cc:1918] T ccfb9e44c4aa4059bb843dfa870e5cda P 7fd09b52184c425597059beece124998: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260805 22:47:37.783071 27041 log.cc:1196] T ccfb9e44c4aa4059bb843dfa870e5cda P 7fd09b52184c425597059beece124998: Deleting WAL directory at /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/ts-2/wal/wals/ccfb9e44c4aa4059bb843dfa870e5cda
I20260805 22:47:37.783311 27041 ts_tablet_manager.cc:1939] T ccfb9e44c4aa4059bb843dfa870e5cda P 7fd09b52184c425597059beece124998: Deleting consensus metadata
I20260805 22:47:37.783293 27039 tablet_replica.cc:330] T ccfb9e44c4aa4059bb843dfa870e5cda P 5efee7222d70430aab8d04cd1b357e8a: stopping tablet replica
I20260805 22:47:37.783376 27039 raft_consensus.cc:2229] T ccfb9e44c4aa4059bb843dfa870e5cda P 5efee7222d70430aab8d04cd1b357e8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:47:37.783438 27039 raft_consensus.cc:2258] T ccfb9e44c4aa4059bb843dfa870e5cda P 5efee7222d70430aab8d04cd1b357e8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:47:37.783735 26210 catalog_manager.cc:4841] TS 7fd09b52184c425597059beece124998 (127.14.224.131:46871): tablet ccfb9e44c4aa4059bb843dfa870e5cda (table test-table [id=1293bac3d24b47e7a216003d3def5e43]) successfully deleted
I20260805 22:47:37.787550 27039 ts_tablet_manager.cc:1905] T ccfb9e44c4aa4059bb843dfa870e5cda P 5efee7222d70430aab8d04cd1b357e8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:47:37.789017 27039 ts_tablet_manager.cc:1918] T ccfb9e44c4aa4059bb843dfa870e5cda P 5efee7222d70430aab8d04cd1b357e8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260805 22:47:37.789194 27039 log.cc:1196] T ccfb9e44c4aa4059bb843dfa870e5cda P 5efee7222d70430aab8d04cd1b357e8a: Deleting WAL directory at /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970021300824-15234-0/minicluster-data/ts-1/wal/wals/ccfb9e44c4aa4059bb843dfa870e5cda
I20260805 22:47:37.789427 27039 ts_tablet_manager.cc:1939] T ccfb9e44c4aa4059bb843dfa870e5cda P 5efee7222d70430aab8d04cd1b357e8a: Deleting consensus metadata
I20260805 22:47:37.789853 26209 catalog_manager.cc:4841] TS 5efee7222d70430aab8d04cd1b357e8a (127.14.224.130:39785): tablet ccfb9e44c4aa4059bb843dfa870e5cda (table test-table [id=1293bac3d24b47e7a216003d3def5e43]) successfully deleted
W20260805 22:47:37.790154 26214 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.224.129:43355 (error 108)
I20260805 22:47:37.790808 27154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:37.790595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.129:43355 (local address 127.0.0.1:49992)
0805 22:47:37.790711 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:37.790763 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.129:43355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":60,"threads_started":1}
I20260805 22:47:37.790804 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 26542
W20260805 22:47:37.797004 26214 catalog_manager.cc:4584] TS 6dcd990050744d38a34e0f692272c33c (127.14.224.129:43355): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ccfb9e44c4aa4059bb843dfa870e5cda: Network error: Client connection negotiation failed: client connection to 127.14.224.129:43355: connect: Connection refused (error 111)
I20260805 22:47:37.803658 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 26743
I20260805 22:47:37.821839 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 26185
2026-08-05T22:47:37Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3328 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785970021300824-15234-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:47:37 dist-test-slave-gjrz krb5kdc[27160](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:47:37 dist-test-slave-gjrz krb5kdc[27160](info): set up 2 sockets
Aug 05 22:47:37 dist-test-slave-gjrz krb5kdc[27160](info): commencing operation
krb5kdc: starting...
W20260805 22:47:38.957986 15234 mini_kdc.cc:121] Time spent starting KDC: real 1.112s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Aug 05 22:47:39 dist-test-slave-gjrz krb5kdc[27160](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970059, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:47:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:47:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.224.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab.
Entry for principal kudu/127.14.224.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab.
I20260805 22:47:39.082996 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785970021300824-15234-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785970021300824-15234-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785970021300824-15234-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:37117
--webserver_interface=127.14.224.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:35559
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.224.190:37117
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:47:39.168493 27177 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:39.168730 27177 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:39.168754 27177 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:39.169941 27177 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:47:39.169982 27177 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:39.169996 27177 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:39.170007 27177 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:47:39.170017 27177 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:47:39.171631 27177 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:35559
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785970021300824-15234-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785970021300824-15234-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.224.190:37117
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:37117
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.224.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27177
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785970021300824-15234-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:39.171880 27177 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:39.172076 27177 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:39.177567 27186 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:39.177569 27185 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:39.177603 27177 server_base.cc:1034] running on GCE node
W20260805 22:47:39.177579 27188 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:39.178133 27177 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:39.178459 27177 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:39.179670 27177 hybrid_clock.cc:648] HybridClock initialized: now 1785970059179651 us; error 37 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-05T22:47:39Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1355 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:47:39 dist-test-slave-gjrz krb5kdc[27197](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:47:39 dist-test-slave-gjrz krb5kdc[27197](info): set up 2 sockets
Aug 05 22:47:39 dist-test-slave-gjrz krb5kdc[27197](info): commencing operation
krb5kdc: starting...
W20260805 22:47:40.315390 15234 mini_kdc.cc:121] Time spent starting KDC: real 1.114s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Aug 05 22:47:40 dist-test-slave-gjrz krb5kdc[27197](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970060, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:47:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:47:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.224.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab.
Entry for principal kudu/127.14.224.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab.
I20260805 22:47:40.444087 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:42185
--webserver_interface=127.14.224.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:41827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.224.190:42185
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:47:40.527585 27216 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:40.527810 27216 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:40.527841 27216 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:40.529003 27216 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:47:40.529049 27216 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:40.529068 27216 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:40.529084 27216 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:47:40.529099 27216 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:47:40.530617 27216 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:41827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.224.190:42185
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:42185
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.224.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27216
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:40.530874 27216 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:40.531088 27216 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:40.535933 27224 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:40.535936 27226 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:40.535936 27223 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:40.536177 27216 server_base.cc:1034] running on GCE node
I20260805 22:47:40.536401 27216 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:40.536697 27216 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:40.537858 27216 hybrid_clock.cc:648] HybridClock initialized: now 1785970060537835 us; error 36 us; skew 500 ppm
Aug 05 22:47:40 dist-test-slave-gjrz krb5kdc[27197](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970060, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:40.545686 27216 init.cc:377] Logged in from keytab as kudu/127.14.224.190@KRBTEST.COM (short username kudu)
I20260805 22:47:40.546182 27216 webserver.cc:460] Webserver started at http://127.14.224.190:36545/ using document root <none> and password file <none>
I20260805 22:47:40.546413 27216 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:40.546469 27216 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:40.546610 27216 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:40.547771 27216 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/master-0/data/instance:
uuid: "30f76d96bc1a45fda29371869d1675db"
format_stamp: "Formatted at 2026-08-05 22:47:40 on dist-test-slave-gjrz"
server_key: "821f925480495d6e4baad7d3bd3e8c0a"
server_key_iv: "ca8af7927127846ddea7a39f7d17ad08"
server_key_version: "encryptionkey@0"
I20260805 22:47:40.548125 27216 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/master-0/wal/instance:
uuid: "30f76d96bc1a45fda29371869d1675db"
format_stamp: "Formatted at 2026-08-05 22:47:40 on dist-test-slave-gjrz"
server_key: "821f925480495d6e4baad7d3bd3e8c0a"
server_key_iv: "ca8af7927127846ddea7a39f7d17ad08"
server_key_version: "encryptionkey@0"
I20260805 22:47:40.549479 27216 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260805 22:47:40.550227 27237 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:40.550410 27216 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:47:40.550511 27216 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/master-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/master-0/wal
uuid: "30f76d96bc1a45fda29371869d1675db"
format_stamp: "Formatted at 2026-08-05 22:47:40 on dist-test-slave-gjrz"
server_key: "821f925480495d6e4baad7d3bd3e8c0a"
server_key_iv: "ca8af7927127846ddea7a39f7d17ad08"
server_key_version: "encryptionkey@0"
I20260805 22:47:40.550585 27216 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:40.564535 27216 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:40.566390 27216 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:40.566517 27216 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:40.570636 27216 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.190:42185
I20260805 22:47:40.570675 27313 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.190:42185 every 8 connection(s)
I20260805 22:47:40.571031 27216 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
I20260805 22:47:40.571973 27314 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:40.574342 27314 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 30f76d96bc1a45fda29371869d1675db: Bootstrap starting.
I20260805 22:47:40.574936 27314 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 30f76d96bc1a45fda29371869d1675db: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:40.575207 27314 log.cc:824] T 00000000000000000000000000000000 P 30f76d96bc1a45fda29371869d1675db: Log is configured to *not* fsync() on all Append() calls
I20260805 22:47:40.575953 27314 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 30f76d96bc1a45fda29371869d1675db: No bootstrap required, opened a new log
I20260805 22:47:40.577610 27314 raft_consensus.cc:348] T 00000000000000000000000000000000 P 30f76d96bc1a45fda29371869d1675db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30f76d96bc1a45fda29371869d1675db" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 42185 } }
I20260805 22:47:40.577768 27314 raft_consensus.cc:374] T 00000000000000000000000000000000 P 30f76d96bc1a45fda29371869d1675db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:40.577790 27314 raft_consensus.cc:729] T 00000000000000000000000000000000 P 30f76d96bc1a45fda29371869d1675db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f76d96bc1a45fda29371869d1675db, State: Initialized, Role: FOLLOWER
I20260805 22:47:40.577930 27314 consensus_queue.cc:260] T 00000000000000000000000000000000 P 30f76d96bc1a45fda29371869d1675db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30f76d96bc1a45fda29371869d1675db" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 42185 } }
I20260805 22:47:40.578009 27314 raft_consensus.cc:388] T 00000000000000000000000000000000 P 30f76d96bc1a45fda29371869d1675db [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:47:40.578033 27314 raft_consensus.cc:482] T 00000000000000000000000000000000 P 30f76d96bc1a45fda29371869d1675db [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:47:40.578063 27314 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 30f76d96bc1a45fda29371869d1675db [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:40.578658 27314 raft_consensus.cc:504] T 00000000000000000000000000000000 P 30f76d96bc1a45fda29371869d1675db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30f76d96bc1a45fda29371869d1675db" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 42185 } }
I20260805 22:47:40.578761 27314 leader_election.cc:302] T 00000000000000000000000000000000 P 30f76d96bc1a45fda29371869d1675db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 30f76d96bc1a45fda29371869d1675db; no voters:
I20260805 22:47:40.578933 27314 leader_election.cc:288] T 00000000000000000000000000000000 P 30f76d96bc1a45fda29371869d1675db [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:47:40.578982 27317 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 30f76d96bc1a45fda29371869d1675db [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:47:40.579154 27317 raft_consensus.cc:686] T 00000000000000000000000000000000 P 30f76d96bc1a45fda29371869d1675db [term 1 LEADER]: Becoming Leader. State: Replica: 30f76d96bc1a45fda29371869d1675db, State: Running, Role: LEADER
I20260805 22:47:40.579212 27314 sys_catalog.cc:564] T 00000000000000000000000000000000 P 30f76d96bc1a45fda29371869d1675db [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:47:40.579253 27317 consensus_queue.cc:237] T 00000000000000000000000000000000 P 30f76d96bc1a45fda29371869d1675db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30f76d96bc1a45fda29371869d1675db" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 42185 } }
I20260805 22:47:40.579839 27318 sys_catalog.cc:455] T 00000000000000000000000000000000 P 30f76d96bc1a45fda29371869d1675db [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "30f76d96bc1a45fda29371869d1675db" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30f76d96bc1a45fda29371869d1675db" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 42185 } } }
I20260805 22:47:40.579847 27322 sys_catalog.cc:455] T 00000000000000000000000000000000 P 30f76d96bc1a45fda29371869d1675db [sys.catalog]: SysCatalogTable state changed. Reason: New leader 30f76d96bc1a45fda29371869d1675db. Latest consensus state: current_term: 1 leader_uuid: "30f76d96bc1a45fda29371869d1675db" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30f76d96bc1a45fda29371869d1675db" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 42185 } } }
I20260805 22:47:40.580029 27318 sys_catalog.cc:458] T 00000000000000000000000000000000 P 30f76d96bc1a45fda29371869d1675db [sys.catalog]: This master's current role is: LEADER
I20260805 22:47:40.580056 27322 sys_catalog.cc:458] T 00000000000000000000000000000000 P 30f76d96bc1a45fda29371869d1675db [sys.catalog]: This master's current role is: LEADER
I20260805 22:47:40.580229 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 27216
I20260805 22:47:40.580338 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/master-0/wal/instance
I20260805 22:47:40.580416 27336 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:47:40.580547 15234 external_mini_cluster.cc:1428] Setting key a835b87eaa6377446180fdf99714a620
I20260805 22:47:40.580938 27336 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:47:40.582618 27336 catalog_manager.cc:1347] Generated new cluster ID: 58e3ad3491124323b760dd3ef1d9ed2d
I20260805 22:47:40.582671 27336 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 05 22:47:40 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970060, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:47:40.593464 27348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:40.581218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59598 (local address 127.14.224.190:42185)
0805 22:47:40.581381 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:40.581391 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:40.581955 (+ 564us) server_negotiation.cc:407] Connection header received
0805 22:47:40.582088 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:40.582095 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:40.582161 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:40.582286 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:40.583066 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:40.584601 (+ 1535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:40.585710 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:40.586312 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:40.586418 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:40.589397 (+ 2979us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:40.589404 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:40.589405 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:40.589427 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:40.591547 (+ 2120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:40.591950 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:40.591954 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:40.591954 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:40.592080 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:40.592290 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:40.592291 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:40.592291 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:40.592643 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:40.592802 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:40.592926 (+ 124us) server_negotiation.cc:299] Negotiation successful
0805 22:47:40.593195 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":70,"threads_started":1}
I20260805 22:47:40.602886 27336 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:47:40.603706 27336 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:47:40.610453 27336 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 30f76d96bc1a45fda29371869d1675db: Generated new TSK 0
I20260805 22:47:40.610703 27336 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.224.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab.
Entry for principal kudu/127.14.224.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab.
I20260805 22:47:40.642565 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.129:0
--local_ip_for_outbound_sockets=127.14.224.129
--webserver_interface=127.14.224.129
--webserver_port=0
--tserver_master_addrs=127.14.224.190:42185
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab
--principal=kudu/127.14.224.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:41827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:47:40.726775 27356 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:40.727026 27356 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:40.727063 27356 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:40.728627 27356 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:40.728701 27356 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:40.728744 27356 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.129
I20260805 22:47:40.730428 27356 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:41827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab
--principal=kudu/127.14.224.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.224.129
--webserver_port=0
--tserver_master_addrs=127.14.224.190:42185
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27356
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.129
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:40.730719 27356 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:40.730955 27356 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:40.736192 27365 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:40.736199 27363 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:40.736279 27356 server_base.cc:1034] running on GCE node
W20260805 22:47:40.736199 27367 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:40.736683 27356 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:40.736960 27356 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:40.738130 27356 hybrid_clock.cc:648] HybridClock initialized: now 1785970060738117 us; error 31 us; skew 500 ppm
Aug 05 22:47:40 dist-test-slave-gjrz krb5kdc[27197](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970060, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:40.740717 27356 init.cc:377] Logged in from keytab as kudu/127.14.224.129@KRBTEST.COM (short username kudu)
I20260805 22:47:40.741197 27356 webserver.cc:460] Webserver started at http://127.14.224.129:44207/ using document root <none> and password file <none>
I20260805 22:47:40.741432 27356 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:40.741483 27356 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:40.741616 27356 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:40.742708 27356 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-0/data/instance:
uuid: "f4b0dffc33d84f4e801808de155eaf6e"
format_stamp: "Formatted at 2026-08-05 22:47:40 on dist-test-slave-gjrz"
server_key: "d6e2d972a2dd44e1ae08107f2eebf1f7"
server_key_iv: "41d76e89a86c29dcbbc3161d655d5dea"
server_key_version: "encryptionkey@0"
I20260805 22:47:40.743070 27356 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-0/wal/instance:
uuid: "f4b0dffc33d84f4e801808de155eaf6e"
format_stamp: "Formatted at 2026-08-05 22:47:40 on dist-test-slave-gjrz"
server_key: "d6e2d972a2dd44e1ae08107f2eebf1f7"
server_key_iv: "41d76e89a86c29dcbbc3161d655d5dea"
server_key_version: "encryptionkey@0"
I20260805 22:47:40.744429 27356 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260805 22:47:40.745131 27378 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:40.745296 27356 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260805 22:47:40.745385 27356 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-0/wal
uuid: "f4b0dffc33d84f4e801808de155eaf6e"
format_stamp: "Formatted at 2026-08-05 22:47:40 on dist-test-slave-gjrz"
server_key: "d6e2d972a2dd44e1ae08107f2eebf1f7"
server_key_iv: "41d76e89a86c29dcbbc3161d655d5dea"
server_key_version: "encryptionkey@0"
I20260805 22:47:40.745460 27356 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:40.758718 27356 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:40.760630 27356 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:40.760780 27356 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:40.761016 27356 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:47:40.761332 27356 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:47:40.761373 27356 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:40.761402 27356 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:47:40.761420 27356 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:40.767184 27356 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.129:38899
I20260805 22:47:40.767230 27548 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.129:38899 every 8 connection(s)
I20260805 22:47:40.767583 27356 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
I20260805 22:47:40.768743 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 27356
I20260805 22:47:40.768832 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-0/wal/instance
I20260805 22:47:40.769038 15234 external_mini_cluster.cc:1428] Setting key fcc8f35888f76ecb84223a5504c1dbdd
Aug 05 22:47:40 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970060, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.129@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:47:40.777443 27348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:40.768343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.129:40785 (local address 127.14.224.190:42185)
0805 22:47:40.768397 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:40.768399 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:40.768942 (+ 543us) server_negotiation.cc:407] Connection header received
0805 22:47:40.769170 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:40.769172 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:40.769185 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:40.769237 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:40.770289 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:40.770796 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:40.771943 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:40.772271 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:40.772331 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:40.774713 (+ 2382us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:40.774715 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:40.774715 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:40.774723 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:40.776111 (+ 1388us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:40.776499 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:40.776500 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:40.776500 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:40.776559 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:40.776786 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:40.776787 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:40.776787 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:40.776911 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:40.776969 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:40.777238 (+ 269us) server_negotiation.cc:299] Negotiation successful
0805 22:47:40.777336 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260805 22:47:40.777599 27554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:40.768305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42185 (local address 127.14.224.129:40785)
0805 22:47:40.768471 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:40.768515 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:40.769069 (+ 554us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:40.769316 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:40.769321 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:40.769987 (+ 666us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:40.770188 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:40.770193 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:40.770889 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:40.770890 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:40.771834 (+ 944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:40.771839 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:40.772344 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:40.772345 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:40.772513 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:40.773033 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:40.773042 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:40.774617 (+ 1575us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:40.776189 (+ 1572us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:40.776197 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:40.776200 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:40.776429 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:40.776612 (+ 183us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:40.776613 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:40.776613 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:40.776729 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:40.776967 (+ 238us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:40.776974 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:40.777117 (+ 143us) client_negotiation.cc:769] Sending connection context
0805 22:47:40.777211 (+ 94us) client_negotiation.cc:240] Negotiation successful
0805 22:47:40.777378 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":95,"threads_started":1}
WARNING: no policy specified for kudu/127.14.224.130@KRBTEST.COM; defaulting to no policy
I20260805 22:47:40.778120 27549 heartbeater.cc:347] Connected to a master server at 127.14.224.190:42185
I20260805 22:47:40.778228 27549 heartbeater.cc:464] Registering TS with master...
I20260805 22:47:40.778414 27549 heartbeater.cc:511] Master 127.14.224.190:42185 requested a full tablet report, sending...
I20260805 22:47:40.778944 27263 ts_manager.cc:194] Registered new tserver with Master: f4b0dffc33d84f4e801808de155eaf6e (127.14.224.129:38899)
I20260805 22:47:40.779664 27263 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.224.129@KRBTEST.COM'} at 127.14.224.129:40785
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab.
Entry for principal kudu/127.14.224.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab.
I20260805 22:47:40.798455 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.130:0
--local_ip_for_outbound_sockets=127.14.224.130
--webserver_interface=127.14.224.130
--webserver_port=0
--tserver_master_addrs=127.14.224.190:42185
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab
--principal=kudu/127.14.224.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:41827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:47:40.883708 27561 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:40.883948 27561 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:40.883992 27561 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:40.885368 27561 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:40.885437 27561 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:40.885478 27561 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.130
I20260805 22:47:40.887145 27561 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:41827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab
--principal=kudu/127.14.224.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.224.130
--webserver_port=0
--tserver_master_addrs=127.14.224.190:42185
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27561
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.130
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:40.887465 27561 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:40.887712 27561 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:40.892939 27569 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:40.893074 27570 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:40.893010 27573 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:40.893211 27561 server_base.cc:1034] running on GCE node
I20260805 22:47:40.893446 27561 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:40.893736 27561 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:40.894892 27561 hybrid_clock.cc:648] HybridClock initialized: now 1785970060894868 us; error 42 us; skew 500 ppm
Aug 05 22:47:40 dist-test-slave-gjrz krb5kdc[27197](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970060, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:40.897563 27561 init.cc:377] Logged in from keytab as kudu/127.14.224.130@KRBTEST.COM (short username kudu)
I20260805 22:47:40.898075 27561 webserver.cc:460] Webserver started at http://127.14.224.130:40697/ using document root <none> and password file <none>
I20260805 22:47:40.898298 27561 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:40.898351 27561 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:40.898495 27561 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:40.899696 27561 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-1/data/instance:
uuid: "b03f7bbd2bfb4c00b977769dd779cff1"
format_stamp: "Formatted at 2026-08-05 22:47:40 on dist-test-slave-gjrz"
server_key: "a5de831f02bb51bdf57dd258be6fdf72"
server_key_iv: "e38b80b05ab4cd0b1b55ab426e8c0115"
server_key_version: "encryptionkey@0"
I20260805 22:47:40.900051 27561 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-1/wal/instance:
uuid: "b03f7bbd2bfb4c00b977769dd779cff1"
format_stamp: "Formatted at 2026-08-05 22:47:40 on dist-test-slave-gjrz"
server_key: "a5de831f02bb51bdf57dd258be6fdf72"
server_key_iv: "e38b80b05ab4cd0b1b55ab426e8c0115"
server_key_version: "encryptionkey@0"
I20260805 22:47:40.901484 27561 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260805 22:47:40.902230 27583 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:40.902439 27561 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:47:40.902540 27561 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-1/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-1/wal
uuid: "b03f7bbd2bfb4c00b977769dd779cff1"
format_stamp: "Formatted at 2026-08-05 22:47:40 on dist-test-slave-gjrz"
server_key: "a5de831f02bb51bdf57dd258be6fdf72"
server_key_iv: "e38b80b05ab4cd0b1b55ab426e8c0115"
server_key_version: "encryptionkey@0"
I20260805 22:47:40.902626 27561 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:40.931710 27561 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:40.933949 27561 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:40.934080 27561 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:40.934329 27561 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:47:40.934736 27561 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:47:40.934777 27561 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:40.934800 27561 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:47:40.934811 27561 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:40.940423 27561 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.130:45629
I20260805 22:47:40.940481 27760 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.130:45629 every 8 connection(s)
I20260805 22:47:40.940793 27561 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
I20260805 22:47:40.944976 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 27561
I20260805 22:47:40.945077 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-1/wal/instance
I20260805 22:47:40.945312 15234 external_mini_cluster.cc:1428] Setting key 8ff4a93528917b97df57f8729445f558
Aug 05 22:47:40 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970060, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.130@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:47:40.950621 27348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:40.941731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:53741 (local address 127.14.224.190:42185)
0805 22:47:40.941794 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:40.941797 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:40.941807 (+ 10us) server_negotiation.cc:407] Connection header received
0805 22:47:40.942320 (+ 513us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:40.942322 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:40.942338 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:40.942394 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:40.943387 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:40.943880 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:40.944868 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:40.945064 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:40.945120 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:40.947548 (+ 2428us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:40.947550 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:40.947550 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:40.947557 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:40.949096 (+ 1539us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:40.949589 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:40.949590 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:40.949590 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:40.949660 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:40.949888 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:40.949889 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:40.949889 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:40.950031 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:40.950097 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:40.950411 (+ 314us) server_negotiation.cc:299] Negotiation successful
0805 22:47:40.950532 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260805 22:47:40.950700 27764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:40.941498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42185 (local address 127.14.224.130:53741)
0805 22:47:40.941674 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:40.941710 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:40.942221 (+ 511us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:40.942481 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:40.942486 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:40.943073 (+ 587us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:40.943292 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:40.943299 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:40.943964 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:40.943965 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:40.944786 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:40.944788 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:40.945155 (+ 367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:40.945157 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:40.945323 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:40.945836 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:40.945845 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:40.947367 (+ 1522us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:40.949189 (+ 1822us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:40.949197 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:40.949199 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:40.949517 (+ 318us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:40.949725 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:40.949725 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:40.949726 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:40.949833 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:40.950119 (+ 286us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:40.950125 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:40.950262 (+ 137us) client_negotiation.cc:769] Sending connection context
0805 22:47:40.950362 (+ 100us) client_negotiation.cc:240] Negotiation successful
0805 22:47:40.950514 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":93,"threads_started":1}
I20260805 22:47:40.951506 27761 heartbeater.cc:347] Connected to a master server at 127.14.224.190:42185
I20260805 22:47:40.951627 27761 heartbeater.cc:464] Registering TS with master...
I20260805 22:47:40.951839 27761 heartbeater.cc:511] Master 127.14.224.190:42185 requested a full tablet report, sending...
I20260805 22:47:40.952325 27263 ts_manager.cc:194] Registered new tserver with Master: b03f7bbd2bfb4c00b977769dd779cff1 (127.14.224.130:45629)
I20260805 22:47:40.952705 27263 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.224.130@KRBTEST.COM'} at 127.14.224.130:53741
WARNING: no policy specified for kudu/127.14.224.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab.
Entry for principal kudu/127.14.224.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab.
I20260805 22:47:40.973745 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.131:0
--local_ip_for_outbound_sockets=127.14.224.131
--webserver_interface=127.14.224.131
--webserver_port=0
--tserver_master_addrs=127.14.224.190:42185
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab
--principal=kudu/127.14.224.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:41827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:47:41.059196 27772 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:41.059475 27772 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:41.059514 27772 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:41.060832 27772 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:41.060886 27772 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:41.060926 27772 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.131
I20260805 22:47:41.062539 27772 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:41827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab
--principal=kudu/127.14.224.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.224.131
--webserver_port=0
--tserver_master_addrs=127.14.224.190:42185
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27772
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.131
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:41.062808 27772 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:41.063046 27772 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:41.068192 27779 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:41.068192 27784 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:41.068269 27780 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:41.068578 27772 server_base.cc:1034] running on GCE node
I20260805 22:47:41.068830 27772 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:41.069072 27772 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:41.070246 27772 hybrid_clock.cc:648] HybridClock initialized: now 1785970061070229 us; error 31 us; skew 500 ppm
Aug 05 22:47:41 dist-test-slave-gjrz krb5kdc[27197](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970061, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:41.073083 27772 init.cc:377] Logged in from keytab as kudu/127.14.224.131@KRBTEST.COM (short username kudu)
I20260805 22:47:41.073568 27772 webserver.cc:460] Webserver started at http://127.14.224.131:34065/ using document root <none> and password file <none>
I20260805 22:47:41.073809 27772 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:41.073863 27772 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:41.074004 27772 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:41.075088 27772 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-2/data/instance:
uuid: "6133ed593a6d4f03b409add7b51a322c"
format_stamp: "Formatted at 2026-08-05 22:47:41 on dist-test-slave-gjrz"
server_key: "6df8ed6a822093bccd5ae5671348b1e7"
server_key_iv: "f48ba1a900415cb7a923c99eaa7bc335"
server_key_version: "encryptionkey@0"
I20260805 22:47:41.075484 27772 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-2/wal/instance:
uuid: "6133ed593a6d4f03b409add7b51a322c"
format_stamp: "Formatted at 2026-08-05 22:47:41 on dist-test-slave-gjrz"
server_key: "6df8ed6a822093bccd5ae5671348b1e7"
server_key_iv: "f48ba1a900415cb7a923c99eaa7bc335"
server_key_version: "encryptionkey@0"
I20260805 22:47:41.076974 27772 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:47:41.077813 27796 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:41.077996 27772 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260805 22:47:41.078083 27772 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-2/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-2/wal
uuid: "6133ed593a6d4f03b409add7b51a322c"
format_stamp: "Formatted at 2026-08-05 22:47:41 on dist-test-slave-gjrz"
server_key: "6df8ed6a822093bccd5ae5671348b1e7"
server_key_iv: "f48ba1a900415cb7a923c99eaa7bc335"
server_key_version: "encryptionkey@0"
I20260805 22:47:41.078156 27772 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:41.102689 27772 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:41.104728 27772 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:41.104878 27772 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:41.105134 27772 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:47:41.105456 27772 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:47:41.105492 27772 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:41.105521 27772 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:47:41.105542 27772 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:41.111490 27772 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.131:35171
I20260805 22:47:41.111543 27969 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.131:35171 every 8 connection(s)
I20260805 22:47:41.111876 27772 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
Aug 05 22:47:41 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970061, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.131@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:47:41.119844 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 27772
I20260805 22:47:41.119942 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-2/wal/instance
I20260805 22:47:41.120124 15234 external_mini_cluster.cc:1428] Setting key 47d2c740a80ab996e770cf4d39629bcd
I20260805 22:47:41.121277 27348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:41.112589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:34315 (local address 127.14.224.190:42185)
0805 22:47:41.112647 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:41.112649 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:41.112854 (+ 205us) server_negotiation.cc:407] Connection header received
0805 22:47:41.113424 (+ 570us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:41.113426 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:41.113439 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:41.113492 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:41.114497 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:41.115013 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:41.116088 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:41.116279 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:41.116336 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:41.118462 (+ 2126us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:41.118464 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:41.118464 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:41.118473 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:41.119782 (+ 1309us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:41.120244 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:41.120246 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:41.120246 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:41.120315 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:41.120610 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:41.120611 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:41.120611 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:41.120735 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:41.120797 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:41.121089 (+ 292us) server_negotiation.cc:299] Negotiation successful
0805 22:47:41.121186 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260805 22:47:41.121443 27973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:41.112556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42185 (local address 127.14.224.131:34315)
0805 22:47:41.112719 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:41.112759 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:41.113308 (+ 549us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:41.113578 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:41.113582 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:41.114178 (+ 596us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:41.114387 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:41.114392 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:41.115108 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:41.115109 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:41.115988 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:41.115991 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:41.116354 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:41.116355 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:41.116482 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:41.116971 (+ 489us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:41.116979 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:41.118366 (+ 1387us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:41.119861 (+ 1495us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:41.119870 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:41.119872 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:41.120139 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:41.120386 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:41.120387 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:41.120387 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:41.120546 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:41.120794 (+ 248us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:41.120801 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:41.120943 (+ 142us) client_negotiation.cc:769] Sending connection context
0805 22:47:41.121055 (+ 112us) client_negotiation.cc:240] Negotiation successful
0805 22:47:41.121225 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":74,"threads_started":1}
I20260805 22:47:41.121891 27970 heartbeater.cc:347] Connected to a master server at 127.14.224.190:42185
I20260805 22:47:41.122005 27970 heartbeater.cc:464] Registering TS with master...
I20260805 22:47:41.122197 27970 heartbeater.cc:511] Master 127.14.224.190:42185 requested a full tablet report, sending...
I20260805 22:47:41.122558 27263 ts_manager.cc:194] Registered new tserver with Master: 6133ed593a6d4f03b409add7b51a322c (127.14.224.131:35171)
I20260805 22:47:41.122926 27263 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.224.131@KRBTEST.COM'} at 127.14.224.131:34315
I20260805 22:47:41.131884 15234 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.14.224.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.14.224.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.14.224.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/krb5kdc/oryx_127.14.224.129.keytab.
Entry for principal oryx/127.14.224.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/krb5kdc/oryx_127.14.224.129.keytab.
WARNING: no policy specified for oryx/127.14.224.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.14.224.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.14.224.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/krb5kdc/oryx_127.14.224.130.keytab.
Entry for principal oryx/127.14.224.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/krb5kdc/oryx_127.14.224.130.keytab.
WARNING: no policy specified for oryx/127.14.224.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.14.224.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.14.224.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/krb5kdc/oryx_127.14.224.131.keytab.
Entry for principal oryx/127.14.224.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/krb5kdc/oryx_127.14.224.131.keytab.
I20260805 22:47:41.207993 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 27356
I20260805 22:47:41.215041 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 27561
I20260805 22:47:41.225517 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 27772
I20260805 22:47:41.238698 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 27216
I20260805 22:47:41.254078 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:42185
--webserver_interface=127.14.224.190
--webserver_port=36545
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:41827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.224.190:42185
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:47:41.339056 27988 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:41.339318 27988 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:41.339355 27988 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:41.340570 27988 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:47:41.340624 27988 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:41.340643 27988 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:41.340659 27988 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:47:41.340674 27988 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:47:41.342347 27988 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:41827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.224.190:42185
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:42185
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.224.190
--webserver_port=36545
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27988
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:41.342645 27988 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:41.342914 27988 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:41.348045 28000 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:41.348125 27988 server_base.cc:1034] running on GCE node
W20260805 22:47:41.348083 27996 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:41.348066 27994 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:41.348495 27988 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:41.348814 27988 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:41.349979 27988 hybrid_clock.cc:648] HybridClock initialized: now 1785970061349963 us; error 33 us; skew 500 ppm
Aug 05 22:47:41 dist-test-slave-gjrz krb5kdc[27197](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970061, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:41.352667 27988 init.cc:377] Logged in from keytab as kudu/127.14.224.190@KRBTEST.COM (short username kudu)
I20260805 22:47:41.353148 27988 webserver.cc:460] Webserver started at http://127.14.224.190:36545/ using document root <none> and password file <none>
I20260805 22:47:41.353359 27988 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:41.353425 27988 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:41.354933 27988 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:47:41.355729 28008 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:41.355885 27988 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260805 22:47:41.355988 27988 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/master-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/master-0/wal
uuid: "30f76d96bc1a45fda29371869d1675db"
format_stamp: "Formatted at 2026-08-05 22:47:40 on dist-test-slave-gjrz"
server_key: "821f925480495d6e4baad7d3bd3e8c0a"
server_key_iv: "ca8af7927127846ddea7a39f7d17ad08"
server_key_version: "encryptionkey@0"
I20260805 22:47:41.356376 27988 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:41.384369 27988 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:41.386842 27988 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:41.387010 27988 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:41.391161 27988 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.190:42185
I20260805 22:47:41.391207 28099 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.190:42185 every 8 connection(s)
I20260805 22:47:41.391642 27988 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
I20260805 22:47:41.393225 28100 sys_catalog.cc:263] Verifying existing consensus state
I20260805 22:47:41.393887 28100 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 30f76d96bc1a45fda29371869d1675db: Bootstrap starting.
I20260805 22:47:41.400233 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 27988
I20260805 22:47:41.400564 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.129:38899
--local_ip_for_outbound_sockets=127.14.224.129
--tserver_master_addrs=127.14.224.190:42185
--webserver_port=44207
--webserver_interface=127.14.224.129
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab
--principal=kudu/127.14.224.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:41827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.14.224.129
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/krb5kdc/oryx_127.14.224.129.keytab with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 22:47:41.402211 28100 log.cc:824] T 00000000000000000000000000000000 P 30f76d96bc1a45fda29371869d1675db: Log is configured to *not* fsync() on all Append() calls
I20260805 22:47:41.404512 28100 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 30f76d96bc1a45fda29371869d1675db: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260805 22:47:41.404839 28100 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 30f76d96bc1a45fda29371869d1675db: Bootstrap complete.
I20260805 22:47:41.408164 28100 raft_consensus.cc:348] T 00000000000000000000000000000000 P 30f76d96bc1a45fda29371869d1675db [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30f76d96bc1a45fda29371869d1675db" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 42185 } }
I20260805 22:47:41.408537 28100 raft_consensus.cc:729] T 00000000000000000000000000000000 P 30f76d96bc1a45fda29371869d1675db [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f76d96bc1a45fda29371869d1675db, State: Initialized, Role: FOLLOWER
I20260805 22:47:41.408731 28100 consensus_queue.cc:260] T 00000000000000000000000000000000 P 30f76d96bc1a45fda29371869d1675db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30f76d96bc1a45fda29371869d1675db" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 42185 } }
I20260805 22:47:41.408813 28100 raft_consensus.cc:388] T 00000000000000000000000000000000 P 30f76d96bc1a45fda29371869d1675db [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:47:41.408864 28100 raft_consensus.cc:482] T 00000000000000000000000000000000 P 30f76d96bc1a45fda29371869d1675db [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:47:41.408916 28100 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 30f76d96bc1a45fda29371869d1675db [term 1 FOLLOWER]: Advancing to term 2
I20260805 22:47:41.410463 28100 raft_consensus.cc:504] T 00000000000000000000000000000000 P 30f76d96bc1a45fda29371869d1675db [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30f76d96bc1a45fda29371869d1675db" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 42185 } }
I20260805 22:47:41.410597 28100 leader_election.cc:302] T 00000000000000000000000000000000 P 30f76d96bc1a45fda29371869d1675db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 30f76d96bc1a45fda29371869d1675db; no voters:
I20260805 22:47:41.410801 28100 leader_election.cc:288] T 00000000000000000000000000000000 P 30f76d96bc1a45fda29371869d1675db [CANDIDATE]: Term 2 election: Requested vote from peers
I20260805 22:47:41.410867 28108 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 30f76d96bc1a45fda29371869d1675db [term 2 FOLLOWER]: Leader election won for term 2
I20260805 22:47:41.411089 28108 raft_consensus.cc:686] T 00000000000000000000000000000000 P 30f76d96bc1a45fda29371869d1675db [term 2 LEADER]: Becoming Leader. State: Replica: 30f76d96bc1a45fda29371869d1675db, State: Running, Role: LEADER
I20260805 22:47:41.411113 28100 sys_catalog.cc:564] T 00000000000000000000000000000000 P 30f76d96bc1a45fda29371869d1675db [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:47:41.411193 28108 consensus_queue.cc:237] T 00000000000000000000000000000000 P 30f76d96bc1a45fda29371869d1675db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30f76d96bc1a45fda29371869d1675db" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 42185 } }
I20260805 22:47:41.411510 28111 sys_catalog.cc:455] T 00000000000000000000000000000000 P 30f76d96bc1a45fda29371869d1675db [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "30f76d96bc1a45fda29371869d1675db" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30f76d96bc1a45fda29371869d1675db" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 42185 } } }
I20260805 22:47:41.411598 28111 sys_catalog.cc:458] T 00000000000000000000000000000000 P 30f76d96bc1a45fda29371869d1675db [sys.catalog]: This master's current role is: LEADER
I20260805 22:47:41.411770 28112 sys_catalog.cc:455] T 00000000000000000000000000000000 P 30f76d96bc1a45fda29371869d1675db [sys.catalog]: SysCatalogTable state changed. Reason: New leader 30f76d96bc1a45fda29371869d1675db. Latest consensus state: current_term: 2 leader_uuid: "30f76d96bc1a45fda29371869d1675db" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30f76d96bc1a45fda29371869d1675db" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 42185 } } }
I20260805 22:47:41.411839 28112 sys_catalog.cc:458] T 00000000000000000000000000000000 P 30f76d96bc1a45fda29371869d1675db [sys.catalog]: This master's current role is: LEADER
I20260805 22:47:41.412137 28116 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:47:41.412695 28116 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:47:41.412843 28116 catalog_manager.cc:1259] Loaded cluster ID: 58e3ad3491124323b760dd3ef1d9ed2d
I20260805 22:47:41.413005 28116 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:47:41.414285 28116 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:47:41.414474 28116 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 30f76d96bc1a45fda29371869d1675db: Loaded TSK: 0
I20260805 22:47:41.414691 28116 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260805 22:47:41.489228 28102 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:41.489511 28102 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:41.489552 28102 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:41.491120 28102 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:41.491174 28102 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:41.491209 28102 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.129
I20260805 22:47:41.493041 28102 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:41827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/krb5kdc/oryx_127.14.224.129.keytab
--principal=oryx/127.14.224.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.129:38899
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.224.129
--webserver_port=44207
--tserver_master_addrs=127.14.224.190:42185
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28102
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.129
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:41.493533 28102 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:41.493808 28102 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:41.500715 28138 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:41.501220 28102 server_base.cc:1034] running on GCE node
W20260805 22:47:41.500860 28143 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:41.500715 28141 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:41.501649 28102 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:41.501936 28102 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:41.503100 28102 hybrid_clock.cc:648] HybridClock initialized: now 1785970061503077 us; error 39 us; skew 500 ppm
Aug 05 22:47:41 dist-test-slave-gjrz krb5kdc[27197](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970061, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.224.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:41.506635 28102 init.cc:377] Logged in from keytab as oryx/127.14.224.129@KRBTEST.COM (short username oryx)
I20260805 22:47:41.507162 28102 webserver.cc:460] Webserver started at http://127.14.224.129:44207/ using document root <none> and password file <none>
I20260805 22:47:41.507447 28102 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:41.507521 28102 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:41.508929 28102 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:47:41.509526 28151 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:41.509727 28102 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260805 22:47:41.509850 28102 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-0/wal
uuid: "f4b0dffc33d84f4e801808de155eaf6e"
format_stamp: "Formatted at 2026-08-05 22:47:40 on dist-test-slave-gjrz"
server_key: "d6e2d972a2dd44e1ae08107f2eebf1f7"
server_key_iv: "41d76e89a86c29dcbbc3161d655d5dea"
server_key_version: "encryptionkey@0"
I20260805 22:47:41.510330 28102 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:41.530553 28102 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:41.533390 28102 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:41.533566 28102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:41.533856 28102 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:47:41.534260 28102 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:47:41.534310 28102 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:41.534349 28102 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:47:41.534373 28102 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:41.541512 28102 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.129:38899
I20260805 22:47:41.541574 28324 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.129:38899 every 8 connection(s)
I20260805 22:47:41.541990 28102 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
I20260805 22:47:41.547798 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 28102
I20260805 22:47:41.548152 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.130:45629
--local_ip_for_outbound_sockets=127.14.224.130
--tserver_master_addrs=127.14.224.190:42185
--webserver_port=40697
--webserver_interface=127.14.224.130
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab
--principal=kudu/127.14.224.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:41827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.14.224.130
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/krb5kdc/oryx_127.14.224.130.keytab with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 05 22:47:41 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.129@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:47:41 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.129@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:47:41.552085 28330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:41.542795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42185 (local address 127.14.224.129:51433)
0805 22:47:41.542997 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:41.543057 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:41.543736 (+ 679us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:41.544200 (+ 464us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:41.544204 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:41.544962 (+ 758us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:41.545267 (+ 305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:41.545275 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:41.546431 (+ 1156us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:41.546432 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:41.547717 (+ 1285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:41.547721 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:41.548591 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:41.548592 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:41.548737 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:41.549302 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:41.549313 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:41.551855 (+ 2542us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.224.190:42185: Server oryx/127.14.224.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":109,"threads_started":1}
W20260805 22:47:41.552191 28333 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:47:41.542933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.129:51433 (local address 127.14.224.190:42185)
0805 22:47:41.543117 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:41.543124 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:41.543151 (+ 27us) server_negotiation.cc:407] Connection header received
0805 22:47:41.543956 (+ 805us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:41.543962 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:41.544018 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:41.544123 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:41.545407 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:41.546300 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:41.547819 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:41.548477 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:41.548587 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:41.552040 (+ 3453us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.224.129:51433: BlockingRecv error: recv got EOF from 127.14.224.129:51433 (error 108)
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":71,"threads_started":1}
W20260805 22:47:41.552357 28325 heartbeater.cc:644] Failed to heartbeat to 127.14.224.190:42185 (0 consecutive failures): Not authorized: Failed to ping master at 127.14.224.190:42185: Client connection negotiation failed: client connection to 127.14.224.190:42185: Server oryx/127.14.224.190@KRBTEST.COM not found in Kerberos database
Aug 05 22:47:41 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.129@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:47:41 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.129@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:47:41.556890 28330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:41.552588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42185 (local address 127.14.224.129:59421)
0805 22:47:41.552786 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:41.552796 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:41.552837 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:41.553040 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:41.553041 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:41.553173 (+ 132us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:41.553224 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:41.553226 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:41.553876 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:41.553877 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:41.554366 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:41.554367 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:41.554685 (+ 318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:41.554686 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:41.554744 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:41.555139 (+ 395us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:41.555143 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:41.556814 (+ 1671us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.224.190:42185: Server oryx/127.14.224.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":94,"threads_started":1}
W20260805 22:47:41.556978 28333 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:47:41.552881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.129:59421 (local address 127.14.224.190:42185)
0805 22:47:41.552919 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:41.552921 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:41.552928 (+ 7us) server_negotiation.cc:407] Connection header received
0805 22:47:41.552954 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:41.552955 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:41.552966 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:41.553023 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:41.553292 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:41.553803 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:41.554439 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:41.554626 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:41.554680 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:41.556916 (+ 2236us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.224.129:59421: BlockingRecv error: recv got EOF from 127.14.224.129:59421 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
Aug 05 22:47:41 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.129@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:47:41 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.129@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:47:41.561195 28330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:41.557145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42185 (local address 127.14.224.129:35781)
0805 22:47:41.557196 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:41.557205 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:41.557243 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:41.557373 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:41.557374 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:41.557501 (+ 127us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:41.557534 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:41.557536 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:41.558128 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:41.558129 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:41.558612 (+ 483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:41.558613 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:41.558915 (+ 302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:41.558916 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:41.558963 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:41.559400 (+ 437us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:41.559405 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:41.561126 (+ 1721us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.224.190:42185: Server oryx/127.14.224.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":39}
W20260805 22:47:41.561268 28333 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:47:41.557193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.129:35781 (local address 127.14.224.190:42185)
0805 22:47:41.557229 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:41.557230 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:41.557239 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:47:41.557305 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:41.557306 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:41.557316 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:41.557363 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:41.557598 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:41.558060 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:41.558681 (+ 621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:41.558860 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:41.558912 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:41.561216 (+ 2304us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.224.129:35781: BlockingRecv error: recv got EOF from 127.14.224.129:35781 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260805 22:47:41.561375 28325 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260805 22:47:41.633976 28335 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:41.634258 28335 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:41.634296 28335 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:41.635614 28335 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:41.635666 28335 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:41.635694 28335 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.130
I20260805 22:47:41.637231 28335 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:41827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/krb5kdc/oryx_127.14.224.130.keytab
--principal=oryx/127.14.224.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.130:45629
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.224.130
--webserver_port=40697
--tserver_master_addrs=127.14.224.190:42185
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28335
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.130
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:41.637490 28335 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:41.637720 28335 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:41.643180 28353 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:41.643373 28335 server_base.cc:1034] running on GCE node
W20260805 22:47:41.643180 28346 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:41.643188 28348 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:41.643714 28335 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:41.643965 28335 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:41.645134 28335 hybrid_clock.cc:648] HybridClock initialized: now 1785970061645117 us; error 29 us; skew 500 ppm
Aug 05 22:47:41 dist-test-slave-gjrz krb5kdc[27197](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970061, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.224.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:41.647727 28335 init.cc:377] Logged in from keytab as oryx/127.14.224.130@KRBTEST.COM (short username oryx)
I20260805 22:47:41.648217 28335 webserver.cc:460] Webserver started at http://127.14.224.130:40697/ using document root <none> and password file <none>
I20260805 22:47:41.648447 28335 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:41.648515 28335 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:41.649931 28335 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:47:41.650509 28365 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:41.650673 28335 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:41.650765 28335 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-1/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-1/wal
uuid: "b03f7bbd2bfb4c00b977769dd779cff1"
format_stamp: "Formatted at 2026-08-05 22:47:40 on dist-test-slave-gjrz"
server_key: "a5de831f02bb51bdf57dd258be6fdf72"
server_key_iv: "e38b80b05ab4cd0b1b55ab426e8c0115"
server_key_version: "encryptionkey@0"
I20260805 22:47:41.651149 28335 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:41.672760 28335 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:41.674803 28335 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:41.674958 28335 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:41.675211 28335 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:47:41.675586 28335 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:47:41.675627 28335 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:41.675660 28335 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:47:41.675683 28335 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:41.681596 28335 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.130:45629
I20260805 22:47:41.681667 28545 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.130:45629 every 8 connection(s)
I20260805 22:47:41.682045 28335 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
I20260805 22:47:41.685163 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 28335
I20260805 22:47:41.685511 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.131:35171
--local_ip_for_outbound_sockets=127.14.224.131
--tserver_master_addrs=127.14.224.190:42185
--webserver_port=34065
--webserver_interface=127.14.224.131
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab
--principal=kudu/127.14.224.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:41827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.14.224.131
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/krb5kdc/oryx_127.14.224.131.keytab with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 05 22:47:41 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.130@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:47:41 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.130@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:47:41.690220 28550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:41.682771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42185 (local address 127.14.224.130:45149)
0805 22:47:41.682942 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:41.682980 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:41.683502 (+ 522us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:41.683720 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:41.683723 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:41.684324 (+ 601us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:41.684532 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:41.684537 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:41.685248 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:41.685249 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:41.686487 (+ 1238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:41.686491 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:41.686885 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:41.686886 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:41.687049 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:41.687662 (+ 613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:41.687671 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:41.690052 (+ 2381us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.224.190:42185: Server oryx/127.14.224.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":103,"threads_started":1}
W20260805 22:47:41.690254 28333 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:47:41.682813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:45149 (local address 127.14.224.190:42185)
0805 22:47:41.682865 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:41.682867 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:41.683056 (+ 189us) server_negotiation.cc:407] Connection header received
0805 22:47:41.683603 (+ 547us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:41.683605 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:41.683619 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:41.683656 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:41.684605 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:41.685130 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:41.686585 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:41.686797 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:41.686857 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:41.690186 (+ 3329us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.224.130:45149: BlockingRecv error: recv got EOF from 127.14.224.130:45149 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260805 22:47:41.690480 28546 heartbeater.cc:644] Failed to heartbeat to 127.14.224.190:42185 (0 consecutive failures): Not authorized: Failed to ping master at 127.14.224.190:42185: Client connection negotiation failed: client connection to 127.14.224.190:42185: Server oryx/127.14.224.190@KRBTEST.COM not found in Kerberos database
Aug 05 22:47:41 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.130@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:47:41 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.130@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:47:41.695036 28550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:41.690700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42185 (local address 127.14.224.130:55309)
0805 22:47:41.690846 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:41.690858 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:41.690910 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:41.691050 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:41.691051 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:41.691184 (+ 133us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:41.691231 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:41.691233 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:41.691871 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:41.691872 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:41.692368 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:41.692369 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:41.692689 (+ 320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:41.692690 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:41.692750 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:41.693197 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:41.693201 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:41.694961 (+ 1760us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.224.190:42185: Server oryx/127.14.224.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":78,"threads_started":1}
W20260805 22:47:41.695122 28333 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:47:41.690768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:55309 (local address 127.14.224.190:42185)
0805 22:47:41.690823 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:41.690826 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:41.690896 (+ 70us) server_negotiation.cc:407] Connection header received
0805 22:47:41.690974 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:41.690975 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:41.690985 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:41.691034 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:41.691318 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:41.691802 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:41.692450 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:41.692631 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:41.692687 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:41.695068 (+ 2381us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.224.130:55309: BlockingRecv error: recv got EOF from 127.14.224.130:55309 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
Aug 05 22:47:41 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.130@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:47:41 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.130@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:47:41.699774 28550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:41.695318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42185 (local address 127.14.224.130:38653)
0805 22:47:41.695371 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:41.695381 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:41.695419 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:41.695586 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:41.695587 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:41.695694 (+ 107us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:41.695728 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:41.695729 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:41.696607 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:41.696608 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:41.697113 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:41.697115 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:41.697571 (+ 456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:41.697572 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:41.697613 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:41.698031 (+ 418us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:41.698035 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:41.699721 (+ 1686us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.224.190:42185: Server oryx/127.14.224.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":40}
W20260805 22:47:41.699890 28333 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:47:41.695365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:38653 (local address 127.14.224.190:42185)
0805 22:47:41.695396 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:41.695398 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:41.695408 (+ 10us) server_negotiation.cc:407] Connection header received
0805 22:47:41.695501 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:41.695502 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:41.695515 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:41.695584 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:41.695793 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:41.696512 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:41.697189 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:41.697500 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:41.697567 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:41.699827 (+ 2260us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.224.130:38653: BlockingRecv error: recv got EOF from 127.14.224.130:38653 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260805 22:47:41.699903 28546 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260805 22:47:41.772002 28553 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:41.772222 28553 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:41.772246 28553 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:41.773473 28553 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:41.773531 28553 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:41.773562 28553 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.131
I20260805 22:47:41.775110 28553 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:41827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/krb5kdc/oryx_127.14.224.131.keytab
--principal=oryx/127.14.224.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.131:35171
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.224.131
--webserver_port=34065
--tserver_master_addrs=127.14.224.190:42185
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28553
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.131
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:41.775424 28553 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:41.775667 28553 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:41.780807 28563 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:41.780805 28570 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:41.780799 28564 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:41.780870 28553 server_base.cc:1034] running on GCE node
I20260805 22:47:41.781239 28553 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:41.781507 28553 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:41.782687 28553 hybrid_clock.cc:648] HybridClock initialized: now 1785970061782670 us; error 32 us; skew 500 ppm
Aug 05 22:47:41 dist-test-slave-gjrz krb5kdc[27197](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970061, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.224.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:41.785342 28553 init.cc:377] Logged in from keytab as oryx/127.14.224.131@KRBTEST.COM (short username oryx)
I20260805 22:47:41.785946 28553 webserver.cc:460] Webserver started at http://127.14.224.131:34065/ using document root <none> and password file <none>
I20260805 22:47:41.786260 28553 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:41.786334 28553 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:41.787887 28553 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260805 22:47:41.788640 28580 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:41.788828 28553 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:47:41.788925 28553 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-2/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-2/wal
uuid: "6133ed593a6d4f03b409add7b51a322c"
format_stamp: "Formatted at 2026-08-05 22:47:41 on dist-test-slave-gjrz"
server_key: "6df8ed6a822093bccd5ae5671348b1e7"
server_key_iv: "f48ba1a900415cb7a923c99eaa7bc335"
server_key_version: "encryptionkey@0"
I20260805 22:47:41.789363 28553 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:41.800877 28553 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:41.803124 28553 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:41.803256 28553 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:41.803552 28553 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:47:41.803860 28553 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:47:41.803895 28553 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:41.803916 28553 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:47:41.803930 28553 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:41.809810 28553 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.131:35171
I20260805 22:47:41.809865 28775 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.131:35171 every 8 connection(s)
I20260805 22:47:41.810236 28553 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
I20260805 22:47:41.811892 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 28553
Aug 05 22:47:41 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.131@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:47:41 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.131@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
W20260805 22:47:41.818950 28333 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:47:41.811068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:36885 (local address 127.14.224.190:42185)
0805 22:47:41.811165 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:41.811167 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:41.811402 (+ 235us) server_negotiation.cc:407] Connection header received
0805 22:47:41.812097 (+ 695us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:41.812099 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:41.812113 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:41.812196 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:41.813246 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:41.813748 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:41.815349 (+ 1601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:41.815610 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:41.815688 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:41.818891 (+ 3203us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.224.131:36885: BlockingRecv error: recv got EOF from 127.14.224.131:36885 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
I20260805 22:47:41.819101 28780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:41.811024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42185 (local address 127.14.224.131:36885)
0805 22:47:41.811236 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:41.811306 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:41.811961 (+ 655us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:41.812259 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:41.812263 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:41.812931 (+ 668us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:41.813155 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:41.813161 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:41.813854 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:41.813855 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:41.815201 (+ 1346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:41.815205 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:41.815732 (+ 527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:41.815734 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:41.815890 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:41.816455 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:41.816466 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:41.818793 (+ 2327us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.224.190:42185: Server oryx/127.14.224.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":108,"threads_started":1}
W20260805 22:47:41.819392 28778 heartbeater.cc:644] Failed to heartbeat to 127.14.224.190:42185 (0 consecutive failures): Not authorized: Failed to ping master at 127.14.224.190:42185: Client connection negotiation failed: client connection to 127.14.224.190:42185: Server oryx/127.14.224.190@KRBTEST.COM not found in Kerberos database
I20260805 22:47:41.820711 28782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:41.812606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59612 (local address 127.14.224.190:42185)
0805 22:47:41.812725 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:41.812727 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:41.813383 (+ 656us) server_negotiation.cc:407] Connection header received
0805 22:47:41.813431 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:41.813432 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:41.813445 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:41.813511 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:41.814210 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:41.814675 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:41.815658 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:41.815867 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:41.815938 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:41.817283 (+ 1345us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:41.817288 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:41.817288 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:41.817299 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:41.818947 (+ 1648us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:41.819394 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:41.819399 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:41.819399 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:41.819517 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:41.819774 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:41.819776 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:41.819776 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:41.820137 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:41.820297 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:41.820522 (+ 225us) server_negotiation.cc:299] Negotiation successful
0805 22:47:41.820637 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96,"thread_start_us":53,"threads_started":1}
Aug 05 22:47:41 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.131@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:47:41 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.131@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:47:41.824385 28780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:41.819650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42185 (local address 127.14.224.131:48651)
0805 22:47:41.819752 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:41.819764 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:41.819816 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:41.819933 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:41.819934 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:41.820102 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:41.820166 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:41.820168 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:41.821060 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:41.821066 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:41.821591 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:41.821593 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:41.822041 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:41.822042 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:41.822108 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:41.822522 (+ 414us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:41.822528 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:41.824329 (+ 1801us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.224.190:42185: Server oryx/127.14.224.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":83}
W20260805 22:47:41.824491 28333 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:47:41.819709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:48651 (local address 127.14.224.190:42185)
0805 22:47:41.819750 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:41.819752 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:41.819799 (+ 47us) server_negotiation.cc:407] Connection header received
0805 22:47:41.819863 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:41.819864 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:41.819872 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:41.819909 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:41.820253 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:41.820987 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:41.821673 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:41.821969 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:41.822034 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:41.824424 (+ 2390us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.224.131:48651: BlockingRecv error: recv got EOF from 127.14.224.131:48651 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
Aug 05 22:47:41 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.131@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:47:41 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.131@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:47:41.828640 28780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:41.824671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42185 (local address 127.14.224.131:59231)
0805 22:47:41.824716 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:41.824725 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:41.824759 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:41.824852 (+ 93us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:41.824853 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:41.824964 (+ 111us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:41.824995 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:41.824996 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:41.825585 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:41.825586 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:41.826088 (+ 502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:41.826090 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:41.826406 (+ 316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:41.826407 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:41.826442 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:41.826833 (+ 391us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:41.826839 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:41.828567 (+ 1728us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.224.190:42185: Server oryx/127.14.224.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":26}
W20260805 22:47:41.828720 28333 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:47:41.824724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:59231 (local address 127.14.224.190:42185)
0805 22:47:41.824757 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:41.824758 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:41.824767 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:47:41.824795 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:41.824796 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:41.824804 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:41.824847 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:41.825041 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:41.825512 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:41.826173 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:41.826354 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:41.826405 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:41.828667 (+ 2262us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.224.131:59231: BlockingRecv error: recv got EOF from 127.14.224.131:59231 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
W20260805 22:47:41.828831 28778 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 05 22:47:42 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.129@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:47:42 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.129@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:47:42.566362 28783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:42.561818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42185 (local address 127.14.224.129:54955)
0805 22:47:42.561975 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:42.561987 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:42.562051 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:42.562186 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:42.562187 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:42.562360 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:42.562412 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:42.562414 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:42.563063 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:42.563064 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:42.563651 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:42.563653 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:42.563952 (+ 299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:42.563953 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:42.563992 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:42.564433 (+ 441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:42.564437 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:42.566290 (+ 1853us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.224.190:42185: Server oryx/127.14.224.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":91,"threads_started":1}
W20260805 22:47:42.566540 28784 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:47:42.561918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.129:54955 (local address 127.14.224.190:42185)
0805 22:47:42.562042 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:42.562044 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:42.562055 (+ 11us) server_negotiation.cc:407] Connection header received
0805 22:47:42.562101 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:42.562102 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:42.562113 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:42.562173 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:42.562479 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:42.562977 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:42.563710 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:42.563900 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:42.563946 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:42.566462 (+ 2516us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.224.129:54955: BlockingRecv error: recv got EOF from 127.14.224.129:54955 (error 108)
Metrics: {"server-negotiator.queue_time_us":104,"thread_start_us":60,"threads_started":1}
Aug 05 22:47:42 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.130@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:47:42 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.130@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:47:42.705152 28785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:42.700388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42185 (local address 127.14.224.130:35033)
0805 22:47:42.700529 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:42.700543 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:42.700611 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:42.700773 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:42.700774 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:42.700945 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:42.700997 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:42.700998 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:42.701676 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:42.701677 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:42.702308 (+ 631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:42.702311 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:42.702663 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:42.702664 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:42.702703 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:42.703160 (+ 457us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:42.703164 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:42.705048 (+ 1884us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.224.190:42185: Server oryx/127.14.224.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":79,"threads_started":1}
W20260805 22:47:42.705238 28784 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:47:42.700484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:35033 (local address 127.14.224.190:42185)
0805 22:47:42.700546 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:42.700549 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:42.700602 (+ 53us) server_negotiation.cc:407] Connection header received
0805 22:47:42.700680 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:42.700681 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:42.700693 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:42.700755 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:42.701082 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:42.701582 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:42.702404 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:42.702606 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:42.702660 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:42.705182 (+ 2522us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.224.130:35033: BlockingRecv error: recv got EOF from 127.14.224.130:35033 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
Aug 05 22:47:42 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.131@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:47:42 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.131@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:47:42.833812 28787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:42.829293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42185 (local address 127.14.224.131:49211)
0805 22:47:42.829447 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:42.829460 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:42.829518 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:42.829656 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:42.829656 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:42.829823 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:42.829875 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:42.829877 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:42.830507 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:42.830508 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:42.831064 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:42.831066 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:42.831434 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:42.831434 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:42.831478 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:42.831902 (+ 424us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:42.831907 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:42.833734 (+ 1827us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.224.190:42185: Server oryx/127.14.224.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":68,"threads_started":1}
W20260805 22:47:42.833911 28784 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:47:42.829424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:49211 (local address 127.14.224.190:42185)
0805 22:47:42.829484 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:42.829486 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:42.829499 (+ 13us) server_negotiation.cc:407] Connection header received
0805 22:47:42.829578 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:42.829578 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:42.829591 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:42.829639 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:42.829932 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:42.830445 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:42.831166 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:42.831375 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:42.831420 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:42.833847 (+ 2427us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.224.131:49211: BlockingRecv error: recv got EOF from 127.14.224.131:49211 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
Aug 05 22:47:43 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.129@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:47:43 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.129@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:47:43.571439 28788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:43.566855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42185 (local address 127.14.224.129:38685)
0805 22:47:43.566985 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:43.566996 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:43.567045 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:43.567236 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:43.567236 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:43.567431 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:43.567481 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:43.567483 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:43.568116 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:43.568116 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:43.568638 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:43.568640 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:43.569057 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:43.569058 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:43.569114 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:43.569585 (+ 471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:43.569590 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:43.571368 (+ 1778us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.224.190:42185: Server oryx/127.14.224.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":60,"threads_started":1}
W20260805 22:47:43.571579 28789 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:47:43.566965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.129:38685 (local address 127.14.224.190:42185)
0805 22:47:43.567107 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:43.567109 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:43.567117 (+ 8us) server_negotiation.cc:407] Connection header received
0805 22:47:43.567144 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:43.567144 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:43.567156 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:43.567225 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:43.567546 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:43.568049 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:43.568730 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:43.568941 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:43.569013 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:43.571495 (+ 2482us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.224.129:38685: BlockingRecv error: recv got EOF from 127.14.224.129:38685 (error 108)
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":59,"threads_started":1}
Aug 05 22:47:43 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.130@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:47:43 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.130@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:47:43.710391 28790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:43.705690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42185 (local address 127.14.224.130:45801)
0805 22:47:43.705835 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:43.705848 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:43.705939 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:43.706070 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:43.706070 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:43.706236 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:43.706287 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:43.706288 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:43.706961 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:43.706962 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:43.707541 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:43.707543 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:43.707923 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:43.707924 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:43.707973 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:43.708416 (+ 443us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:43.708422 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:43.710327 (+ 1905us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.224.190:42185: Server oryx/127.14.224.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":80,"threads_started":1}
W20260805 22:47:43.710508 28789 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:47:43.705780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:45801 (local address 127.14.224.190:42185)
0805 22:47:43.705869 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:43.705871 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:43.705921 (+ 50us) server_negotiation.cc:407] Connection header received
0805 22:47:43.705991 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:43.705992 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:43.706004 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:43.706057 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:43.706362 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:43.706866 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:43.707632 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:43.707834 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:43.707890 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:43.710444 (+ 2554us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.224.130:45801: BlockingRecv error: recv got EOF from 127.14.224.130:45801 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 05 22:47:43 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.131@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:47:43 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.131@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:47:43.839175 28791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:43.834458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42185 (local address 127.14.224.131:50711)
0805 22:47:43.834625 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:43.834636 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:43.834695 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:43.834868 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:43.834869 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:43.835108 (+ 239us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:43.835171 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:43.835174 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:43.835939 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:43.835940 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:43.836490 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:43.836493 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:43.836820 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:43.836820 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:43.836875 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:43.837344 (+ 469us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:43.837350 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:43.839111 (+ 1761us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.224.190:42185: Server oryx/127.14.224.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":93,"threads_started":1}
W20260805 22:47:43.839301 28789 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:47:43.834647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:50711 (local address 127.14.224.190:42185)
0805 22:47:43.834720 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:43.834722 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:43.834731 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:47:43.834762 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:43.834763 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:43.834777 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:43.834834 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:43.835257 (+ 423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:43.835862 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:43.836566 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:43.836753 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:43.836802 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:43.839215 (+ 2413us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.224.131:50711: BlockingRecv error: recv got EOF from 127.14.224.131:50711 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 05 22:47:44 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.129@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:47:44 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.129@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:47:44.581818 28795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:44.571994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42185 (local address 127.14.224.129:50241)
0805 22:47:44.572143 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:44.572154 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:44.572206 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:44.572389 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:44.572389 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:44.572562 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:44.572610 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:44.572612 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:44.573276 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:44.573277 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:44.573800 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:44.573802 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:44.574227 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:44.574228 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:44.574276 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:44.579728 (+ 5452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:44.579735 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:44.581736 (+ 2001us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.224.190:42185: Server oryx/127.14.224.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":79,"threads_started":1}
W20260805 22:47:44.581969 28797 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:47:44.572126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.129:50241 (local address 127.14.224.190:42185)
0805 22:47:44.572252 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:44.572254 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:44.572263 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:47:44.572291 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:44.572292 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:44.572304 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:44.572377 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:44.572672 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:44.573197 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:44.573916 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:44.574148 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:44.574214 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:44.581859 (+ 7645us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.224.129:50241: BlockingRecv error: recv got EOF from 127.14.224.129:50241 (error 108)
Metrics: {"server-negotiator.queue_time_us":103,"thread_start_us":58,"threads_started":1}
Aug 05 22:47:44 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.130@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:47:44 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.130@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:47:44.715713 28799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:44.710925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42185 (local address 127.14.224.130:53887)
0805 22:47:44.711117 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:44.711143 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:44.711212 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:44.711453 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:44.711454 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:44.711666 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:44.711725 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:44.711728 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:44.712419 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:44.712420 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:44.712972 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:44.712976 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:44.713305 (+ 329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:44.713306 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:44.713362 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:44.713781 (+ 419us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:44.713786 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:44.715650 (+ 1864us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.224.190:42185: Server oryx/127.14.224.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":81,"threads_started":1}
W20260805 22:47:44.715823 28797 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:47:44.711051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:53887 (local address 127.14.224.190:42185)
0805 22:47:44.711122 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:44.711124 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:44.711199 (+ 75us) server_negotiation.cc:407] Connection header received
0805 22:47:44.711333 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:44.711334 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:44.711346 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:44.711439 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:44.711801 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:44.712300 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:44.713051 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:44.713243 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:44.713299 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:44.715747 (+ 2448us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.224.130:53887: BlockingRecv error: recv got EOF from 127.14.224.130:53887 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 05 22:47:44 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.131@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:47:44 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.131@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:47:44.844322 28801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:44.839790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42185 (local address 127.14.224.131:53673)
0805 22:47:44.839934 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:44.839948 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:44.840033 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:44.840178 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:44.840179 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:44.840349 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:44.840400 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:44.840402 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:44.841031 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:44.841031 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:44.841570 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:44.841571 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:44.841988 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:44.841989 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:44.842062 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:44.842517 (+ 455us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:44.842522 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:44.844261 (+ 1739us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.224.190:42185: Server oryx/127.14.224.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":75,"threads_started":1}
W20260805 22:47:44.844486 28797 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:47:44.839889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:53673 (local address 127.14.224.190:42185)
0805 22:47:44.840004 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:44.840005 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:44.840017 (+ 12us) server_negotiation.cc:407] Connection header received
0805 22:47:44.840099 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:44.840100 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:44.840112 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:44.840163 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:44.840461 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:44.840960 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:44.841647 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:44.841912 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:44.841978 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:44.844395 (+ 2417us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.224.131:53673: BlockingRecv error: recv got EOF from 127.14.224.131:53673 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
Aug 05 22:47:45 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.129@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:47:45 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.129@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:47:45.595669 28802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:45.582371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42185 (local address 127.14.224.129:47437)
0805 22:47:45.582514 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:45.582526 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:45.582579 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:45.582775 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:45.582776 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:45.582938 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:45.582990 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:45.582991 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:45.583664 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:45.583664 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:45.584192 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:45.584193 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:45.584488 (+ 295us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:45.584488 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:45.584527 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:45.593753 (+ 9226us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:45.593759 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:45.595605 (+ 1846us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.224.190:42185: Server oryx/127.14.224.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":82,"threads_started":1}
W20260805 22:47:45.595808 28803 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:47:45.582493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.129:47437 (local address 127.14.224.190:42185)
0805 22:47:45.582644 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:45.582646 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:45.582657 (+ 11us) server_negotiation.cc:407] Connection header received
0805 22:47:45.582682 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:45.582683 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:45.582693 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:45.582763 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:45.583049 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:45.583605 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:45.584255 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:45.584440 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:45.584484 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:45.595726 (+ 11242us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.224.129:47437: BlockingRecv error: recv got EOF from 127.14.224.129:47437 (error 108)
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":65,"threads_started":1}
Aug 05 22:47:45 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.130@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:47:45 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.130@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:47:45.720957 28806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:45.716256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42185 (local address 127.14.224.130:47689)
0805 22:47:45.716388 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:45.716401 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:45.716468 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:45.716630 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:45.716631 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:45.716809 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:45.716858 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:45.716860 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:45.717519 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:45.717520 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:45.718043 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:45.718044 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:45.718376 (+ 332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:45.718377 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:45.718431 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:45.718898 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:45.718902 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:45.720889 (+ 1987us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.224.190:42185: Server oryx/127.14.224.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":72,"threads_started":1}
W20260805 22:47:45.721056 28803 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:47:45.716367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:47689 (local address 127.14.224.190:42185)
0805 22:47:45.716433 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:45.716435 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:45.716448 (+ 13us) server_negotiation.cc:407] Connection header received
0805 22:47:45.716556 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:45.716557 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:45.716571 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:45.716617 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:45.716932 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:45.717435 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:45.718122 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:45.718315 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:45.718371 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:45.720989 (+ 2618us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.224.130:47689: BlockingRecv error: recv got EOF from 127.14.224.130:47689 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Aug 05 22:47:45 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.131@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:47:45 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.131@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:47:45.848937 28808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:45.844804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42185 (local address 127.14.224.131:33271)
0805 22:47:45.844928 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:45.844942 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:45.845002 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:45.845161 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:45.845161 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:45.845316 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:45.845367 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:45.845368 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:45.845957 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:45.845958 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:45.846488 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:45.846489 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:45.846761 (+ 272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:45.846762 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:45.846798 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:45.847195 (+ 397us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:45.847200 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:45.848877 (+ 1677us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.224.190:42185: Server oryx/127.14.224.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":58,"threads_started":1}
W20260805 22:47:45.849048 28803 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:47:45.844893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:33271 (local address 127.14.224.190:42185)
0805 22:47:45.844972 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:45.844974 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:45.844989 (+ 15us) server_negotiation.cc:407] Connection header received
0805 22:47:45.845059 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:45.845094 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:45.845108 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:45.845149 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:45.845419 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:45.845900 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:45.846543 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:45.846714 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:45.846757 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:45.848976 (+ 2219us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.224.131:33271: BlockingRecv error: recv got EOF from 127.14.224.131:33271 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 05 22:47:46 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.129@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:47:46 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.129@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:47:46.601035 28810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:46.596150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42185 (local address 127.14.224.129:45659)
0805 22:47:46.596274 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:46.596286 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:46.596337 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:46.596501 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:46.596503 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:46.596744 (+ 241us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:46.596796 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:46.596798 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:46.597524 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:46.597525 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:46.598093 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:46.598095 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:46.598504 (+ 409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:46.598505 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:46.598566 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:46.599026 (+ 460us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:46.599031 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:46.600952 (+ 1921us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.224.190:42185: Server oryx/127.14.224.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":72,"threads_started":1}
W20260805 22:47:46.601135 28811 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:47:46.596238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.129:45659 (local address 127.14.224.190:42185)
0805 22:47:46.596366 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:46.596369 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:46.596378 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:47:46.596405 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:46.596406 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:46.596419 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:46.596489 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:46.596896 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:46.597414 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:46.598208 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:46.598419 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:46.598482 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:46.601070 (+ 2588us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.224.129:45659: BlockingRecv error: recv got EOF from 127.14.224.129:45659 (error 108)
Metrics: {"server-negotiator.queue_time_us":105,"thread_start_us":62,"threads_started":1}
Aug 05 22:47:46 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.130@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:47:46 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.130@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:47:46.726346 28812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:46.721508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42185 (local address 127.14.224.130:41455)
0805 22:47:46.721660 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:46.721671 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:46.721726 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:46.721895 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:46.721897 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:46.722098 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:46.722151 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:46.722152 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:46.722822 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:46.722823 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:46.723518 (+ 695us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:46.723522 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:46.723905 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:46.723906 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:46.723944 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:46.724395 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:46.724399 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:46.726281 (+ 1882us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.224.190:42185: Server oryx/127.14.224.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":69,"threads_started":1}
W20260805 22:47:46.726490 28811 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:47:46.721658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:41455 (local address 127.14.224.190:42185)
0805 22:47:46.721719 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:46.721721 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:46.721731 (+ 10us) server_negotiation.cc:407] Connection header received
0805 22:47:46.721779 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:46.721780 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:46.721791 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:46.721833 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:46.722219 (+ 386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:46.722721 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:46.723628 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:46.723833 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:46.723894 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:46.726423 (+ 2529us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.224.130:41455: BlockingRecv error: recv got EOF from 127.14.224.130:41455 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 05 22:47:46 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.131@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:47:46 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.131@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:47:46.853699 28813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:46.849383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42185 (local address 127.14.224.131:36115)
0805 22:47:46.849572 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:46.849585 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:46.849652 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:46.849763 (+ 111us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:46.849764 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:46.849929 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:46.849979 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:46.849981 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:46.850599 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:46.850600 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:46.851129 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:46.851131 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:46.851475 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:46.851476 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:46.851514 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:46.851927 (+ 413us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:46.851931 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:46.853638 (+ 1707us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.224.190:42185: Server oryx/127.14.224.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":69,"threads_started":1}
W20260805 22:47:46.853801 28811 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:47:46.849504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:36115 (local address 127.14.224.190:42185)
0805 22:47:46.849566 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:46.849567 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:46.849635 (+ 68us) server_negotiation.cc:407] Connection header received
0805 22:47:46.849705 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:46.849706 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:46.849718 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:46.849756 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:46.850034 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:46.850536 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:46.851197 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:46.851423 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:46.851475 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:46.853728 (+ 2253us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.224.131:36115: BlockingRecv error: recv got EOF from 127.14.224.131:36115 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
Aug 05 22:47:47 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.129@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:47:47 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.129@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:47:47.606130 28814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:47.601602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42185 (local address 127.14.224.129:56095)
0805 22:47:47.601746 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:47.601757 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:47.601811 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:47.601996 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:47.601997 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:47.602190 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:47.602262 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:47.602264 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:47.603046 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:47.603047 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:47.603607 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:47.603609 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:47.603913 (+ 304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:47.603914 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:47.603950 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:47.604358 (+ 408us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:47.604362 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:47.606067 (+ 1705us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.224.190:42185: Server oryx/127.14.224.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":69,"threads_started":1}
W20260805 22:47:47.606282 28815 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:47:47.601700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.129:56095 (local address 127.14.224.190:42185)
0805 22:47:47.601821 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:47.601823 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:47.601859 (+ 36us) server_negotiation.cc:407] Connection header received
0805 22:47:47.601899 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:47.601900 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:47.601912 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:47.601967 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:47.602326 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:47.602967 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:47.603669 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:47.603863 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:47.603911 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:47.606209 (+ 2298us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.224.129:56095: BlockingRecv error: recv got EOF from 127.14.224.129:56095 (error 108)
Metrics: {"server-negotiator.queue_time_us":100,"thread_start_us":63,"threads_started":1}
Aug 05 22:47:47 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.130@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:47:47 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.130@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:47:47.731575 28816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:47.726917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42185 (local address 127.14.224.130:59321)
0805 22:47:47.727100 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:47.727112 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:47.727195 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:47.727379 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:47.727380 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:47.727568 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:47.727622 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:47.727625 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:47.728299 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:47.728301 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:47.728829 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:47.728831 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:47.729167 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:47.729168 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:47.729224 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:47.729680 (+ 456us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:47.729684 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:47.731512 (+ 1828us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.224.190:42185: Server oryx/127.14.224.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":95,"threads_started":1}
W20260805 22:47:47.731706 28815 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:47:47.727017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:59321 (local address 127.14.224.190:42185)
0805 22:47:47.727090 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:47.727093 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:47.727174 (+ 81us) server_negotiation.cc:407] Connection header received
0805 22:47:47.727252 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:47.727253 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:47.727319 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:47.727371 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:47.727707 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:47.728216 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:47.728911 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:47.729103 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:47.729160 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:47.731633 (+ 2473us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.224.130:59321: BlockingRecv error: recv got EOF from 127.14.224.130:59321 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Aug 05 22:47:47 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.131@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:47:47 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.131@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:47:47.858923 28818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:47.854231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42185 (local address 127.14.224.131:40139)
0805 22:47:47.854366 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:47.854378 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:47.854450 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:47.854669 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:47.854670 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:47.854881 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:47.854934 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:47.854937 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:47.855724 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:47.855725 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:47.856312 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:47.856315 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:47.856678 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:47.856679 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:47.856724 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:47.857168 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:47.857172 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:47.858847 (+ 1675us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.224.190:42185: Server oryx/127.14.224.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":71,"threads_started":1}
W20260805 22:47:47.859027 28815 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:47:47.854294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:40139 (local address 127.14.224.190:42185)
0805 22:47:47.854368 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:47.854371 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:47.854429 (+ 58us) server_negotiation.cc:407] Connection header received
0805 22:47:47.854545 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:47.854545 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:47.854561 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:47.854632 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:47.855054 (+ 422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:47.855646 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:47.856409 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:47.856601 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:47.856670 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:47.858966 (+ 2296us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.224.131:40139: BlockingRecv error: recv got EOF from 127.14.224.131:40139 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 05 22:47:48 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.129@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:47:48 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.129@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:47:48.611722 28819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:48.606695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42185 (local address 127.14.224.129:47887)
0805 22:47:48.606850 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:48.606861 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:48.606914 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:48.607080 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:48.607081 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:48.607254 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:48.607335 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:48.607337 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:48.608080 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:48.608082 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:48.608645 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:48.608647 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:48.609008 (+ 361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:48.609009 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:48.609047 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:48.609531 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:48.609535 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:48.611638 (+ 2103us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.224.190:42185: Server oryx/127.14.224.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":84,"threads_started":1}
W20260805 22:47:48.611876 28820 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:47:48.606809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.129:47887 (local address 127.14.224.190:42185)
0805 22:47:48.606936 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:48.606938 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:48.606949 (+ 11us) server_negotiation.cc:407] Connection header received
0805 22:47:48.606979 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:48.606980 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:48.606990 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:48.607067 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:48.607426 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:48.607973 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:48.608722 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:48.608946 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:48.609010 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:48.611754 (+ 2744us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.224.129:47887: BlockingRecv error: recv got EOF from 127.14.224.129:47887 (error 108)
Metrics: {"server-negotiator.queue_time_us":104,"thread_start_us":70,"threads_started":1}
Aug 05 22:47:48 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.130@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:47:48 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.130@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:47:48.736572 28821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:48.732097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42185 (local address 127.14.224.130:32961)
0805 22:47:48.732257 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:48.732269 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:48.732330 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:48.732454 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:48.732455 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:48.732618 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:48.732667 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:48.732668 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:48.733297 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:48.733298 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:48.733852 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:48.733854 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:48.734203 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:48.734204 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:48.734257 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:48.734681 (+ 424us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:48.734685 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:48.736508 (+ 1823us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.224.190:42185: Server oryx/127.14.224.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":76,"threads_started":1}
W20260805 22:47:48.736683 28820 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:47:48.732157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:32961 (local address 127.14.224.190:42185)
0805 22:47:48.732206 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:48.732209 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:48.732328 (+ 119us) server_negotiation.cc:407] Connection header received
0805 22:47:48.732375 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:48.732375 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:48.732388 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:48.732438 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:48.732719 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:48.733205 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:48.733919 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:48.734115 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:48.734161 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:48.736622 (+ 2461us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.224.130:32961: BlockingRecv error: recv got EOF from 127.14.224.130:32961 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
Aug 05 22:47:48 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.131@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:47:48 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.131@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:47:48.864162 28822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:48.859463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42185 (local address 127.14.224.131:59715)
0805 22:47:48.859609 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:48.859618 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:48.859679 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:48.859854 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:48.859855 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:48.860028 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:48.860080 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:48.860082 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:48.860705 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:48.860706 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:48.861240 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:48.861242 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:48.861561 (+ 319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:48.861562 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:48.861604 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:48.862110 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:48.862115 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:48.864101 (+ 1986us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.224.190:42185: Server oryx/127.14.224.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":83,"threads_started":1}
W20260805 22:47:48.864315 28820 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:47:48.859531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:59715 (local address 127.14.224.190:42185)
0805 22:47:48.859615 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:48.859616 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:48.859676 (+ 60us) server_negotiation.cc:407] Connection header received
0805 22:47:48.859757 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:48.859758 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:48.859771 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:48.859838 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:48.860141 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:48.860637 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:48.861304 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:48.861484 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:48.861527 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:48.864241 (+ 2714us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.224.131:59715: BlockingRecv error: recv got EOF from 127.14.224.131:59715 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 05 22:47:49 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.129@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:47:49 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.129@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:47:49.617137 28823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:49.612202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42185 (local address 127.14.224.129:46147)
0805 22:47:49.612384 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:49.612399 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:49.612465 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:49.612622 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:49.612623 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:49.612791 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:49.612843 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:49.612845 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:49.613540 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:49.613540 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:49.614133 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:49.614136 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:49.614501 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:49.614501 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:49.614538 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:49.615035 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:49.615040 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:49.617054 (+ 2014us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.224.190:42185: Server oryx/127.14.224.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":62,"threads_started":1}
W20260805 22:47:49.617249 28825 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:47:49.612371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.129:46147 (local address 127.14.224.190:42185)
0805 22:47:49.612474 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:49.612476 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:49.612485 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:47:49.612512 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:49.612513 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:49.612523 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:49.612597 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:49.612933 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:49.613468 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:49.614223 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:49.614451 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:49.614500 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:49.617179 (+ 2679us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.224.129:46147: BlockingRecv error: recv got EOF from 127.14.224.129:46147 (error 108)
Metrics: {"server-negotiator.queue_time_us":82,"thread_start_us":56,"threads_started":1}
Aug 05 22:47:49 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.130@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:47:49 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.130@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:47:49.743348 28827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:49.737040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42185 (local address 127.14.224.130:46099)
0805 22:47:49.737246 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:49.737258 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:49.737320 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:49.738283 (+ 963us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:49.738284 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:49.738450 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:49.738502 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:49.738504 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:49.739810 (+ 1306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:49.739811 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:49.740375 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:49.740377 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:49.740874 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:49.740875 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:49.740914 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:49.741370 (+ 456us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:49.741376 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:49.743231 (+ 1855us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.224.190:42185: Server oryx/127.14.224.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":78,"threads_started":1}
W20260805 22:47:49.743417 28825 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:47:49.737365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:46099 (local address 127.14.224.190:42185)
0805 22:47:49.738147 (+ 782us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:49.738149 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:49.738158 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:47:49.738188 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:49.738189 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:49.738203 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:49.738262 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:49.738601 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:49.739720 (+ 1119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:49.740462 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:49.740801 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:49.740875 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:49.743360 (+ 2485us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.224.130:46099: BlockingRecv error: recv got EOF from 127.14.224.130:46099 (error 108)
Metrics: {"server-negotiator.queue_time_us":758}
Aug 05 22:47:49 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.131@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:47:49 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.131@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:47:49.869091 28830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:49.864704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42185 (local address 127.14.224.131:39557)
0805 22:47:49.864831 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:49.864842 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:49.864911 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:49.865030 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:49.865031 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:49.865198 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:49.865247 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:49.865249 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:49.865875 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:49.865875 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:49.866413 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:49.866415 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:49.866721 (+ 306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:49.866722 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:49.866765 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:49.867170 (+ 405us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:49.867174 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:49.869016 (+ 1842us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.224.190:42185: Server oryx/127.14.224.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":71,"threads_started":1}
W20260805 22:47:49.869167 28825 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:47:49.864801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:39557 (local address 127.14.224.190:42185)
0805 22:47:49.864850 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:49.864852 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:49.864906 (+ 54us) server_negotiation.cc:407] Connection header received
0805 22:47:49.864967 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:49.864967 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:49.864980 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:49.865017 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:49.865304 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:49.865800 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:49.866476 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:49.866663 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:49.866706 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:49.869105 (+ 2399us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.224.131:39557: BlockingRecv error: recv got EOF from 127.14.224.131:39557 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
Aug 05 22:47:50 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.129@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:47:50 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.129@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:47:50.626096 28831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:50.617643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42185 (local address 127.14.224.129:59723)
0805 22:47:50.617806 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:50.617818 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:50.617884 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:50.618035 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:50.618036 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:50.618215 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:50.618269 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:50.618271 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:50.618953 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:50.618954 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:50.619570 (+ 616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:50.619574 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:50.619989 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:50.619990 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:50.620046 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:50.623790 (+ 3744us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:50.623796 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:50.625997 (+ 2201us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.224.190:42185: Server oryx/127.14.224.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":94,"threads_started":1}
W20260805 22:47:50.626158 28832 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:47:50.617745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.129:59723 (local address 127.14.224.190:42185)
0805 22:47:50.617854 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:50.617856 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:50.617868 (+ 12us) server_negotiation.cc:407] Connection header received
0805 22:47:50.617950 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:50.617951 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:50.617971 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:50.618020 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:50.618353 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:50.618876 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:50.619667 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:50.619871 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:50.619928 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:50.626096 (+ 6168us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.224.129:59723: BlockingRecv error: recv got EOF from 127.14.224.129:59723 (error 108)
Metrics: {"server-negotiator.queue_time_us":87,"thread_start_us":53,"threads_started":1}
Aug 05 22:47:50 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.130@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:47:50 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.130@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:47:50.748507 28833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:50.743852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42185 (local address 127.14.224.130:44645)
0805 22:47:50.744027 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:50.744038 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:50.744099 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:50.744240 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:50.744241 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:50.744430 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:50.744493 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:50.744496 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:50.745299 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:50.745300 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:50.745839 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:50.745841 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:50.746157 (+ 316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:50.746157 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:50.746197 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:50.746609 (+ 412us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:50.746625 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:50.748433 (+ 1808us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.224.190:42185: Server oryx/127.14.224.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":88,"threads_started":1}
W20260805 22:47:50.748603 28832 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:47:50.743921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:44645 (local address 127.14.224.190:42185)
0805 22:47:50.743976 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:50.743978 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:50.744096 (+ 118us) server_negotiation.cc:407] Connection header received
0805 22:47:50.744155 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:50.744155 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:50.744167 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:50.744224 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:50.744566 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:50.745225 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:50.745907 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:50.746105 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:50.746151 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:50.748540 (+ 2389us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.224.130:44645: BlockingRecv error: recv got EOF from 127.14.224.130:44645 (error 108)
Metrics: {"server-negotiator.queue_time_us":29}
Aug 05 22:47:50 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.131@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:47:50 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.131@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:47:50.874266 28834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:50.869606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42185 (local address 127.14.224.131:50153)
0805 22:47:50.869779 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:50.869795 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:50.869873 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:50.870009 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:50.870010 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:50.870222 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:50.870275 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:50.870277 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:50.870946 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:50.870947 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:50.871502 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:50.871504 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:50.871845 (+ 341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:50.871846 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:50.871901 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:50.872361 (+ 460us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:50.872366 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:50.874182 (+ 1816us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.224.190:42185: Server oryx/127.14.224.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":92,"threads_started":1}
W20260805 22:47:50.874459 28832 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:47:50.869713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:50153 (local address 127.14.224.190:42185)
0805 22:47:50.869795 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:50.869797 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:50.869851 (+ 54us) server_negotiation.cc:407] Connection header received
0805 22:47:50.869931 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:50.869932 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:50.869946 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:50.869996 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:50.870360 (+ 364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:50.870865 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:50.871594 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:50.871781 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:50.871838 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:50.874403 (+ 2565us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.224.131:50153: BlockingRecv error: recv got EOF from 127.14.224.131:50153 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 05 22:47:51 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.129@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:47:51 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.129@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:47:51.630975 28835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:51.626618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42185 (local address 127.14.224.129:50051)
0805 22:47:51.626766 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:51.626778 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:51.626835 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:51.626968 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:51.626969 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:51.627136 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:51.627186 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:51.627187 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:51.627887 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:51.627887 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:51.628401 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:51.628403 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:51.628762 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:51.628762 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:51.628799 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:51.629230 (+ 431us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:51.629234 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:51.630913 (+ 1679us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.224.190:42185: Server oryx/127.14.224.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":77,"threads_started":1}
W20260805 22:47:51.631107 28836 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:47:51.626700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.129:50051 (local address 127.14.224.190:42185)
0805 22:47:51.626804 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:51.626806 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:51.626820 (+ 14us) server_negotiation.cc:407] Connection header received
0805 22:47:51.626884 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:51.626885 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:51.626895 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:51.626958 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:51.627313 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:51.627824 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:51.628491 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:51.628697 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:51.628759 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:51.631030 (+ 2271us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.224.129:50051: BlockingRecv error: recv got EOF from 127.14.224.129:50051 (error 108)
Metrics: {"server-negotiator.queue_time_us":83,"thread_start_us":53,"threads_started":1}
Aug 05 22:47:51 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.130@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:47:51 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.130@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:47:51.753715 28839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:51.749072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42185 (local address 127.14.224.130:48835)
0805 22:47:51.749268 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:51.749280 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:51.749342 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:51.749478 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:51.749479 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:51.749656 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:51.749708 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:51.749709 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:51.750326 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:51.750327 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:51.750869 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:51.750870 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:51.751219 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:51.751220 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:51.751304 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:51.751767 (+ 463us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:51.751772 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:51.753654 (+ 1882us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.224.190:42185: Server oryx/127.14.224.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":112,"threads_started":1}
W20260805 22:47:51.753809 28836 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:47:51.749147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:48835 (local address 127.14.224.190:42185)
0805 22:47:51.749197 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:51.749199 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:51.749335 (+ 136us) server_negotiation.cc:407] Connection header received
0805 22:47:51.749410 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:51.749411 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:51.749422 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:51.749462 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:51.749761 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:51.750259 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:51.750941 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:51.751151 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:51.751203 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:51.753748 (+ 2545us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.224.130:48835: BlockingRecv error: recv got EOF from 127.14.224.130:48835 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
Aug 05 22:47:51 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.131@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:47:51 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.131@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:47:51.879916 28840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:51.874827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42185 (local address 127.14.224.131:56999)
0805 22:47:51.875002 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:51.875018 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:51.875097 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:51.875239 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:51.875240 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:51.875446 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:51.875512 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:51.875514 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:51.876192 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:51.876194 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:51.876761 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:51.876763 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:51.877116 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:51.877117 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:51.877173 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:51.877681 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:51.877686 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:51.879842 (+ 2156us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.224.190:42185: Server oryx/127.14.224.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":64,"threads_started":1}
W20260805 22:47:51.880041 28836 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:47:51.874980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:56999 (local address 127.14.224.190:42185)
0805 22:47:51.875031 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:51.875033 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:51.875090 (+ 57us) server_negotiation.cc:407] Connection header received
0805 22:47:51.875155 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:51.875156 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:51.875171 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:51.875222 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:51.875596 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:51.876108 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:51.876847 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:51.877041 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:51.877098 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:51.879966 (+ 2868us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.224.131:56999: BlockingRecv error: recv got EOF from 127.14.224.131:56999 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
Aug 05 22:47:52 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.129@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:47:52 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.129@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:47:52.636619 28841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:52.631571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42185 (local address 127.14.224.129:42959)
0805 22:47:52.631711 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:52.631724 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:52.631777 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:52.632004 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:52.632005 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:52.632186 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:52.632246 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:52.632248 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:52.633048 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:52.633049 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:52.633610 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:52.633612 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:52.634056 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:52.634058 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:52.634111 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:52.634661 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:52.634668 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:52.636543 (+ 1875us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.224.190:42185: Server oryx/127.14.224.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":76,"threads_started":1}
W20260805 22:47:52.636737 28844 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:47:52.631657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.129:42959 (local address 127.14.224.190:42185)
0805 22:47:52.631830 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:52.631832 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:52.631843 (+ 11us) server_negotiation.cc:407] Connection header received
0805 22:47:52.631873 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:52.631874 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:52.631885 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:52.631989 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:52.632344 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:52.632905 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:52.633711 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:52.633958 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:52.634025 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:52.636666 (+ 2641us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.224.129:42959: BlockingRecv error: recv got EOF from 127.14.224.129:42959 (error 108)
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":95,"threads_started":1}
Aug 05 22:47:52 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.130@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:47:52 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.130@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:47:52.758997 28845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:52.754272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42185 (local address 127.14.224.130:48279)
0805 22:47:52.754437 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:52.754449 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:52.754524 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:52.754701 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:52.754702 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:52.754875 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:52.754924 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:52.754926 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:52.755613 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:52.755623 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:52.756153 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:52.756155 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:52.756489 (+ 334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:52.756490 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:52.756546 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:52.757080 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:52.757085 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:52.758922 (+ 1837us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.224.190:42185: Server oryx/127.14.224.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":96,"threads_started":1}
W20260805 22:47:52.759084 28844 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:47:52.754350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:48279 (local address 127.14.224.190:42185)
0805 22:47:52.754421 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:52.754423 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:52.754565 (+ 142us) server_negotiation.cc:407] Connection header received
0805 22:47:52.754608 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:52.754610 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:52.754622 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:52.754689 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:52.754981 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:52.755549 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:52.756219 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:52.756412 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:52.756477 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:52.759023 (+ 2546us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.224.130:48279: BlockingRecv error: recv got EOF from 127.14.224.130:48279 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 05 22:47:52 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.131@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:47:52 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.131@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:47:52.885092 28847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:52.880460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42185 (local address 127.14.224.131:55579)
0805 22:47:52.880631 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:52.880646 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:52.880720 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:52.880859 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:52.880860 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:52.881045 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:52.881097 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:52.881100 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:52.881750 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:52.881752 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:52.882293 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:52.882294 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:52.882627 (+ 333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:52.882628 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:52.882685 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:52.883145 (+ 460us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:52.883150 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:52.885009 (+ 1859us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.224.190:42185: Server oryx/127.14.224.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":64,"threads_started":1}
W20260805 22:47:52.885185 28844 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:47:52.880584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:55579 (local address 127.14.224.190:42185)
0805 22:47:52.880655 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:52.880657 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:52.880700 (+ 43us) server_negotiation.cc:407] Connection header received
0805 22:47:52.880780 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:52.880781 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:52.880795 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:52.880843 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:52.881174 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:52.881671 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:52.882378 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:52.882564 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:52.882622 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:52.885129 (+ 2507us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.224.131:55579: BlockingRecv error: recv got EOF from 127.14.224.131:55579 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 05 22:47:53 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.129@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:47:53 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.129@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:47:53.641628 28848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:53.637127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42185 (local address 127.14.224.129:34353)
0805 22:47:53.637302 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:53.637315 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:53.637375 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:53.637506 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:53.637507 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:53.637696 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:53.637746 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:53.637748 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:53.638429 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:53.638431 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:53.638996 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:53.638998 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:53.639353 (+ 355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:53.639354 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:53.639398 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:53.639849 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:53.639853 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:53.641565 (+ 1712us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.224.190:42185: Server oryx/127.14.224.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":77,"threads_started":1}
W20260805 22:47:53.641747 28850 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:47:53.637237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.129:34353 (local address 127.14.224.190:42185)
0805 22:47:53.637373 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:53.637375 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:53.637385 (+ 10us) server_negotiation.cc:407] Connection header received
0805 22:47:53.637427 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:53.637428 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:53.637439 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:53.637492 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:53.637809 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:53.638328 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:53.639066 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:53.639290 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:53.639352 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:53.641675 (+ 2323us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.224.129:34353: BlockingRecv error: recv got EOF from 127.14.224.129:34353 (error 108)
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":71,"threads_started":1}
Aug 05 22:47:53 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.130@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:47:53 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.130@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:47:53.763983 28851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:53.759494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42185 (local address 127.14.224.130:42533)
0805 22:47:53.759630 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:53.759642 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:53.759720 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:53.759865 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:53.759866 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:53.760054 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:53.760102 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:53.760106 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:53.760775 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:53.760776 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:53.761313 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:53.761315 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:53.761652 (+ 337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:53.761654 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:53.761709 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:53.762141 (+ 432us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:53.762145 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:53.763892 (+ 1747us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.224.190:42185: Server oryx/127.14.224.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":74,"threads_started":1}
W20260805 22:47:53.764058 28850 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:47:53.759563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:42533 (local address 127.14.224.190:42185)
0805 22:47:53.759627 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:53.759629 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:53.759706 (+ 77us) server_negotiation.cc:407] Connection header received
0805 22:47:53.759787 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:53.759788 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:53.759801 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:53.759848 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:53.760210 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:53.760700 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:53.761396 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:53.761590 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:53.761645 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:53.764003 (+ 2358us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.224.130:42533: BlockingRecv error: recv got EOF from 127.14.224.130:42533 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
Aug 05 22:47:53 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.131@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:47:53 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.131@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:47:53.890601 28852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:53.885659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42185 (local address 127.14.224.131:60271)
0805 22:47:53.885831 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:53.885841 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:53.885900 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:53.886094 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:53.886095 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:53.886299 (+ 204us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:53.886357 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:53.886359 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:53.887008 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:53.887009 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:53.887597 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:53.887599 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:53.887917 (+ 318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:53.887918 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:53.887959 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:53.888487 (+ 528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:53.888492 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:53.890524 (+ 2032us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.224.190:42185: Server oryx/127.14.224.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":84,"threads_started":1}
W20260805 22:47:53.890787 28850 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:47:53.885748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:60271 (local address 127.14.224.190:42185)
0805 22:47:53.885798 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:53.885801 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:53.885889 (+ 88us) server_negotiation.cc:407] Connection header received
0805 22:47:53.885947 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:53.885948 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:53.885982 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:53.886040 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:53.886428 (+ 388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:53.886921 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:53.887667 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:53.887860 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:53.887910 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:53.890675 (+ 2765us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.224.131:60271: BlockingRecv error: recv got EOF from 127.14.224.131:60271 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
Aug 05 22:47:54 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.129@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:47:54 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.129@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:47:54.646787 28853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:54.642144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42185 (local address 127.14.224.129:34551)
0805 22:47:54.642281 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:54.642293 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:54.642346 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:54.642524 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:54.642524 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:54.642707 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:54.642759 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:54.642760 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:54.643461 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:54.643462 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:54.644024 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:54.644026 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:54.644340 (+ 314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:54.644341 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:54.644378 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:54.644932 (+ 554us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:54.644938 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:54.646725 (+ 1787us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.224.190:42185: Server oryx/127.14.224.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":75,"threads_started":1}
W20260805 22:47:54.646921 28854 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:47:54.642257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.129:34551 (local address 127.14.224.190:42185)
0805 22:47:54.642399 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:54.642401 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:54.642410 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:47:54.642435 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:54.642435 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:54.642446 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:54.642515 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:54.642847 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:54.643388 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:54.644087 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:54.644291 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:54.644337 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:54.646837 (+ 2500us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.224.129:34551: BlockingRecv error: recv got EOF from 127.14.224.129:34551 (error 108)
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":62,"threads_started":1}
Aug 05 22:47:54 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.130@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:47:54 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.130@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:47:54.768953 28855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:54.764459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42185 (local address 127.14.224.130:56641)
0805 22:47:54.764638 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:54.764649 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:54.764708 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:54.764840 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:54.764841 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:54.765008 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:54.765059 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:54.765060 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:54.765677 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:54.765677 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:54.766198 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:54.766200 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:54.766537 (+ 337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:54.766538 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:54.766575 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:54.767040 (+ 465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:54.767045 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:54.768891 (+ 1846us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.224.190:42185: Server oryx/127.14.224.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":82,"threads_started":1}
W20260805 22:47:54.769079 28854 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:47:54.764585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:56641 (local address 127.14.224.190:42185)
0805 22:47:54.764640 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:54.764642 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:54.764699 (+ 57us) server_negotiation.cc:407] Connection header received
0805 22:47:54.764756 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:54.764757 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:54.764768 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:54.764828 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:54.765112 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:54.765607 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:54.766279 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:54.766479 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:54.766535 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:54.769015 (+ 2480us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.224.130:56641: BlockingRecv error: recv got EOF from 127.14.224.130:56641 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
Aug 05 22:47:54 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.131@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:47:54 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.131@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:47:54.895789 28856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:54.891089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42185 (local address 127.14.224.131:35907)
0805 22:47:54.891231 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:54.891243 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:54.891344 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:54.891459 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:54.891459 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:54.891656 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:54.891708 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:54.891710 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:54.892464 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:54.892466 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:54.893019 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:54.893021 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:54.893374 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:54.893376 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:54.893436 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:54.893892 (+ 456us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:54.893896 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:54.895727 (+ 1831us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.224.190:42185: Server oryx/127.14.224.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":72,"threads_started":1}
W20260805 22:47:54.895905 28854 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:47:54.891136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:35907 (local address 127.14.224.190:42185)
0805 22:47:54.891194 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:54.891196 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:54.891329 (+ 133us) server_negotiation.cc:407] Connection header received
0805 22:47:54.891390 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:54.891391 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:54.891405 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:54.891452 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:54.891766 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:54.892312 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:54.893101 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:54.893289 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:54.893351 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:54.895838 (+ 2487us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.224.131:35907: BlockingRecv error: recv got EOF from 127.14.224.131:35907 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
Aug 05 22:47:55 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.129@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:47:55 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.129@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:47:55.655207 28858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:55.647295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42185 (local address 127.14.224.129:40037)
0805 22:47:55.647451 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:55.647467 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:55.647539 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:55.647678 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:55.647679 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:55.647854 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:55.647905 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:55.647907 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:55.648518 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:55.648519 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:55.649125 (+ 606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:55.649128 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:55.649443 (+ 315us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:55.649443 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:55.649483 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:55.653148 (+ 3665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:55.653154 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:55.655103 (+ 1949us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.224.190:42185: Server oryx/127.14.224.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":76,"threads_started":1}
W20260805 22:47:55.655299 28859 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:47:55.647381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.129:40037 (local address 127.14.224.190:42185)
0805 22:47:55.647527 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:55.647529 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:55.647538 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:47:55.647603 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:55.647604 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:55.647614 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:55.647661 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:55.647960 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:55.648460 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:55.649199 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:55.649387 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:55.649432 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:55.655202 (+ 5770us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.224.129:40037: BlockingRecv error: recv got EOF from 127.14.224.129:40037 (error 108)
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":85,"threads_started":1}
Aug 05 22:47:55 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.130@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:47:55 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.130@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:47:55.774284 28862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:55.769515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42185 (local address 127.14.224.130:55861)
0805 22:47:55.769703 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:55.769716 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:55.769793 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:55.769944 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:55.769946 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:55.770131 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:55.770182 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:55.770185 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:55.770847 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:55.770848 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:55.771422 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:55.771424 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:55.771770 (+ 346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:55.771770 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:55.771824 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:55.772268 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:55.772272 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:55.774218 (+ 1946us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.224.190:42185: Server oryx/127.14.224.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":96,"threads_started":1}
W20260805 22:47:55.774420 28859 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:47:55.769595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:55861 (local address 127.14.224.190:42185)
0805 22:47:55.769681 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:55.769683 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:55.769784 (+ 101us) server_negotiation.cc:407] Connection header received
0805 22:47:55.769862 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:55.769863 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:55.769877 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:55.769924 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:55.770264 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:55.770764 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:55.771510 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:55.771705 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:55.771763 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:55.774342 (+ 2579us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.224.130:55861: BlockingRecv error: recv got EOF from 127.14.224.130:55861 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 05 22:47:55 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.131@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:47:55 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.131@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:47:55.900990 28863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:55.896283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42185 (local address 127.14.224.131:38813)
0805 22:47:55.896433 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:55.896444 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:55.896508 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:55.896682 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:55.896683 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:55.896864 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:55.896916 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:55.896918 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:55.897599 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:55.897600 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:55.898150 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:55.898152 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:55.898479 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:55.898480 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:55.898537 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:55.899020 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:55.899026 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:55.900906 (+ 1880us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.224.190:42185: Server oryx/127.14.224.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":88,"threads_started":1}
W20260805 22:47:55.901077 28859 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:47:55.896357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:38813 (local address 127.14.224.190:42185)
0805 22:47:55.896441 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:55.896443 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:55.896505 (+ 62us) server_negotiation.cc:407] Connection header received
0805 22:47:55.896562 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:55.896562 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:55.896575 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:55.896630 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:55.897011 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:55.897521 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:55.898214 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:55.898397 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:55.898445 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:55.901017 (+ 2572us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.224.131:38813: BlockingRecv error: recv got EOF from 127.14.224.131:38813 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 05 22:47:56 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.129@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:47:56 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.129@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:47:56.660511 28865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:56.655944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42185 (local address 127.14.224.129:53905)
0805 22:47:56.656092 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:56.656106 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:56.656178 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:56.656334 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:56.656336 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:56.656497 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:56.656546 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:56.656548 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:56.657178 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:56.657179 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:56.657701 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:56.657703 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:56.657994 (+ 291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:56.657994 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:56.658032 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:56.658555 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:56.658561 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:56.660446 (+ 1885us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.224.190:42185: Server oryx/127.14.224.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":80,"threads_started":1}
W20260805 22:47:56.660619 28866 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:47:56.656037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.129:53905 (local address 127.14.224.190:42185)
0805 22:47:56.656203 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:56.656204 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:56.656215 (+ 11us) server_negotiation.cc:407] Connection header received
0805 22:47:56.656243 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:56.656244 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:56.656256 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:56.656323 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:56.656606 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:56.657111 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:56.657760 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:56.657946 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:56.657988 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:56.660540 (+ 2552us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.224.129:53905: BlockingRecv error: recv got EOF from 127.14.224.129:53905 (error 108)
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":74,"threads_started":1}
Aug 05 22:47:56 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.130@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:47:56 dist-test-slave-gjrz krb5kdc[27197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.224.130@KRBTEST.COM for oryx/127.14.224.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:47:56.779574 28867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:56.774942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:42185 (local address 127.14.224.130:55849)
0805 22:47:56.775087 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:56.775100 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:56.775167 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:56.775353 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:56.775354 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:56.775528 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:56.775578 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:56.775580 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:56.776203 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:56.776204 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:56.776739 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:56.776741 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:56.777134 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:56.777135 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:56.777186 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:56.777703 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:56.777710 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:56.779500 (+ 1790us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.224.190:42185: Server oryx/127.14.224.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":71,"threads_started":1}
W20260805 22:47:56.779667 28866 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:47:56.775038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:55849 (local address 127.14.224.190:42185)
0805 22:47:56.775108 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:56.775110 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:56.775161 (+ 51us) server_negotiation.cc:407] Connection header received
0805 22:47:56.775223 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:56.775224 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:56.775235 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:56.775296 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:56.775634 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:56.776142 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:56.776836 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:56.777047 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:56.777115 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:56.779604 (+ 2489us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.224.130:55849: BlockingRecv error: recv got EOF from 127.14.224.130:55849 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
I20260805 22:47:56.820695 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 28102
I20260805 22:47:56.839810 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 28335
I20260805 22:47:56.855760 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 28553
I20260805 22:47:56.866691 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 27988
2026-08-05T22:47:56Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17694 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-05T22:47:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:47:56Z Disabled control of system clock
I20260805 22:47:56.905098 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970021300824-15234-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970021300824-15234-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970021300824-15234-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:43669
--webserver_interface=127.14.224.190
--webserver_port=0
--builtin_ntp_servers=127.14.224.148:44189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.224.190:43669
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260805 22:47:56.989370 28872 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:56.989614 28872 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:56.989638 28872 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:56.990937 28872 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:47:56.990990 28872 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:56.991003 28872 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:56.991015 28872 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:47:56.991025 28872 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:47:56.992479 28872 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:44189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970021300824-15234-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970021300824-15234-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.224.190:43669
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:43669
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.224.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28872
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970021300824-15234-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:56.992712 28872 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:56.992975 28872 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:56.998241 28882 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:56.998296 28884 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:56.998293 28888 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:56.998344 28872 server_base.cc:1034] running on GCE node
I20260805 22:47:56.998852 28872 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:56.999146 28872 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:57.000312 28872 hybrid_clock.cc:648] HybridClock initialized: now 1785970077000294 us; error 41 us; skew 500 ppm
I20260805 22:47:57.001598 28872 webserver.cc:460] Webserver started at http://127.14.224.190:42623/ using document root <none> and password file <none>
I20260805 22:47:57.001842 28872 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:57.001907 28872 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:57.002048 28872 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:57.003168 28872 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970021300824-15234-0/minicluster-data/master-0/data/instance:
uuid: "7447aa4fd2584dd0a0551e7cb61ec669"
format_stamp: "Formatted at 2026-08-05 22:47:56 on dist-test-slave-gjrz"
server_key: "5d205a7b159400ed30279a42f8755752"
server_key_iv: "43791dd0d49e91cf2b8037b125a86d45"
server_key_version: "encryptionkey@0"
I20260805 22:47:57.003579 28872 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970021300824-15234-0/minicluster-data/master-0/wal/instance:
uuid: "7447aa4fd2584dd0a0551e7cb61ec669"
format_stamp: "Formatted at 2026-08-05 22:47:56 on dist-test-slave-gjrz"
server_key: "5d205a7b159400ed30279a42f8755752"
server_key_iv: "43791dd0d49e91cf2b8037b125a86d45"
server_key_version: "encryptionkey@0"
I20260805 22:47:57.004900 28872 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:47:57.005590 28895 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:57.005743 28872 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260805 22:47:57.005832 28872 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970021300824-15234-0/minicluster-data/master-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970021300824-15234-0/minicluster-data/master-0/wal
uuid: "7447aa4fd2584dd0a0551e7cb61ec669"
format_stamp: "Formatted at 2026-08-05 22:47:56 on dist-test-slave-gjrz"
server_key: "5d205a7b159400ed30279a42f8755752"
server_key_iv: "43791dd0d49e91cf2b8037b125a86d45"
server_key_version: "encryptionkey@0"
I20260805 22:47:57.005899 28872 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970021300824-15234-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970021300824-15234-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970021300824-15234-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:57.016816 28872 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:57.017158 28872 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:57.017289 28872 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:57.021317 28872 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.190:43669
I20260805 22:47:57.021354 28989 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.190:43669 every 8 connection(s)
I20260805 22:47:57.021697 28872 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
I20260805 22:47:57.022392 28991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:57.025087 28991 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7447aa4fd2584dd0a0551e7cb61ec669: Bootstrap starting.
I20260805 22:47:57.025662 28991 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7447aa4fd2584dd0a0551e7cb61ec669: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:57.025905 28991 log.cc:824] T 00000000000000000000000000000000 P 7447aa4fd2584dd0a0551e7cb61ec669: Log is configured to *not* fsync() on all Append() calls
I20260805 22:47:57.026574 28991 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7447aa4fd2584dd0a0551e7cb61ec669: No bootstrap required, opened a new log
I20260805 22:47:57.028211 28991 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7447aa4fd2584dd0a0551e7cb61ec669 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7447aa4fd2584dd0a0551e7cb61ec669" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 43669 } }
I20260805 22:47:57.028354 28991 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7447aa4fd2584dd0a0551e7cb61ec669 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:57.028376 28991 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7447aa4fd2584dd0a0551e7cb61ec669 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7447aa4fd2584dd0a0551e7cb61ec669, State: Initialized, Role: FOLLOWER
I20260805 22:47:57.028486 28991 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7447aa4fd2584dd0a0551e7cb61ec669 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7447aa4fd2584dd0a0551e7cb61ec669" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 43669 } }
I20260805 22:47:57.028561 28991 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7447aa4fd2584dd0a0551e7cb61ec669 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:47:57.028594 28991 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7447aa4fd2584dd0a0551e7cb61ec669 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:47:57.028625 28991 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7447aa4fd2584dd0a0551e7cb61ec669 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:57.029142 28991 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7447aa4fd2584dd0a0551e7cb61ec669 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7447aa4fd2584dd0a0551e7cb61ec669" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 43669 } }
I20260805 22:47:57.029232 28991 leader_election.cc:302] T 00000000000000000000000000000000 P 7447aa4fd2584dd0a0551e7cb61ec669 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7447aa4fd2584dd0a0551e7cb61ec669; no voters:
I20260805 22:47:57.029363 28991 leader_election.cc:288] T 00000000000000000000000000000000 P 7447aa4fd2584dd0a0551e7cb61ec669 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:47:57.029431 28996 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7447aa4fd2584dd0a0551e7cb61ec669 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:47:57.029597 28991 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7447aa4fd2584dd0a0551e7cb61ec669 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:47:57.029619 28996 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7447aa4fd2584dd0a0551e7cb61ec669 [term 1 LEADER]: Becoming Leader. State: Replica: 7447aa4fd2584dd0a0551e7cb61ec669, State: Running, Role: LEADER
I20260805 22:47:57.029801 28996 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7447aa4fd2584dd0a0551e7cb61ec669 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7447aa4fd2584dd0a0551e7cb61ec669" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 43669 } }
I20260805 22:47:57.030375 28997 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7447aa4fd2584dd0a0551e7cb61ec669 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7447aa4fd2584dd0a0551e7cb61ec669" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7447aa4fd2584dd0a0551e7cb61ec669" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 43669 } } }
I20260805 22:47:57.030471 28997 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7447aa4fd2584dd0a0551e7cb61ec669 [sys.catalog]: This master's current role is: LEADER
I20260805 22:47:57.030512 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 28872
I20260805 22:47:57.030604 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970021300824-15234-0/minicluster-data/master-0/wal/instance
I20260805 22:47:57.030812 15234 external_mini_cluster.cc:1428] Setting key 770a70513fbe2ac71a0db068d25f7d78
I20260805 22:47:57.030905 28998 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7447aa4fd2584dd0a0551e7cb61ec669 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7447aa4fd2584dd0a0551e7cb61ec669. Latest consensus state: current_term: 1 leader_uuid: "7447aa4fd2584dd0a0551e7cb61ec669" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7447aa4fd2584dd0a0551e7cb61ec669" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 43669 } } }
I20260805 22:47:57.030982 28998 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7447aa4fd2584dd0a0551e7cb61ec669 [sys.catalog]: This master's current role is: LEADER
I20260805 22:47:57.030897 29009 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:47:57.031939 29009 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:47:57.033701 29009 catalog_manager.cc:1347] Generated new cluster ID: 0204849178f54430806a01b5ea01e621
I20260805 22:47:57.033773 29009 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:47:57.036370 29023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:57.031383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49844 (local address 127.14.224.190:43669)
0805 22:47:57.031628 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:57.031650 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:57.031690 (+ 40us) server_negotiation.cc:407] Connection header received
0805 22:47:57.031819 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:57.031828 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:57.031900 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:57.032071 (+ 171us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:57.032301 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:57.033528 (+ 1227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:57.034395 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:57.034839 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:57.034951 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:57.035661 (+ 710us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:57.035665 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:57.035666 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:47:57.035837 (+ 171us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:57.035870 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:47:57.035882 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:57.035940 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:57.036028 (+ 88us) server_negotiation.cc:299] Negotiation successful
0805 22:47:57.036209 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":84,"threads_started":1}
I20260805 22:47:57.047072 29009 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:47:57.047761 29009 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:47:57.049837 29009 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7447aa4fd2584dd0a0551e7cb61ec669: Generated new TSK 0
I20260805 22:47:57.050015 29009 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:47:57.052955 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.129:0
--local_ip_for_outbound_sockets=127.14.224.129
--webserver_interface=127.14.224.129
--webserver_port=0
--tserver_master_addrs=127.14.224.190:43669
--builtin_ntp_servers=127.14.224.148:44189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260805 22:47:57.154855 29027 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:57.155095 29027 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:57.155128 29027 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:57.156386 29027 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:57.156435 29027 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:57.156472 29027 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.129
I20260805 22:47:57.157850 29027 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:44189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.224.129
--webserver_port=0
--tserver_master_addrs=127.14.224.190:43669
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29027
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.129
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:57.158133 29027 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:57.158437 29027 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:57.163543 29034 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:57.163643 29036 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:57.163712 29027 server_base.cc:1034] running on GCE node
W20260805 22:47:57.163854 29039 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:57.164052 29027 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:57.164304 29027 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:57.165459 29027 hybrid_clock.cc:648] HybridClock initialized: now 1785970077165452 us; error 38 us; skew 500 ppm
I20260805 22:47:57.166746 29027 webserver.cc:460] Webserver started at http://127.14.224.129:40399/ using document root <none> and password file <none>
I20260805 22:47:57.166973 29027 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:57.167023 29027 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:57.167160 29027 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:57.168288 29027 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-0/data/instance:
uuid: "bb23830e58d34e3e87653338752e344b"
format_stamp: "Formatted at 2026-08-05 22:47:57 on dist-test-slave-gjrz"
server_key: "79251eaa956a41947424e70d0c2b6417"
server_key_iv: "a60c7a9e6c4bf59161cd136f1e9d7ccd"
server_key_version: "encryptionkey@0"
I20260805 22:47:57.168638 29027 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-0/wal/instance:
uuid: "bb23830e58d34e3e87653338752e344b"
format_stamp: "Formatted at 2026-08-05 22:47:57 on dist-test-slave-gjrz"
server_key: "79251eaa956a41947424e70d0c2b6417"
server_key_iv: "a60c7a9e6c4bf59161cd136f1e9d7ccd"
server_key_version: "encryptionkey@0"
I20260805 22:47:57.169999 29027 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260805 22:47:57.170737 29047 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:57.170890 29027 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260805 22:47:57.170977 29027 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-0/wal
uuid: "bb23830e58d34e3e87653338752e344b"
format_stamp: "Formatted at 2026-08-05 22:47:57 on dist-test-slave-gjrz"
server_key: "79251eaa956a41947424e70d0c2b6417"
server_key_iv: "a60c7a9e6c4bf59161cd136f1e9d7ccd"
server_key_version: "encryptionkey@0"
I20260805 22:47:57.171044 29027 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:57.182801 29027 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:57.183108 29027 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:57.183233 29027 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:57.183501 29027 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:47:57.183837 29027 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:47:57.183871 29027 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:57.183900 29027 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:47:57.183923 29027 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:57.189467 29027 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.129:35355
I20260805 22:47:57.189532 29243 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.129:35355 every 8 connection(s)
I20260805 22:47:57.189867 29027 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
I20260805 22:47:57.194702 29023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:57.190599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.129:39349 (local address 127.14.224.190:43669)
0805 22:47:57.190646 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:57.190648 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:57.190876 (+ 228us) server_negotiation.cc:407] Connection header received
0805 22:47:57.191410 (+ 534us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:57.191411 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:57.191424 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:57.191473 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:57.192092 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:57.192575 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:57.193476 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:57.193653 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:57.193695 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:57.194487 (+ 792us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:57.194488 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:57.194488 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:47:57.194493 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:57.194508 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:47:57.194512 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:57.194549 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:57.194615 (+ 66us) server_negotiation.cc:299] Negotiation successful
0805 22:47:57.194643 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260805 22:47:57.194909 29248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:57.190576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:43669 (local address 127.14.224.129:39349)
0805 22:47:57.190758 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:57.190792 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:57.191321 (+ 529us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:57.191534 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:57.191537 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:57.191545 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:57.192028 (+ 483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:57.192032 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:57.192642 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:57.192643 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:57.193415 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:57.193418 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:57.193710 (+ 292us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:57.193711 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:57.193818 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:57.194337 (+ 519us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 22:47:57.194337 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:57.194377 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 22:47:57.194405 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:57.194559 (+ 154us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:57.194562 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:57.194564 (+ 2us) client_negotiation.cc:769] Sending connection context
0805 22:47:57.194610 (+ 46us) client_negotiation.cc:240] Negotiation successful
0805 22:47:57.194702 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":87,"threads_started":1}
I20260805 22:47:57.195427 29246 heartbeater.cc:347] Connected to a master server at 127.14.224.190:43669
I20260805 22:47:57.195520 29246 heartbeater.cc:464] Registering TS with master...
I20260805 22:47:57.195708 29246 heartbeater.cc:511] Master 127.14.224.190:43669 requested a full tablet report, sending...
I20260805 22:47:57.196292 28924 ts_manager.cc:194] Registered new tserver with Master: bb23830e58d34e3e87653338752e344b (127.14.224.129:35355)
I20260805 22:47:57.196897 28924 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.224.129:39349
I20260805 22:47:57.199791 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 29027
I20260805 22:47:57.199878 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-0/wal/instance
I20260805 22:47:57.200090 15234 external_mini_cluster.cc:1428] Setting key 530f3480bf406bbe5e0ecd2726014e3d
I20260805 22:47:57.200996 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.130:0
--local_ip_for_outbound_sockets=127.14.224.130
--webserver_interface=127.14.224.130
--webserver_port=0
--tserver_master_addrs=127.14.224.190:43669
--builtin_ntp_servers=127.14.224.148:44189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260805 22:47:57.284354 29249 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:57.284577 29249 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:57.284600 29249 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:57.285800 29249 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:57.285848 29249 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:57.285874 29249 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.130
I20260805 22:47:57.287369 29249 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:44189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.224.130
--webserver_port=0
--tserver_master_addrs=127.14.224.190:43669
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29249
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.130
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:57.287617 29249 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:57.287936 29249 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:57.293080 29256 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:57.293056 29258 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:57.293062 29261 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:57.293332 29249 server_base.cc:1034] running on GCE node
I20260805 22:47:57.293570 29249 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:57.293828 29249 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:57.294966 29249 hybrid_clock.cc:648] HybridClock initialized: now 1785970077294955 us; error 30 us; skew 500 ppm
I20260805 22:47:57.296437 29249 webserver.cc:460] Webserver started at http://127.14.224.130:44273/ using document root <none> and password file <none>
I20260805 22:47:57.296744 29249 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:57.296798 29249 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:57.296916 29249 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:57.298061 29249 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-1/data/instance:
uuid: "896a854aaf8f441abefc79417d11cbfa"
format_stamp: "Formatted at 2026-08-05 22:47:57 on dist-test-slave-gjrz"
server_key: "6189ca2e9e45b52bc6c067b7078c6e44"
server_key_iv: "7ad781ade27079984ea2c38aad7c98cc"
server_key_version: "encryptionkey@0"
I20260805 22:47:57.298399 29249 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-1/wal/instance:
uuid: "896a854aaf8f441abefc79417d11cbfa"
format_stamp: "Formatted at 2026-08-05 22:47:57 on dist-test-slave-gjrz"
server_key: "6189ca2e9e45b52bc6c067b7078c6e44"
server_key_iv: "7ad781ade27079984ea2c38aad7c98cc"
server_key_version: "encryptionkey@0"
I20260805 22:47:57.299731 29249 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260805 22:47:57.300612 29271 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:57.300793 29249 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:47:57.300894 29249 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-1/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-1/wal
uuid: "896a854aaf8f441abefc79417d11cbfa"
format_stamp: "Formatted at 2026-08-05 22:47:57 on dist-test-slave-gjrz"
server_key: "6189ca2e9e45b52bc6c067b7078c6e44"
server_key_iv: "7ad781ade27079984ea2c38aad7c98cc"
server_key_version: "encryptionkey@0"
I20260805 22:47:57.300969 29249 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:57.312585 29249 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:57.312917 29249 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:57.313047 29249 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:57.313278 29249 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:47:57.313633 29249 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:47:57.313669 29249 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:57.313701 29249 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:47:57.313724 29249 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:57.319865 29249 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.130:46019
I20260805 22:47:57.319911 29471 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.130:46019 every 8 connection(s)
I20260805 22:47:57.320293 29249 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
I20260805 22:47:57.325660 29023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:57.321088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:37559 (local address 127.14.224.190:43669)
0805 22:47:57.321167 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:57.321170 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:57.321442 (+ 272us) server_negotiation.cc:407] Connection header received
0805 22:47:57.321941 (+ 499us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:57.321942 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:57.321953 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:57.322005 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:57.322721 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:57.323227 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:57.324289 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:57.324481 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:57.324539 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:57.325419 (+ 880us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:57.325420 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:57.325421 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:47:57.325426 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:57.325442 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:47:57.325446 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:57.325487 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:57.325556 (+ 69us) server_negotiation.cc:299] Negotiation successful
0805 22:47:57.325594 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260805 22:47:57.325855 29476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:57.321061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:43669 (local address 127.14.224.130:37559)
0805 22:47:57.321293 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:57.321331 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:57.321833 (+ 502us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:57.322078 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:57.322082 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:57.322090 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:57.322633 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:57.322638 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:57.323375 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:57.323376 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:57.324197 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:57.324200 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:57.324579 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:57.324580 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:57.324712 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:57.325266 (+ 554us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 22:47:57.325266 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:57.325299 (+ 33us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 22:47:57.325325 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:57.325495 (+ 170us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:57.325497 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:57.325500 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:47:57.325553 (+ 53us) client_negotiation.cc:240] Negotiation successful
0805 22:47:57.325641 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":105,"threads_started":1}
I20260805 22:47:57.326304 29472 heartbeater.cc:347] Connected to a master server at 127.14.224.190:43669
I20260805 22:47:57.326399 29472 heartbeater.cc:464] Registering TS with master...
I20260805 22:47:57.326594 29472 heartbeater.cc:511] Master 127.14.224.190:43669 requested a full tablet report, sending...
I20260805 22:47:57.326885 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 29249
I20260805 22:47:57.326982 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-1/wal/instance
I20260805 22:47:57.327051 28924 ts_manager.cc:194] Registered new tserver with Master: 896a854aaf8f441abefc79417d11cbfa (127.14.224.130:46019)
I20260805 22:47:57.327222 15234 external_mini_cluster.cc:1428] Setting key 4ba3e004b46f9f01ecea4d9d2da6446e
I20260805 22:47:57.327525 28924 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.224.130:37559
I20260805 22:47:57.328243 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.131:0
--local_ip_for_outbound_sockets=127.14.224.131
--webserver_interface=127.14.224.131
--webserver_port=0
--tserver_master_addrs=127.14.224.190:43669
--builtin_ntp_servers=127.14.224.148:44189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260805 22:47:57.411427 29477 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:57.411643 29477 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:57.411664 29477 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:57.412868 29477 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:57.412920 29477 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:57.412945 29477 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.131
I20260805 22:47:57.414417 29477 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:44189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.224.131
--webserver_port=0
--tserver_master_addrs=127.14.224.190:43669
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29477
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.131
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:57.414675 29477 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:57.414975 29477 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:57.420123 29488 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:57.420123 29485 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:57.420137 29484 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:57.420370 29477 server_base.cc:1034] running on GCE node
I20260805 22:47:57.420612 29477 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:57.420861 29477 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:57.422049 29477 hybrid_clock.cc:648] HybridClock initialized: now 1785970077422031 us; error 31 us; skew 500 ppm
I20260805 22:47:57.423602 29477 webserver.cc:460] Webserver started at http://127.14.224.131:44961/ using document root <none> and password file <none>
I20260805 22:47:57.423847 29477 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:57.423894 29477 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:57.424031 29477 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:57.425288 29477 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-2/data/instance:
uuid: "3306bd84ee5e4a788504bab69b7a3db2"
format_stamp: "Formatted at 2026-08-05 22:47:57 on dist-test-slave-gjrz"
server_key: "57d8651386e0e83ddb3e44b28554d8d6"
server_key_iv: "b554ecabc8059046a17d40f93e60bf60"
server_key_version: "encryptionkey@0"
I20260805 22:47:57.425685 29477 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-2/wal/instance:
uuid: "3306bd84ee5e4a788504bab69b7a3db2"
format_stamp: "Formatted at 2026-08-05 22:47:57 on dist-test-slave-gjrz"
server_key: "57d8651386e0e83ddb3e44b28554d8d6"
server_key_iv: "b554ecabc8059046a17d40f93e60bf60"
server_key_version: "encryptionkey@0"
I20260805 22:47:57.427047 29477 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260805 22:47:57.427893 29497 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:57.428042 29477 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:57.428138 29477 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-2/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-2/wal
uuid: "3306bd84ee5e4a788504bab69b7a3db2"
format_stamp: "Formatted at 2026-08-05 22:47:57 on dist-test-slave-gjrz"
server_key: "57d8651386e0e83ddb3e44b28554d8d6"
server_key_iv: "b554ecabc8059046a17d40f93e60bf60"
server_key_version: "encryptionkey@0"
I20260805 22:47:57.428212 29477 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:57.437491 29477 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:57.437808 29477 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:57.437937 29477 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:57.438163 29477 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:47:57.438488 29477 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:47:57.438526 29477 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:57.438557 29477 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:47:57.438580 29477 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:57.444092 29477 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.131:41617
I20260805 22:47:57.444152 29693 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.131:41617 every 8 connection(s)
I20260805 22:47:57.444461 29477 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
I20260805 22:47:57.449316 29023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:57.445184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:53213 (local address 127.14.224.190:43669)
0805 22:47:57.445246 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:57.445248 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:57.445468 (+ 220us) server_negotiation.cc:407] Connection header received
0805 22:47:57.445941 (+ 473us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:57.445942 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:57.445951 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:57.446007 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:57.446645 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:57.447145 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:57.448132 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:57.448320 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:57.448372 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:57.449101 (+ 729us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:57.449102 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:57.449102 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:47:57.449108 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:57.449121 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:47:57.449125 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:57.449165 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:57.449224 (+ 59us) server_negotiation.cc:299] Negotiation successful
0805 22:47:57.449250 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260805 22:47:57.449496 29700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:57.445151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:43669 (local address 127.14.224.131:53213)
0805 22:47:57.445353 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:57.445396 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:57.445866 (+ 470us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:57.446069 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:57.446073 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:57.446082 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:57.446580 (+ 498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:57.446584 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:57.447215 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:57.447215 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:57.448056 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:57.448059 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:57.448380 (+ 321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:57.448380 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:57.448486 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:57.448963 (+ 477us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 22:47:57.448963 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:57.448992 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 22:47:57.449016 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:57.449171 (+ 155us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:57.449173 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:57.449175 (+ 2us) client_negotiation.cc:769] Sending connection context
0805 22:47:57.449221 (+ 46us) client_negotiation.cc:240] Negotiation successful
0805 22:47:57.449304 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":92,"threads_started":1}
I20260805 22:47:57.449936 29695 heartbeater.cc:347] Connected to a master server at 127.14.224.190:43669
I20260805 22:47:57.450024 29695 heartbeater.cc:464] Registering TS with master...
I20260805 22:47:57.450191 29695 heartbeater.cc:511] Master 127.14.224.190:43669 requested a full tablet report, sending...
I20260805 22:47:57.450572 28921 ts_manager.cc:194] Registered new tserver with Master: 3306bd84ee5e4a788504bab69b7a3db2 (127.14.224.131:41617)
I20260805 22:47:57.450914 28921 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.224.131:53213
I20260805 22:47:57.454084 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 29477
I20260805 22:47:57.454173 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-2/wal/instance
I20260805 22:47:57.454352 15234 external_mini_cluster.cc:1428] Setting key 7df24f39accac217f1146e98af7ef2fc
I20260805 22:47:57.455190 15234 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260805 22:47:57.456974 29023 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:47:57.456534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49850 (local address 127.14.224.190:43669)
0805 22:47:57.456608 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:57.456610 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:57.456655 (+ 45us) server_negotiation.cc:407] Connection header received
0805 22:47:57.456718 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:57.456719 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:57.456730 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:57.456774 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:57.456906 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49850: BlockingRecv error: recv got EOF from 127.0.0.1:49850 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
I20260805 22:47:57.457024 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 29027
I20260805 22:47:57.466950 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 29249
I20260805 22:47:57.480773 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 29477
I20260805 22:47:57.493750 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 28872
2026-08-05T22:47:57Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (620 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-05T22:47:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:47:57Z Disabled control of system clock
I20260805 22:47:57.525699 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970021300824-15234-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970021300824-15234-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970021300824-15234-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:44209
--webserver_interface=127.14.224.190
--webserver_port=0
--builtin_ntp_servers=127.14.224.148:37743
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.224.190:44209
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260805 22:47:57.608443 29718 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:57.608678 29718 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:57.608700 29718 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:57.610214 29718 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:47:57.610281 29718 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:57.610294 29718 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:57.610307 29718 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:47:57.610320 29718 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:47:57.611996 29718 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:37743
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970021300824-15234-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970021300824-15234-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.224.190:44209
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:44209
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.224.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29718
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970021300824-15234-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:57.612274 29718 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:57.612586 29718 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:57.617453 29726 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:57.617446 29727 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:57.617481 29731 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:57.617686 29718 server_base.cc:1034] running on GCE node
I20260805 22:47:57.617928 29718 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:57.618233 29718 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:57.619351 29718 hybrid_clock.cc:648] HybridClock initialized: now 1785970077619325 us; error 36 us; skew 500 ppm
I20260805 22:47:57.620674 29718 webserver.cc:460] Webserver started at http://127.14.224.190:44589/ using document root <none> and password file <none>
I20260805 22:47:57.620945 29718 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:57.620999 29718 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:57.621125 29718 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:57.622282 29718 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970021300824-15234-0/minicluster-data/master-0/data/instance:
uuid: "18052b187a914fcaabcf0aef8df5dec8"
format_stamp: "Formatted at 2026-08-05 22:47:57 on dist-test-slave-gjrz"
server_key: "5d7d7db996d410c135921bd7c4ea064d"
server_key_iv: "303744e75b64fbfa2c7b131e569d0b7e"
server_key_version: "encryptionkey@0"
I20260805 22:47:57.622643 29718 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970021300824-15234-0/minicluster-data/master-0/wal/instance:
uuid: "18052b187a914fcaabcf0aef8df5dec8"
format_stamp: "Formatted at 2026-08-05 22:47:57 on dist-test-slave-gjrz"
server_key: "5d7d7db996d410c135921bd7c4ea064d"
server_key_iv: "303744e75b64fbfa2c7b131e569d0b7e"
server_key_version: "encryptionkey@0"
I20260805 22:47:57.624123 29718 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260805 22:47:57.624984 29743 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:57.625232 29718 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:47:57.625334 29718 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970021300824-15234-0/minicluster-data/master-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970021300824-15234-0/minicluster-data/master-0/wal
uuid: "18052b187a914fcaabcf0aef8df5dec8"
format_stamp: "Formatted at 2026-08-05 22:47:57 on dist-test-slave-gjrz"
server_key: "5d7d7db996d410c135921bd7c4ea064d"
server_key_iv: "303744e75b64fbfa2c7b131e569d0b7e"
server_key_version: "encryptionkey@0"
I20260805 22:47:57.625406 29718 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970021300824-15234-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970021300824-15234-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970021300824-15234-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:57.628950 29718 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:57.629220 29718 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:57.629347 29718 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:57.633284 29718 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.190:44209
I20260805 22:47:57.633322 29820 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.190:44209 every 8 connection(s)
I20260805 22:47:57.633679 29718 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
I20260805 22:47:57.634368 29821 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:57.637228 29821 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 18052b187a914fcaabcf0aef8df5dec8: Bootstrap starting.
I20260805 22:47:57.637789 29821 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 18052b187a914fcaabcf0aef8df5dec8: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:57.638049 29821 log.cc:824] T 00000000000000000000000000000000 P 18052b187a914fcaabcf0aef8df5dec8: Log is configured to *not* fsync() on all Append() calls
I20260805 22:47:57.638710 29821 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 18052b187a914fcaabcf0aef8df5dec8: No bootstrap required, opened a new log
I20260805 22:47:57.640508 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 29718
I20260805 22:47:57.640430 29821 raft_consensus.cc:348] T 00000000000000000000000000000000 P 18052b187a914fcaabcf0aef8df5dec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18052b187a914fcaabcf0aef8df5dec8" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 44209 } }
I20260805 22:47:57.640574 29821 raft_consensus.cc:374] T 00000000000000000000000000000000 P 18052b187a914fcaabcf0aef8df5dec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:57.640594 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970021300824-15234-0/minicluster-data/master-0/wal/instance
I20260805 22:47:57.640609 29821 raft_consensus.cc:729] T 00000000000000000000000000000000 P 18052b187a914fcaabcf0aef8df5dec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18052b187a914fcaabcf0aef8df5dec8, State: Initialized, Role: FOLLOWER
I20260805 22:47:57.640794 15234 external_mini_cluster.cc:1428] Setting key 77575793bcfe3aeb1fb831fdeec02c67
I20260805 22:47:57.640759 29821 consensus_queue.cc:260] T 00000000000000000000000000000000 P 18052b187a914fcaabcf0aef8df5dec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18052b187a914fcaabcf0aef8df5dec8" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 44209 } }
I20260805 22:47:57.640834 29821 raft_consensus.cc:388] T 00000000000000000000000000000000 P 18052b187a914fcaabcf0aef8df5dec8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:47:57.640877 29821 raft_consensus.cc:482] T 00000000000000000000000000000000 P 18052b187a914fcaabcf0aef8df5dec8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:47:57.640925 29821 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 18052b187a914fcaabcf0aef8df5dec8 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:57.641712 29821 raft_consensus.cc:504] T 00000000000000000000000000000000 P 18052b187a914fcaabcf0aef8df5dec8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18052b187a914fcaabcf0aef8df5dec8" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 44209 } }
I20260805 22:47:57.641826 29821 leader_election.cc:302] T 00000000000000000000000000000000 P 18052b187a914fcaabcf0aef8df5dec8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 18052b187a914fcaabcf0aef8df5dec8; no voters:
I20260805 22:47:57.642017 29821 leader_election.cc:288] T 00000000000000000000000000000000 P 18052b187a914fcaabcf0aef8df5dec8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:47:57.642084 29827 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 18052b187a914fcaabcf0aef8df5dec8 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:47:57.642334 29827 raft_consensus.cc:686] T 00000000000000000000000000000000 P 18052b187a914fcaabcf0aef8df5dec8 [term 1 LEADER]: Becoming Leader. State: Replica: 18052b187a914fcaabcf0aef8df5dec8, State: Running, Role: LEADER
I20260805 22:47:57.642503 29827 consensus_queue.cc:237] T 00000000000000000000000000000000 P 18052b187a914fcaabcf0aef8df5dec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18052b187a914fcaabcf0aef8df5dec8" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 44209 } }
I20260805 22:47:57.642747 29821 sys_catalog.cc:564] T 00000000000000000000000000000000 P 18052b187a914fcaabcf0aef8df5dec8 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:47:57.643157 29832 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18052b187a914fcaabcf0aef8df5dec8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 18052b187a914fcaabcf0aef8df5dec8. Latest consensus state: current_term: 1 leader_uuid: "18052b187a914fcaabcf0aef8df5dec8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18052b187a914fcaabcf0aef8df5dec8" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 44209 } } }
I20260805 22:47:57.643226 29826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:57.641306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55130 (local address 127.14.224.190:44209)
0805 22:47:57.641558 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:57.641568 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:57.641607 (+ 39us) server_negotiation.cc:407] Connection header received
0805 22:47:57.641730 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:57.641738 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:57.641786 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:57.641966 (+ 180us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:57.642676 (+ 710us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:57.642679 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:57.642680 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:47:57.642684 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:57.642730 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:47:57.642745 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:57.642811 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:57.642940 (+ 129us) server_negotiation.cc:299] Negotiation successful
0805 22:47:57.643013 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":101,"threads_started":1}
I20260805 22:47:57.643244 29832 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18052b187a914fcaabcf0aef8df5dec8 [sys.catalog]: This master's current role is: LEADER
I20260805 22:47:57.643707 29844 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:47:57.643869 29833 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18052b187a914fcaabcf0aef8df5dec8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "18052b187a914fcaabcf0aef8df5dec8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18052b187a914fcaabcf0aef8df5dec8" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 44209 } } }
I20260805 22:47:57.644021 29833 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18052b187a914fcaabcf0aef8df5dec8 [sys.catalog]: This master's current role is: LEADER
I20260805 22:47:57.644326 29844 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:47:57.645967 29844 catalog_manager.cc:1347] Generated new cluster ID: b3946b7626d74781ab2b1ef8372e994b
I20260805 22:47:57.646028 29844 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:47:57.657085 29844 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:47:57.657280 29844 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:47:57.661046 29844 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 18052b187a914fcaabcf0aef8df5dec8: Generated new TSK 0
I20260805 22:47:57.661274 29844 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:47:57.663928 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.129:0
--local_ip_for_outbound_sockets=127.14.224.129
--webserver_interface=127.14.224.129
--webserver_port=0
--tserver_master_addrs=127.14.224.190:44209
--builtin_ntp_servers=127.14.224.148:37743
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260805 22:47:57.749022 29863 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:57.749248 29863 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:57.749282 29863 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:57.750556 29863 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:57.750607 29863 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:57.750646 29863 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.129
I20260805 22:47:57.752158 29863 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:37743
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.224.129
--webserver_port=0
--tserver_master_addrs=127.14.224.190:44209
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29863
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.129
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:57.752424 29863 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:57.752720 29863 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:57.757810 29874 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:57.757831 29875 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:57.757814 29881 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:57.758360 29863 server_base.cc:1034] running on GCE node
I20260805 22:47:57.758586 29863 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:57.758839 29863 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:57.759986 29863 hybrid_clock.cc:648] HybridClock initialized: now 1785970077759975 us; error 34 us; skew 500 ppm
I20260805 22:47:57.761303 29863 webserver.cc:460] Webserver started at http://127.14.224.129:35475/ using document root <none> and password file <none>
I20260805 22:47:57.761561 29863 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:57.761615 29863 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:57.761751 29863 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:57.762864 29863 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-0/data/instance:
uuid: "a2a2a40c4e8648d48752da00c34d02d6"
format_stamp: "Formatted at 2026-08-05 22:47:57 on dist-test-slave-gjrz"
server_key: "2f0b30e31e4ec9cbd8749242366123bc"
server_key_iv: "6e8bf3c2c16758f3cb233f7d204d194d"
server_key_version: "encryptionkey@0"
I20260805 22:47:57.763224 29863 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-0/wal/instance:
uuid: "a2a2a40c4e8648d48752da00c34d02d6"
format_stamp: "Formatted at 2026-08-05 22:47:57 on dist-test-slave-gjrz"
server_key: "2f0b30e31e4ec9cbd8749242366123bc"
server_key_iv: "6e8bf3c2c16758f3cb233f7d204d194d"
server_key_version: "encryptionkey@0"
I20260805 22:47:57.764644 29863 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:47:57.765462 29897 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:57.765637 29863 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:47:57.765743 29863 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-0/wal
uuid: "a2a2a40c4e8648d48752da00c34d02d6"
format_stamp: "Formatted at 2026-08-05 22:47:57 on dist-test-slave-gjrz"
server_key: "2f0b30e31e4ec9cbd8749242366123bc"
server_key_iv: "6e8bf3c2c16758f3cb233f7d204d194d"
server_key_version: "encryptionkey@0"
I20260805 22:47:57.765825 29863 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:57.770999 29863 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:57.771364 29863 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:57.771502 29863 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:57.771727 29863 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:47:57.772073 29863 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:47:57.772112 29863 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:57.772146 29863 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:47:57.772169 29863 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:57.779176 29863 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.129:43841
I20260805 22:47:57.779255 30075 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.129:43841 every 8 connection(s)
I20260805 22:47:57.779619 29863 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
I20260805 22:47:57.780529 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 29863
I20260805 22:47:57.780651 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-0/wal/instance
I20260805 22:47:57.780881 15234 external_mini_cluster.cc:1428] Setting key 05211ac93464e3e1f25eb8681c4b0996
I20260805 22:47:57.781919 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.130:0
--local_ip_for_outbound_sockets=127.14.224.130
--webserver_interface=127.14.224.130
--webserver_port=0
--tserver_master_addrs=127.14.224.190:44209
--builtin_ntp_servers=127.14.224.148:37743
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260805 22:47:57.782878 29826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:57.780337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.129:36155 (local address 127.14.224.190:44209)
0805 22:47:57.780420 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:57.780422 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:57.780708 (+ 286us) server_negotiation.cc:407] Connection header received
0805 22:47:57.781313 (+ 605us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:57.781314 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:57.781321 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:57.781386 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:57.782650 (+ 1264us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:57.782651 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:57.782652 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:47:57.782656 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:57.782674 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:47:57.782678 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:57.782726 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:57.782811 (+ 85us) server_negotiation.cc:299] Negotiation successful
0805 22:47:57.782824 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260805 22:47:57.783107 30083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:57.780326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:44209 (local address 127.14.224.129:36155)
0805 22:47:57.780545 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:57.780596 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:57.781224 (+ 628us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:57.781446 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:57.781449 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:57.781459 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:57.782474 (+ 1015us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 22:47:57.782475 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:57.782517 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 22:47:57.782555 (+ 38us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:57.782739 (+ 184us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:57.782744 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:57.782747 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:47:57.782820 (+ 73us) client_negotiation.cc:240] Negotiation successful
0805 22:47:57.782886 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":92,"threads_started":1}
I20260805 22:47:57.783654 30079 heartbeater.cc:347] Connected to a master server at 127.14.224.190:44209
I20260805 22:47:57.783757 30079 heartbeater.cc:464] Registering TS with master...
I20260805 22:47:57.783916 30079 heartbeater.cc:511] Master 127.14.224.190:44209 requested a full tablet report, sending...
I20260805 22:47:57.784440 29767 ts_manager.cc:194] Registered new tserver with Master: a2a2a40c4e8648d48752da00c34d02d6 (127.14.224.129:43841)
W20260805 22:47:57.867095 30084 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:57.867365 30084 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:57.867396 30084 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:57.868672 30084 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:57.868723 30084 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:57.868750 30084 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.130
I20260805 22:47:57.870249 30084 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:37743
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.224.130
--webserver_port=0
--tserver_master_addrs=127.14.224.190:44209
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30084
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.130
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:57.870522 30084 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:57.870826 30084 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:57.876003 30097 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:57.875998 30093 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:57.876065 30100 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:57.876160 30084 server_base.cc:1034] running on GCE node
I20260805 22:47:57.876448 30084 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:57.876736 30084 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:57.877929 30084 hybrid_clock.cc:648] HybridClock initialized: now 1785970077877911 us; error 28 us; skew 500 ppm
I20260805 22:47:57.879441 30084 webserver.cc:460] Webserver started at http://127.14.224.130:43375/ using document root <none> and password file <none>
I20260805 22:47:57.879702 30084 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:57.879755 30084 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:57.879884 30084 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:57.881069 30084 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-1/data/instance:
uuid: "d82831b226974b67a6103414b4a5679e"
format_stamp: "Formatted at 2026-08-05 22:47:57 on dist-test-slave-gjrz"
server_key: "46d8d5d318d6f8e329dedd2063c865da"
server_key_iv: "8934d68dccde428ecaa3474d1fdf4e0a"
server_key_version: "encryptionkey@0"
I20260805 22:47:57.881388 30084 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-1/wal/instance:
uuid: "d82831b226974b67a6103414b4a5679e"
format_stamp: "Formatted at 2026-08-05 22:47:57 on dist-test-slave-gjrz"
server_key: "46d8d5d318d6f8e329dedd2063c865da"
server_key_iv: "8934d68dccde428ecaa3474d1fdf4e0a"
server_key_version: "encryptionkey@0"
I20260805 22:47:57.882699 30084 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260805 22:47:57.883476 30107 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:57.883615 30084 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260805 22:47:57.883702 30084 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-1/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-1/wal
uuid: "d82831b226974b67a6103414b4a5679e"
format_stamp: "Formatted at 2026-08-05 22:47:57 on dist-test-slave-gjrz"
server_key: "46d8d5d318d6f8e329dedd2063c865da"
server_key_iv: "8934d68dccde428ecaa3474d1fdf4e0a"
server_key_version: "encryptionkey@0"
I20260805 22:47:57.883778 30084 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:57.887179 30084 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:57.887475 30084 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:57.887600 30084 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:57.887804 30084 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:47:57.888132 30084 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:47:57.888166 30084 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:57.888195 30084 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:47:57.888218 30084 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:57.893992 30084 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.130:39337
I20260805 22:47:57.894033 30280 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.130:39337 every 8 connection(s)
I20260805 22:47:57.894372 30084 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
I20260805 22:47:57.897661 29826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:57.895106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:32921 (local address 127.14.224.190:44209)
0805 22:47:57.895181 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:57.895183 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:57.895479 (+ 296us) server_negotiation.cc:407] Connection header received
0805 22:47:57.895947 (+ 468us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:57.895948 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:57.895954 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:57.896020 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:57.897279 (+ 1259us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:57.897280 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:57.897281 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:47:57.897287 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:57.897317 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:47:57.897323 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:57.897394 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:57.897571 (+ 177us) server_negotiation.cc:299] Negotiation successful
0805 22:47:57.897589 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260805 22:47:57.897897 30285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:57.895083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:44209 (local address 127.14.224.130:32921)
0805 22:47:57.895317 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:57.895360 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:57.895843 (+ 483us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:57.896089 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:57.896092 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:57.896101 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:57.897042 (+ 941us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 22:47:57.897043 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:57.897079 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 22:47:57.897115 (+ 36us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:57.897430 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:57.897437 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:57.897441 (+ 4us) client_negotiation.cc:769] Sending connection context
0805 22:47:57.897543 (+ 102us) client_negotiation.cc:240] Negotiation successful
0805 22:47:57.897608 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":90,"threads_started":1}
I20260805 22:47:57.898044 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 30084
I20260805 22:47:57.898125 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-1/wal/instance
I20260805 22:47:57.898311 15234 external_mini_cluster.cc:1428] Setting key 6cf2fff932fcd2c903f4f70a49e24ff0
I20260805 22:47:57.898716 30281 heartbeater.cc:347] Connected to a master server at 127.14.224.190:44209
I20260805 22:47:57.898813 30281 heartbeater.cc:464] Registering TS with master...
I20260805 22:47:57.898983 30281 heartbeater.cc:511] Master 127.14.224.190:44209 requested a full tablet report, sending...
I20260805 22:47:57.899374 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.131:0
--local_ip_for_outbound_sockets=127.14.224.131
--webserver_interface=127.14.224.131
--webserver_port=0
--tserver_master_addrs=127.14.224.190:44209
--builtin_ntp_servers=127.14.224.148:37743
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260805 22:47:57.899478 29767 ts_manager.cc:194] Registered new tserver with Master: d82831b226974b67a6103414b4a5679e (127.14.224.130:39337)
W20260805 22:47:57.982791 30287 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:57.983007 30287 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:57.983029 30287 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:57.984277 30287 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:57.984326 30287 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:57.984355 30287 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.131
I20260805 22:47:57.985761 30287 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:37743
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.224.131
--webserver_port=0
--tserver_master_addrs=127.14.224.190:44209
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30287
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.131
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:57.986011 30287 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:57.986346 30287 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:57.991396 30302 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:57.991382 30298 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:57.991443 30287 server_base.cc:1034] running on GCE node
W20260805 22:47:57.991379 30297 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:57.991914 30287 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:57.992194 30287 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:57.993360 30287 hybrid_clock.cc:648] HybridClock initialized: now 1785970077993347 us; error 29 us; skew 500 ppm
I20260805 22:47:57.994656 30287 webserver.cc:460] Webserver started at http://127.14.224.131:42799/ using document root <none> and password file <none>
I20260805 22:47:57.994921 30287 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:57.994975 30287 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:57.995105 30287 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:57.996201 30287 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-2/data/instance:
uuid: "161f6a943b644d589d0e69ddc31c1c3e"
format_stamp: "Formatted at 2026-08-05 22:47:57 on dist-test-slave-gjrz"
server_key: "e46a7f9168276ff75d08f5f2a6244083"
server_key_iv: "9a2936062a25c1d81c20ab5c87fe792a"
server_key_version: "encryptionkey@0"
I20260805 22:47:57.996543 30287 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-2/wal/instance:
uuid: "161f6a943b644d589d0e69ddc31c1c3e"
format_stamp: "Formatted at 2026-08-05 22:47:57 on dist-test-slave-gjrz"
server_key: "e46a7f9168276ff75d08f5f2a6244083"
server_key_iv: "9a2936062a25c1d81c20ab5c87fe792a"
server_key_version: "encryptionkey@0"
I20260805 22:47:57.997812 30287 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260805 22:47:57.998550 30310 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:57.998724 30287 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260805 22:47:57.998821 30287 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-2/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-2/wal
uuid: "161f6a943b644d589d0e69ddc31c1c3e"
format_stamp: "Formatted at 2026-08-05 22:47:57 on dist-test-slave-gjrz"
server_key: "e46a7f9168276ff75d08f5f2a6244083"
server_key_iv: "9a2936062a25c1d81c20ab5c87fe792a"
server_key_version: "encryptionkey@0"
I20260805 22:47:57.998893 30287 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:58.002321 30287 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:58.002583 30287 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:58.002712 30287 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:58.002905 30287 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:47:58.003225 30287 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:47:58.003278 30287 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:58.003309 30287 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:47:58.003334 30287 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:58.008917 30287 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.131:36819
I20260805 22:47:58.008996 30476 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.131:36819 every 8 connection(s)
I20260805 22:47:58.009321 30287 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
I20260805 22:47:58.012446 29826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:58.010053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:42183 (local address 127.14.224.190:44209)
0805 22:47:58.010105 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:58.010108 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:58.010338 (+ 230us) server_negotiation.cc:407] Connection header received
0805 22:47:58.010850 (+ 512us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:58.010852 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:58.010858 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:58.010911 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:58.012194 (+ 1283us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:58.012196 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:58.012196 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:47:58.012201 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:58.012220 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:47:58.012225 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:58.012276 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:58.012350 (+ 74us) server_negotiation.cc:299] Negotiation successful
0805 22:47:58.012367 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260805 22:47:58.012730 30480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:58.010027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:44209 (local address 127.14.224.131:42183)
0805 22:47:58.010220 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:58.010255 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:58.010743 (+ 488us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:58.010988 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:58.010992 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:58.011000 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:58.012024 (+ 1024us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 22:47:58.012024 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:58.012057 (+ 33us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 22:47:58.012090 (+ 33us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:58.012278 (+ 188us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:58.012284 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:58.012287 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:47:58.012357 (+ 70us) client_negotiation.cc:240] Negotiation successful
0805 22:47:58.012425 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":90,"threads_started":1}
I20260805 22:47:58.013545 30477 heartbeater.cc:347] Connected to a master server at 127.14.224.190:44209
I20260805 22:47:58.013721 30477 heartbeater.cc:464] Registering TS with master...
I20260805 22:47:58.013988 30477 heartbeater.cc:511] Master 127.14.224.190:44209 requested a full tablet report, sending...
I20260805 22:47:58.014408 29767 ts_manager.cc:194] Registered new tserver with Master: 161f6a943b644d589d0e69ddc31c1c3e (127.14.224.131:36819)
I20260805 22:47:58.014986 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 30287
I20260805 22:47:58.015110 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970021300824-15234-0/minicluster-data/ts-2/wal/instance
I20260805 22:47:58.015348 15234 external_mini_cluster.cc:1428] Setting key ce4055bb420d45dd7722dfd88c0e6aa9
I20260805 22:47:58.016249 15234 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260805 22:47:58.018429 29826 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:47:58.017747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55140 (local address 127.14.224.190:44209)
0805 22:47:58.017832 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:58.017834 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:58.017977 (+ 143us) server_negotiation.cc:407] Connection header received
0805 22:47:58.018106 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:58.018107 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:58.018112 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:58.018170 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:58.018359 (+ 189us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55140: BlockingRecv error: recv got EOF from 127.0.0.1:55140 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
I20260805 22:47:58.018499 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 29863
I20260805 22:47:58.025840 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 30084
I20260805 22:47:58.036273 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 30287
I20260805 22:47:58.047452 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 29718
2026-08-05T22:47:58Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (560 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:47:58 dist-test-slave-gjrz krb5kdc[30489](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:47:58 dist-test-slave-gjrz krb5kdc[30489](info): set up 2 sockets
Aug 05 22:47:58 dist-test-slave-gjrz krb5kdc[30489](info): commencing operation
krb5kdc: starting...
W20260805 22:47:59.172055 15234 mini_kdc.cc:121] Time spent starting KDC: real 1.094s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Aug 05 22:47:59 dist-test-slave-gjrz krb5kdc[30489](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970079, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:47:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:47:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.224.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab.
Entry for principal kudu/127.14.224.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab.
I20260805 22:47:59.298697 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:44919
--webserver_interface=127.14.224.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:38713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.224.190:44919
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:47:59.382539 30513 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:59.382766 30513 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:59.382789 30513 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:59.383948 30513 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:47:59.383989 30513 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:59.384002 30513 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:59.384013 30513 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:47:59.384025 30513 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:47:59.385560 30513 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:38713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.224.190:44919
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:44919
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.224.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30513
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:59.385825 30513 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:59.386039 30513 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260805 22:47:59.391142 30513 server_base.cc:1034] running on GCE node
W20260805 22:47:59.391106 30520 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:59.391083 30522 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:59.391083 30528 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:59.391570 30513 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:59.391891 30513 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:59.393056 30513 hybrid_clock.cc:648] HybridClock initialized: now 1785970079393039 us; error 32 us; skew 500 ppm
Aug 05 22:47:59 dist-test-slave-gjrz krb5kdc[30489](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970079, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:59.395756 30513 init.cc:377] Logged in from keytab as kudu/127.14.224.190@KRBTEST.COM (short username kudu)
I20260805 22:47:59.396261 30513 webserver.cc:460] Webserver started at http://127.14.224.190:36343/ using document root <none> and password file <none>
I20260805 22:47:59.396508 30513 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:59.396556 30513 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:59.396690 30513 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:59.397782 30513 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/minicluster-data/master-0/data/instance:
uuid: "1275de755c0e4bf3bf34d5bab1782067"
format_stamp: "Formatted at 2026-08-05 22:47:59 on dist-test-slave-gjrz"
server_key: "6fe7e9ac78944245241ad92eb5c18ab1"
server_key_iv: "31a6977edbbe4504631d249665dd2c24"
server_key_version: "encryptionkey@0"
I20260805 22:47:59.398135 30513 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/minicluster-data/master-0/wal/instance:
uuid: "1275de755c0e4bf3bf34d5bab1782067"
format_stamp: "Formatted at 2026-08-05 22:47:59 on dist-test-slave-gjrz"
server_key: "6fe7e9ac78944245241ad92eb5c18ab1"
server_key_iv: "31a6977edbbe4504631d249665dd2c24"
server_key_version: "encryptionkey@0"
I20260805 22:47:59.399524 30513 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260805 22:47:59.400362 30539 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:59.400537 30513 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:47:59.400636 30513 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/minicluster-data/master-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/minicluster-data/master-0/wal
uuid: "1275de755c0e4bf3bf34d5bab1782067"
format_stamp: "Formatted at 2026-08-05 22:47:59 on dist-test-slave-gjrz"
server_key: "6fe7e9ac78944245241ad92eb5c18ab1"
server_key_iv: "31a6977edbbe4504631d249665dd2c24"
server_key_version: "encryptionkey@0"
I20260805 22:47:59.400705 30513 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:59.431592 30513 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:59.433756 30513 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:59.433917 30513 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:59.438009 30513 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.190:44919
I20260805 22:47:59.438060 30625 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.190:44919 every 8 connection(s)
I20260805 22:47:59.438421 30513 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
I20260805 22:47:59.439476 30628 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:59.441900 30628 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1275de755c0e4bf3bf34d5bab1782067: Bootstrap starting.
I20260805 22:47:59.442529 30628 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1275de755c0e4bf3bf34d5bab1782067: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:59.442824 30628 log.cc:824] T 00000000000000000000000000000000 P 1275de755c0e4bf3bf34d5bab1782067: Log is configured to *not* fsync() on all Append() calls
I20260805 22:47:59.443631 30628 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1275de755c0e4bf3bf34d5bab1782067: No bootstrap required, opened a new log
I20260805 22:47:59.445060 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 30513
I20260805 22:47:59.445171 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/minicluster-data/master-0/wal/instance
I20260805 22:47:59.445364 15234 external_mini_cluster.cc:1428] Setting key 45cdc38652be686f0e30f3049feba09b
I20260805 22:47:59.445524 30628 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1275de755c0e4bf3bf34d5bab1782067 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1275de755c0e4bf3bf34d5bab1782067" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 44919 } }
I20260805 22:47:59.445695 30628 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1275de755c0e4bf3bf34d5bab1782067 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:59.445726 30628 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1275de755c0e4bf3bf34d5bab1782067 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1275de755c0e4bf3bf34d5bab1782067, State: Initialized, Role: FOLLOWER
I20260805 22:47:59.445889 30628 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1275de755c0e4bf3bf34d5bab1782067 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1275de755c0e4bf3bf34d5bab1782067" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 44919 } }
I20260805 22:47:59.445971 30628 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1275de755c0e4bf3bf34d5bab1782067 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:47:59.446002 30628 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1275de755c0e4bf3bf34d5bab1782067 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:47:59.446043 30628 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1275de755c0e4bf3bf34d5bab1782067 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:47:59.447135 30628 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1275de755c0e4bf3bf34d5bab1782067 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1275de755c0e4bf3bf34d5bab1782067" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 44919 } }
I20260805 22:47:59.447253 30628 leader_election.cc:302] T 00000000000000000000000000000000 P 1275de755c0e4bf3bf34d5bab1782067 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1275de755c0e4bf3bf34d5bab1782067; no voters:
I20260805 22:47:59.447464 30628 leader_election.cc:288] T 00000000000000000000000000000000 P 1275de755c0e4bf3bf34d5bab1782067 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:47:59.447520 30636 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1275de755c0e4bf3bf34d5bab1782067 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:47:59.447664 30636 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1275de755c0e4bf3bf34d5bab1782067 [term 1 LEADER]: Becoming Leader. State: Replica: 1275de755c0e4bf3bf34d5bab1782067, State: Running, Role: LEADER
I20260805 22:47:59.447743 30628 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1275de755c0e4bf3bf34d5bab1782067 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:47:59.447762 30636 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1275de755c0e4bf3bf34d5bab1782067 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1275de755c0e4bf3bf34d5bab1782067" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 44919 } }
I20260805 22:47:59.448127 30636 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1275de755c0e4bf3bf34d5bab1782067 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1275de755c0e4bf3bf34d5bab1782067. Latest consensus state: current_term: 1 leader_uuid: "1275de755c0e4bf3bf34d5bab1782067" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1275de755c0e4bf3bf34d5bab1782067" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 44919 } } }
I20260805 22:47:59.448203 30636 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1275de755c0e4bf3bf34d5bab1782067 [sys.catalog]: This master's current role is: LEADER
I20260805 22:47:59.448349 30638 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1275de755c0e4bf3bf34d5bab1782067 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1275de755c0e4bf3bf34d5bab1782067" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1275de755c0e4bf3bf34d5bab1782067" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 44919 } } }
I20260805 22:47:59.448406 30638 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1275de755c0e4bf3bf34d5bab1782067 [sys.catalog]: This master's current role is: LEADER
I20260805 22:47:59.448518 30643 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:47:59.449060 30643 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:47:59.450845 30643 catalog_manager.cc:1347] Generated new cluster ID: 131c8bcfaae2476884f2ea674b8af8be
I20260805 22:47:59.450907 30643 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 05 22:47:59 dist-test-slave-gjrz krb5kdc[30489](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970079, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:47:59.456251 30634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:59.445922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44682 (local address 127.14.224.190:44919)
0805 22:47:59.446121 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:59.446133 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:59.446174 (+ 41us) server_negotiation.cc:407] Connection header received
0805 22:47:59.446305 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:59.446311 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:59.446366 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:59.446478 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:59.447253 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:59.448635 (+ 1382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:59.449798 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:59.450357 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:59.450512 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:59.453004 (+ 2492us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:59.453009 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:59.453009 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:59.453024 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:59.454659 (+ 1635us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:59.455015 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:59.455018 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:59.455018 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:59.455132 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:59.455357 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:59.455358 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:59.455358 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:59.455634 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:59.455791 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:59.455900 (+ 109us) server_negotiation.cc:299] Negotiation successful
0805 22:47:59.456048 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":93,"threads_started":1}
I20260805 22:47:59.462427 30643 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:47:59.463184 30643 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:47:59.476629 30643 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1275de755c0e4bf3bf34d5bab1782067: Generated new TSK 0
I20260805 22:47:59.476840 30643 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.224.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab.
Entry for principal kudu/127.14.224.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab.
I20260805 22:47:59.512255 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.129:0
--local_ip_for_outbound_sockets=127.14.224.129
--webserver_interface=127.14.224.129
--webserver_port=0
--tserver_master_addrs=127.14.224.190:44919
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab
--principal=kudu/127.14.224.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:38713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:47:59.597446 30663 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:59.597679 30663 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:59.597714 30663 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:59.598937 30663 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:59.598989 30663 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:59.599025 30663 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.129
I20260805 22:47:59.600631 30663 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:38713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab
--principal=kudu/127.14.224.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.224.129
--webserver_port=0
--tserver_master_addrs=127.14.224.190:44919
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30663
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.129
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:59.600908 30663 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:59.601152 30663 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:59.606670 30673 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:59.606654 30676 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:59.606655 30674 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:59.606971 30663 server_base.cc:1034] running on GCE node
I20260805 22:47:59.607173 30663 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:59.607441 30663 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:59.608598 30663 hybrid_clock.cc:648] HybridClock initialized: now 1785970079608583 us; error 33 us; skew 500 ppm
Aug 05 22:47:59 dist-test-slave-gjrz krb5kdc[30489](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970079, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:59.611176 30663 init.cc:377] Logged in from keytab as kudu/127.14.224.129@KRBTEST.COM (short username kudu)
I20260805 22:47:59.611712 30663 webserver.cc:460] Webserver started at http://127.14.224.129:33985/ using document root <none> and password file <none>
I20260805 22:47:59.611954 30663 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:59.612008 30663 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:59.612145 30663 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:59.613260 30663 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/minicluster-data/ts-0/data/instance:
uuid: "c7fb3b221c6843beb32e216621e7ca8a"
format_stamp: "Formatted at 2026-08-05 22:47:59 on dist-test-slave-gjrz"
server_key: "d43602736063f085b8e065755e20ee23"
server_key_iv: "3d1f7efe39a7beae1a77cd97b2e71ef7"
server_key_version: "encryptionkey@0"
I20260805 22:47:59.613618 30663 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/minicluster-data/ts-0/wal/instance:
uuid: "c7fb3b221c6843beb32e216621e7ca8a"
format_stamp: "Formatted at 2026-08-05 22:47:59 on dist-test-slave-gjrz"
server_key: "d43602736063f085b8e065755e20ee23"
server_key_iv: "3d1f7efe39a7beae1a77cd97b2e71ef7"
server_key_version: "encryptionkey@0"
I20260805 22:47:59.615043 30663 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260805 22:47:59.615846 30686 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:59.615995 30663 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:59.616074 30663 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/minicluster-data/ts-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/minicluster-data/ts-0/wal
uuid: "c7fb3b221c6843beb32e216621e7ca8a"
format_stamp: "Formatted at 2026-08-05 22:47:59 on dist-test-slave-gjrz"
server_key: "d43602736063f085b8e065755e20ee23"
server_key_iv: "3d1f7efe39a7beae1a77cd97b2e71ef7"
server_key_version: "encryptionkey@0"
I20260805 22:47:59.616144 30663 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:59.628783 30663 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:59.630985 30663 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:59.631132 30663 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:59.631400 30663 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:47:59.631728 30663 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:47:59.631764 30663 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:59.631794 30663 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:47:59.631819 30663 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:59.637970 30663 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.129:44453
I20260805 22:47:59.638019 30858 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.129:44453 every 8 connection(s)
I20260805 22:47:59.638357 30663 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
I20260805 22:47:59.638556 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 30663
I20260805 22:47:59.638656 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/minicluster-data/ts-0/wal/instance
I20260805 22:47:59.638883 15234 external_mini_cluster.cc:1428] Setting key fe1c28594a49daaf92ca4f5f740ac409
Aug 05 22:47:59 dist-test-slave-gjrz krb5kdc[30489](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970079, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.129@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.14.224.130@KRBTEST.COM; defaulting to no policy
I20260805 22:47:59.648693 30634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:59.639249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.129:53979 (local address 127.14.224.190:44919)
0805 22:47:59.639317 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:59.639319 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:59.639586 (+ 267us) server_negotiation.cc:407] Connection header received
0805 22:47:59.640129 (+ 543us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:59.640130 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:59.640145 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:59.640197 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:59.641202 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:59.641737 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:59.643017 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:59.643362 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:59.643435 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:59.645773 (+ 2338us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:59.645775 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:59.645775 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:59.645784 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:59.647124 (+ 1340us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:59.647671 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:59.647673 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:59.647673 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:59.647732 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:59.647970 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:59.647971 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:59.647972 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:59.648115 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:59.648176 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:59.648474 (+ 298us) server_negotiation.cc:299] Negotiation successful
0805 22:47:59.648573 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260805 22:47:59.648881 30862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:59.639254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:44919 (local address 127.14.224.129:53979)
0805 22:47:59.639452 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:59.639493 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:59.640020 (+ 527us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:59.640273 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:59.640276 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:59.640871 (+ 595us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:59.641087 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:59.641094 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:59.641833 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:59.641834 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:59.642891 (+ 1057us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:59.642895 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:59.643443 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:59.643444 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:59.643571 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:59.644155 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:59.644165 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:59.645666 (+ 1501us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:59.647213 (+ 1547us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:59.647224 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:59.647226 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:59.647579 (+ 353us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:59.647791 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:59.647792 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:59.647792 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:59.647914 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:59.648174 (+ 260us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:59.648183 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:59.648338 (+ 155us) client_negotiation.cc:769] Sending connection context
0805 22:47:59.648437 (+ 99us) client_negotiation.cc:240] Negotiation successful
0805 22:47:59.648642 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":90,"threads_started":1}
I20260805 22:47:59.649415 30859 heartbeater.cc:347] Connected to a master server at 127.14.224.190:44919
I20260805 22:47:59.649515 30859 heartbeater.cc:464] Registering TS with master...
I20260805 22:47:59.649679 30859 heartbeater.cc:511] Master 127.14.224.190:44919 requested a full tablet report, sending...
I20260805 22:47:59.650331 30564 ts_manager.cc:194] Registered new tserver with Master: c7fb3b221c6843beb32e216621e7ca8a (127.14.224.129:44453)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.130@KRBTEST.COM" created.
I20260805 22:47:59.651067 30564 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.224.129@KRBTEST.COM'} at 127.14.224.129:53979
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab.
Entry for principal kudu/127.14.224.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab.
I20260805 22:47:59.668146 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.130:0
--local_ip_for_outbound_sockets=127.14.224.130
--webserver_interface=127.14.224.130
--webserver_port=0
--tserver_master_addrs=127.14.224.190:44919
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab
--principal=kudu/127.14.224.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:38713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:47:59.750784 30866 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:59.751005 30866 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:59.751029 30866 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:59.752254 30866 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:59.752303 30866 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:59.752329 30866 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.130
I20260805 22:47:59.753849 30866 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:38713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab
--principal=kudu/127.14.224.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.224.130
--webserver_port=0
--tserver_master_addrs=127.14.224.190:44919
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30866
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.130
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:59.754105 30866 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:59.754338 30866 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:59.759336 30873 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:59.759330 30880 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:59.759330 30872 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:59.759565 30866 server_base.cc:1034] running on GCE node
I20260805 22:47:59.759841 30866 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:59.760107 30866 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:59.761278 30866 hybrid_clock.cc:648] HybridClock initialized: now 1785970079761267 us; error 28 us; skew 500 ppm
Aug 05 22:47:59 dist-test-slave-gjrz krb5kdc[30489](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970079, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:59.763993 30866 init.cc:377] Logged in from keytab as kudu/127.14.224.130@KRBTEST.COM (short username kudu)
I20260805 22:47:59.764483 30866 webserver.cc:460] Webserver started at http://127.14.224.130:45123/ using document root <none> and password file <none>
I20260805 22:47:59.764714 30866 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:59.764765 30866 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:59.764895 30866 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:59.765959 30866 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/minicluster-data/ts-1/data/instance:
uuid: "b05a3e49778b4170b609717bafc77e52"
format_stamp: "Formatted at 2026-08-05 22:47:59 on dist-test-slave-gjrz"
server_key: "2fb5b28042f92d50e5aa7c4a721d2794"
server_key_iv: "438535b70f8a892b43a920fa2e281d7a"
server_key_version: "encryptionkey@0"
I20260805 22:47:59.766299 30866 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/minicluster-data/ts-1/wal/instance:
uuid: "b05a3e49778b4170b609717bafc77e52"
format_stamp: "Formatted at 2026-08-05 22:47:59 on dist-test-slave-gjrz"
server_key: "2fb5b28042f92d50e5aa7c4a721d2794"
server_key_iv: "438535b70f8a892b43a920fa2e281d7a"
server_key_version: "encryptionkey@0"
I20260805 22:47:59.767616 30866 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260805 22:47:59.768412 30893 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:59.768579 30866 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:47:59.768677 30866 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/minicluster-data/ts-1/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/minicluster-data/ts-1/wal
uuid: "b05a3e49778b4170b609717bafc77e52"
format_stamp: "Formatted at 2026-08-05 22:47:59 on dist-test-slave-gjrz"
server_key: "2fb5b28042f92d50e5aa7c4a721d2794"
server_key_iv: "438535b70f8a892b43a920fa2e281d7a"
server_key_version: "encryptionkey@0"
I20260805 22:47:59.768743 30866 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:59.782680 30866 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:59.784905 30866 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:59.785058 30866 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:59.785334 30866 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:47:59.785651 30866 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:47:59.785686 30866 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:59.785717 30866 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:47:59.785739 30866 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:59.791520 30866 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.130:36213
I20260805 22:47:59.791574 31059 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.130:36213 every 8 connection(s)
I20260805 22:47:59.791913 30866 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
I20260805 22:47:59.793972 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 30866
I20260805 22:47:59.794061 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/minicluster-data/ts-1/wal/instance
I20260805 22:47:59.794220 15234 external_mini_cluster.cc:1428] Setting key 059f98aa68d3077acf80566058370dbe
Aug 05 22:47:59 dist-test-slave-gjrz krb5kdc[30489](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970079, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.130@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:47:59.801668 30634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:59.792628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:36165 (local address 127.14.224.190:44919)
0805 22:47:59.792695 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:59.792697 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:59.792897 (+ 200us) server_negotiation.cc:407] Connection header received
0805 22:47:59.793390 (+ 493us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:59.793391 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:59.793402 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:59.793455 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:59.794497 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:59.795159 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:59.796511 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:59.796730 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:59.796806 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:59.799011 (+ 2205us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:59.799013 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:59.799013 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:59.799022 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:59.800354 (+ 1332us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:59.800750 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:59.800751 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:59.800752 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:59.800806 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:59.801029 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:59.801030 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:59.801030 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:59.801146 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:59.801204 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:59.801474 (+ 270us) server_negotiation.cc:299] Negotiation successful
0805 22:47:59.801576 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260805 22:47:59.801931 31070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:59.792616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:44919 (local address 127.14.224.130:36165)
0805 22:47:59.792771 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:59.792811 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:59.793299 (+ 488us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:59.793524 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:59.793527 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:59.794167 (+ 640us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:59.794398 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:59.794405 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:59.795260 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:59.795286 (+ 26us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:59.796428 (+ 1142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:59.796432 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:59.796837 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:59.796838 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:59.796970 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:59.797498 (+ 528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:59.797509 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:59.798914 (+ 1405us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:59.800436 (+ 1522us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:59.800444 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:59.800446 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:59.800681 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:59.800864 (+ 183us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:59.800865 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:59.800865 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:59.800972 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:59.801204 (+ 232us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:59.801211 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:59.801352 (+ 141us) client_negotiation.cc:769] Sending connection context
0805 22:47:59.801447 (+ 95us) client_negotiation.cc:240] Negotiation successful
0805 22:47:59.801616 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":89,"threads_started":1}
I20260805 22:47:59.802366 31061 heartbeater.cc:347] Connected to a master server at 127.14.224.190:44919
I20260805 22:47:59.802460 31061 heartbeater.cc:464] Registering TS with master...
I20260805 22:47:59.802640 31061 heartbeater.cc:511] Master 127.14.224.190:44919 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.14.224.131@KRBTEST.COM; defaulting to no policy
I20260805 22:47:59.803067 30564 ts_manager.cc:194] Registered new tserver with Master: b05a3e49778b4170b609717bafc77e52 (127.14.224.130:36213)
I20260805 22:47:59.803493 30564 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.224.130@KRBTEST.COM'} at 127.14.224.130:36165
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab.
Entry for principal kudu/127.14.224.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab.
I20260805 22:47:59.823463 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.131:0
--local_ip_for_outbound_sockets=127.14.224.131
--webserver_interface=127.14.224.131
--webserver_port=0
--tserver_master_addrs=127.14.224.190:44919
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab
--principal=kudu/127.14.224.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:38713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:47:59.907567 31074 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:47:59.907789 31074 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:47:59.907815 31074 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:47:59.909065 31074 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:47:59.909111 31074 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:47:59.909139 31074 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.131
I20260805 22:47:59.910667 31074 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:38713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab
--principal=kudu/127.14.224.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.224.131
--webserver_port=0
--tserver_master_addrs=127.14.224.190:44919
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31074
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.131
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:47:59.910888 31074 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:47:59.911105 31074 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:47:59.916217 31083 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:47:59.916296 31084 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:59.916417 31074 server_base.cc:1034] running on GCE node
W20260805 22:47:59.916550 31087 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:47:59.916759 31074 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:47:59.916991 31074 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:47:59.918157 31074 hybrid_clock.cc:648] HybridClock initialized: now 1785970079918135 us; error 34 us; skew 500 ppm
Aug 05 22:47:59 dist-test-slave-gjrz krb5kdc[30489](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970079, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:47:59.920804 31074 init.cc:377] Logged in from keytab as kudu/127.14.224.131@KRBTEST.COM (short username kudu)
I20260805 22:47:59.921252 31074 webserver.cc:460] Webserver started at http://127.14.224.131:38777/ using document root <none> and password file <none>
I20260805 22:47:59.921509 31074 fs_manager.cc:359] Metadata directory not provided
I20260805 22:47:59.921563 31074 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:47:59.921695 31074 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:47:59.922816 31074 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/minicluster-data/ts-2/data/instance:
uuid: "b02c9f6a517a43d7b1bd32e24c63f4dc"
format_stamp: "Formatted at 2026-08-05 22:47:59 on dist-test-slave-gjrz"
server_key: "3e610563ce14355c89127b024c4ee254"
server_key_iv: "dd2e5a7d53f8dab2e5d853de009d198e"
server_key_version: "encryptionkey@0"
I20260805 22:47:59.923177 31074 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/minicluster-data/ts-2/wal/instance:
uuid: "b02c9f6a517a43d7b1bd32e24c63f4dc"
format_stamp: "Formatted at 2026-08-05 22:47:59 on dist-test-slave-gjrz"
server_key: "3e610563ce14355c89127b024c4ee254"
server_key_iv: "dd2e5a7d53f8dab2e5d853de009d198e"
server_key_version: "encryptionkey@0"
I20260805 22:47:59.924567 31074 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:47:59.925292 31095 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:59.925431 31074 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:59.925516 31074 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/minicluster-data/ts-2/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/minicluster-data/ts-2/wal
uuid: "b02c9f6a517a43d7b1bd32e24c63f4dc"
format_stamp: "Formatted at 2026-08-05 22:47:59 on dist-test-slave-gjrz"
server_key: "3e610563ce14355c89127b024c4ee254"
server_key_iv: "dd2e5a7d53f8dab2e5d853de009d198e"
server_key_version: "encryptionkey@0"
I20260805 22:47:59.925587 31074 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:47:59.949470 31074 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:47:59.951762 31074 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:47:59.951890 31074 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:47:59.952131 31074 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:47:59.952448 31074 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:47:59.952482 31074 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:59.952507 31074 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:47:59.952530 31074 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:47:59.958483 31074 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.131:44787
I20260805 22:47:59.958539 31252 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.131:44787 every 8 connection(s)
I20260805 22:47:59.958886 31074 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
I20260805 22:47:59.959749 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 31074
I20260805 22:47:59.959837 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/minicluster-data/ts-2/wal/instance
I20260805 22:47:59.960021 15234 external_mini_cluster.cc:1428] Setting key 144b2f49e43e1f76a33851286664c87e
Aug 05 22:47:59 dist-test-slave-gjrz krb5kdc[30489](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970079, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.131@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:47:59.968881 30634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:59.960273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:36341 (local address 127.14.224.190:44919)
0805 22:47:59.960323 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:59.960325 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:59.960336 (+ 11us) server_negotiation.cc:407] Connection header received
0805 22:47:59.960546 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:59.960547 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:59.960566 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:59.960614 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:59.961628 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:59.962135 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:59.963144 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:59.963402 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:59.963457 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:59.965947 (+ 2490us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:59.965949 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:59.965949 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:59.965958 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:59.967497 (+ 1539us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:59.967924 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:59.967926 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:59.967926 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:59.967990 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:59.968228 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:59.968229 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:59.968229 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:59.968352 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:59.968409 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:59.968692 (+ 283us) server_negotiation.cc:299] Negotiation successful
0805 22:47:59.968785 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260805 22:47:59.969059 31257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:59.959654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:44919 (local address 127.14.224.131:36341)
0805 22:47:59.959828 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:59.959876 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:59.960454 (+ 578us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:59.960705 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:59.960709 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:59.961314 (+ 605us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:47:59.961523 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:59.961528 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:59.962231 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:59.962232 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:59.963040 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:59.963043 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:59.963490 (+ 447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:59.963491 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:59.963632 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:59.964155 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:47:59.964164 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:47:59.965832 (+ 1668us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:47:59.967587 (+ 1755us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:59.967598 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:59.967601 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:59.967850 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:59.968047 (+ 197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:47:59.968048 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:47:59.968048 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:47:59.968170 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:47:59.968408 (+ 238us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:47:59.968415 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:47:59.968564 (+ 149us) client_negotiation.cc:769] Sending connection context
0805 22:47:59.968660 (+ 96us) client_negotiation.cc:240] Negotiation successful
0805 22:47:59.968841 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":73,"threads_started":1}
I20260805 22:47:59.969553 31253 heartbeater.cc:347] Connected to a master server at 127.14.224.190:44919
I20260805 22:47:59.969663 31253 heartbeater.cc:464] Registering TS with master...
I20260805 22:47:59.969856 31253 heartbeater.cc:511] Master 127.14.224.190:44919 requested a full tablet report, sending...
I20260805 22:47:59.970258 30564 ts_manager.cc:194] Registered new tserver with Master: b02c9f6a517a43d7b1bd32e24c63f4dc (127.14.224.131:44787)
I20260805 22:47:59.970618 30564 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.224.131@KRBTEST.COM'} at 127.14.224.131:36341
I20260805 22:47:59.971726 15234 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 22:47:59.978803 30634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:59.973017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41262 (local address 127.14.224.190:44919)
0805 22:47:59.973073 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:59.973075 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:59.973163 (+ 88us) server_negotiation.cc:407] Connection header received
0805 22:47:59.973230 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:59.973231 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:59.973241 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:59.973293 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:47:59.973843 (+ 550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:59.974330 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:59.975028 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:59.975227 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:59.975319 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:59.976443 (+ 1124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:47:59.976445 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:47:59.976445 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:47:59.976453 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:47:59.977664 (+ 1211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:59.978021 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:59.978022 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:59.978022 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:59.978080 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:47:59.978247 (+ 167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:47:59.978248 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:47:59.978248 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:47:59.978406 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:47:59.978495 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:59.978621 (+ 126us) server_negotiation.cc:299] Negotiation successful
0805 22:47:59.978711 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260805 22:47:59.980232 30564 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41262:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:47:59.981904 30564 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:47:59.988540 31276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:59.984177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.129:44453 (local address 127.0.0.1:35336)
0805 22:47:59.984659 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:59.984669 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:59.984730 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:59.985028 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:59.985029 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:59.985031 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:47:59.985138 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:59.985140 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:59.986036 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:59.986037 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:59.987214 (+ 1177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:59.987217 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:59.988203 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:59.988205 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:59.988291 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:59.988305 (+ 14us) client_negotiation.cc:769] Sending connection context
0805 22:47:59.988381 (+ 76us) client_negotiation.cc:240] Negotiation successful
0805 22:47:59.988442 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":462,"mutex_wait_us":9,"thread_start_us":63,"threads_started":1}
I20260805 22:47:59.988554 31274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:59.984323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35336 (local address 127.14.224.129:44453)
0805 22:47:59.984534 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:59.984539 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:59.984819 (+ 280us) server_negotiation.cc:407] Connection header received
0805 22:47:59.984862 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:59.984865 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:59.984881 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:59.984945 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:47:59.985219 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:59.985938 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:59.987337 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:59.988114 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:59.988197 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:59.988256 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:59.988407 (+ 151us) server_negotiation.cc:299] Negotiation successful
0805 22:47:59.988463 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":177,"thread_start_us":89,"threads_started":1}
I20260805 22:47:59.988575 31278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:59.984489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48858 (local address 127.14.224.131:44787)
0805 22:47:59.984663 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:59.984668 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:59.984817 (+ 149us) server_negotiation.cc:407] Connection header received
0805 22:47:59.984861 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:59.984863 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:59.984877 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:59.984940 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:47:59.985218 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:59.986357 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:59.987610 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:59.988295 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:59.988354 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:59.988401 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:59.988469 (+ 68us) server_negotiation.cc:299] Negotiation successful
0805 22:47:59.988505 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":88,"threads_started":1}
I20260805 22:47:59.988548 31272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:59.984382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.131:44787 (local address 127.0.0.1:48858)
0805 22:47:59.984676 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:59.984685 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:59.984734 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:59.985025 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:59.985028 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:59.985030 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:47:59.985135 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:59.985138 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:59.986473 (+ 1335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:59.986474 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:59.987544 (+ 1070us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:59.987546 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:59.988354 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:59.988355 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:59.988409 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:59.988412 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:47:59.988458 (+ 46us) client_negotiation.cc:240] Negotiation successful
0805 22:47:59.988490 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"mutex_wait_us":53,"thread_start_us":74,"threads_started":1}
I20260805 22:47:59.989027 31271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:59.984176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.130:36213 (local address 127.0.0.1:60134)
0805 22:47:59.984598 (+ 422us) negotiation.cc:107] Waiting for socket to connect
0805 22:47:59.984639 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0805 22:47:59.984728 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:47:59.985069 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:47:59.985070 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:47:59.985072 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:47:59.985135 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:59.985137 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:59.986488 (+ 1351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:59.986490 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:59.987451 (+ 961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:47:59.987454 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:47:59.988812 (+ 1358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:47:59.988813 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:47:59.988886 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:59.988889 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:47:59.988929 (+ 40us) client_negotiation.cc:240] Negotiation successful
0805 22:47:59.988966 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":395,"mutex_wait_us":27,"spinlock_wait_cycles":768,"thread_start_us":89,"threads_started":1}
I20260805 22:47:59.989378 31162 tablet_service.cc:1467] Processing CreateTablet for tablet f687f3d33ea946d680b78dfae5383f7d (DEFAULT_TABLE table=test-table [id=fa662a35fe5d4a36a525787c0178832b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:47:59.989751 31275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:47:59.984323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60134 (local address 127.14.224.130:36213)
0805 22:47:59.984534 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0805 22:47:59.984539 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:47:59.984713 (+ 174us) server_negotiation.cc:407] Connection header received
0805 22:47:59.984828 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:47:59.984831 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:47:59.984848 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:47:59.984928 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:47:59.985220 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:59.986381 (+ 1161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:59.987550 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:47:59.988125 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:47:59.988198 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:47:59.988256 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0805 22:47:59.989557 (+ 1301us) server_negotiation.cc:299] Negotiation successful
0805 22:47:59.989669 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":182,"thread_start_us":101,"threads_started":1}
I20260805 22:47:59.989789 31162 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f687f3d33ea946d680b78dfae5383f7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:59.989800 30763 tablet_service.cc:1467] Processing CreateTablet for tablet f687f3d33ea946d680b78dfae5383f7d (DEFAULT_TABLE table=test-table [id=fa662a35fe5d4a36a525787c0178832b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:47:59.990157 30763 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f687f3d33ea946d680b78dfae5383f7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:59.990628 30960 tablet_service.cc:1467] Processing CreateTablet for tablet f687f3d33ea946d680b78dfae5383f7d (DEFAULT_TABLE table=test-table [id=fa662a35fe5d4a36a525787c0178832b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:47:59.990949 30960 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f687f3d33ea946d680b78dfae5383f7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:47:59.992692 31280 tablet_bootstrap.cc:492] T f687f3d33ea946d680b78dfae5383f7d P b02c9f6a517a43d7b1bd32e24c63f4dc: Bootstrap starting.
I20260805 22:47:59.993398 31280 tablet_bootstrap.cc:654] T f687f3d33ea946d680b78dfae5383f7d P b02c9f6a517a43d7b1bd32e24c63f4dc: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:59.993717 31281 tablet_bootstrap.cc:492] T f687f3d33ea946d680b78dfae5383f7d P c7fb3b221c6843beb32e216621e7ca8a: Bootstrap starting.
I20260805 22:47:59.994024 31280 log.cc:824] T f687f3d33ea946d680b78dfae5383f7d P b02c9f6a517a43d7b1bd32e24c63f4dc: Log is configured to *not* fsync() on all Append() calls
I20260805 22:47:59.994282 31283 tablet_bootstrap.cc:492] T f687f3d33ea946d680b78dfae5383f7d P b05a3e49778b4170b609717bafc77e52: Bootstrap starting.
I20260805 22:47:59.994429 31281 tablet_bootstrap.cc:654] T f687f3d33ea946d680b78dfae5383f7d P c7fb3b221c6843beb32e216621e7ca8a: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:59.994931 31283 tablet_bootstrap.cc:654] T f687f3d33ea946d680b78dfae5383f7d P b05a3e49778b4170b609717bafc77e52: Neither blocks nor log segments found. Creating new log.
I20260805 22:47:59.994962 31281 log.cc:824] T f687f3d33ea946d680b78dfae5383f7d P c7fb3b221c6843beb32e216621e7ca8a: Log is configured to *not* fsync() on all Append() calls
I20260805 22:47:59.995129 31280 tablet_bootstrap.cc:492] T f687f3d33ea946d680b78dfae5383f7d P b02c9f6a517a43d7b1bd32e24c63f4dc: No bootstrap required, opened a new log
I20260805 22:47:59.995210 31280 ts_tablet_manager.cc:1397] T f687f3d33ea946d680b78dfae5383f7d P b02c9f6a517a43d7b1bd32e24c63f4dc: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260805 22:47:59.995486 31283 log.cc:824] T f687f3d33ea946d680b78dfae5383f7d P b05a3e49778b4170b609717bafc77e52: Log is configured to *not* fsync() on all Append() calls
I20260805 22:47:59.995915 31281 tablet_bootstrap.cc:492] T f687f3d33ea946d680b78dfae5383f7d P c7fb3b221c6843beb32e216621e7ca8a: No bootstrap required, opened a new log
I20260805 22:47:59.996048 31281 ts_tablet_manager.cc:1397] T f687f3d33ea946d680b78dfae5383f7d P c7fb3b221c6843beb32e216621e7ca8a: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260805 22:47:59.996166 31283 tablet_bootstrap.cc:492] T f687f3d33ea946d680b78dfae5383f7d P b05a3e49778b4170b609717bafc77e52: No bootstrap required, opened a new log
I20260805 22:47:59.996223 31283 ts_tablet_manager.cc:1397] T f687f3d33ea946d680b78dfae5383f7d P b05a3e49778b4170b609717bafc77e52: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260805 22:47:59.997247 31280 raft_consensus.cc:348] T f687f3d33ea946d680b78dfae5383f7d P b02c9f6a517a43d7b1bd32e24c63f4dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7fb3b221c6843beb32e216621e7ca8a" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 44453 } } peers { permanent_uuid: "b05a3e49778b4170b609717bafc77e52" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 36213 } } peers { permanent_uuid: "b02c9f6a517a43d7b1bd32e24c63f4dc" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 44787 } }
I20260805 22:47:59.997442 31280 raft_consensus.cc:374] T f687f3d33ea946d680b78dfae5383f7d P b02c9f6a517a43d7b1bd32e24c63f4dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:59.997479 31280 raft_consensus.cc:729] T f687f3d33ea946d680b78dfae5383f7d P b02c9f6a517a43d7b1bd32e24c63f4dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b02c9f6a517a43d7b1bd32e24c63f4dc, State: Initialized, Role: FOLLOWER
I20260805 22:47:59.997638 31280 consensus_queue.cc:260] T f687f3d33ea946d680b78dfae5383f7d P b02c9f6a517a43d7b1bd32e24c63f4dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7fb3b221c6843beb32e216621e7ca8a" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 44453 } } peers { permanent_uuid: "b05a3e49778b4170b609717bafc77e52" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 36213 } } peers { permanent_uuid: "b02c9f6a517a43d7b1bd32e24c63f4dc" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 44787 } }
I20260805 22:47:59.997640 31283 raft_consensus.cc:348] T f687f3d33ea946d680b78dfae5383f7d P b05a3e49778b4170b609717bafc77e52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7fb3b221c6843beb32e216621e7ca8a" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 44453 } } peers { permanent_uuid: "b05a3e49778b4170b609717bafc77e52" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 36213 } } peers { permanent_uuid: "b02c9f6a517a43d7b1bd32e24c63f4dc" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 44787 } }
I20260805 22:47:59.997785 31283 raft_consensus.cc:374] T f687f3d33ea946d680b78dfae5383f7d P b05a3e49778b4170b609717bafc77e52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:59.997816 31283 raft_consensus.cc:729] T f687f3d33ea946d680b78dfae5383f7d P b05a3e49778b4170b609717bafc77e52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b05a3e49778b4170b609717bafc77e52, State: Initialized, Role: FOLLOWER
I20260805 22:47:59.997925 31283 consensus_queue.cc:260] T f687f3d33ea946d680b78dfae5383f7d P b05a3e49778b4170b609717bafc77e52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7fb3b221c6843beb32e216621e7ca8a" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 44453 } } peers { permanent_uuid: "b05a3e49778b4170b609717bafc77e52" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 36213 } } peers { permanent_uuid: "b02c9f6a517a43d7b1bd32e24c63f4dc" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 44787 } }
I20260805 22:47:59.997968 31280 ts_tablet_manager.cc:1428] T f687f3d33ea946d680b78dfae5383f7d P b02c9f6a517a43d7b1bd32e24c63f4dc: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260805 22:47:59.998090 31253 heartbeater.cc:503] Master 127.14.224.190:44919 was elected leader, sending a full tablet report...
I20260805 22:47:59.998207 31283 ts_tablet_manager.cc:1428] T f687f3d33ea946d680b78dfae5383f7d P b05a3e49778b4170b609717bafc77e52: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260805 22:47:59.998255 31061 heartbeater.cc:503] Master 127.14.224.190:44919 was elected leader, sending a full tablet report...
I20260805 22:47:59.998160 31281 raft_consensus.cc:348] T f687f3d33ea946d680b78dfae5383f7d P c7fb3b221c6843beb32e216621e7ca8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7fb3b221c6843beb32e216621e7ca8a" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 44453 } } peers { permanent_uuid: "b05a3e49778b4170b609717bafc77e52" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 36213 } } peers { permanent_uuid: "b02c9f6a517a43d7b1bd32e24c63f4dc" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 44787 } }
I20260805 22:47:59.998308 31281 raft_consensus.cc:374] T f687f3d33ea946d680b78dfae5383f7d P c7fb3b221c6843beb32e216621e7ca8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:47:59.998340 31281 raft_consensus.cc:729] T f687f3d33ea946d680b78dfae5383f7d P c7fb3b221c6843beb32e216621e7ca8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7fb3b221c6843beb32e216621e7ca8a, State: Initialized, Role: FOLLOWER
I20260805 22:47:59.998488 31281 consensus_queue.cc:260] T f687f3d33ea946d680b78dfae5383f7d P c7fb3b221c6843beb32e216621e7ca8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7fb3b221c6843beb32e216621e7ca8a" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 44453 } } peers { permanent_uuid: "b05a3e49778b4170b609717bafc77e52" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 36213 } } peers { permanent_uuid: "b02c9f6a517a43d7b1bd32e24c63f4dc" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 44787 } }
I20260805 22:47:59.998791 31281 ts_tablet_manager.cc:1428] T f687f3d33ea946d680b78dfae5383f7d P c7fb3b221c6843beb32e216621e7ca8a: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260805 22:47:59.998818 30859 heartbeater.cc:503] Master 127.14.224.190:44919 was elected leader, sending a full tablet report...
I20260805 22:48:00.031145 31288 raft_consensus.cc:482] T f687f3d33ea946d680b78dfae5383f7d P b02c9f6a517a43d7b1bd32e24c63f4dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:48:00.031337 31288 raft_consensus.cc:504] T f687f3d33ea946d680b78dfae5383f7d P b02c9f6a517a43d7b1bd32e24c63f4dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7fb3b221c6843beb32e216621e7ca8a" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 44453 } } peers { permanent_uuid: "b05a3e49778b4170b609717bafc77e52" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 36213 } } peers { permanent_uuid: "b02c9f6a517a43d7b1bd32e24c63f4dc" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 44787 } }
I20260805 22:48:00.031747 31288 leader_election.cc:288] T f687f3d33ea946d680b78dfae5383f7d P b02c9f6a517a43d7b1bd32e24c63f4dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7fb3b221c6843beb32e216621e7ca8a (127.14.224.129:44453), b05a3e49778b4170b609717bafc77e52 (127.14.224.130:36213)
I20260805 22:48:00.035636 31275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:48:00.032048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:49611 (local address 127.14.224.130:36213)
0805 22:48:00.032098 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0805 22:48:00.032100 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:48:00.032200 (+ 100us) server_negotiation.cc:407] Connection header received
0805 22:48:00.032232 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:48:00.032233 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:48:00.032243 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:48:00.032283 (+ 40us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:48:00.032411 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:48:00.033096 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:48:00.034619 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:48:00.035239 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:48:00.035355 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:48:00.035367 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0805 22:48:00.035513 (+ 146us) server_negotiation.cc:299] Negotiation successful
0805 22:48:00.035560 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260805 22:48:00.035624 31292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:48:00.031921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.130:36213 (local address 127.14.224.131:49611)
0805 22:48:00.032129 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0805 22:48:00.032138 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0805 22:48:00.032190 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:48:00.032301 (+ 111us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:48:00.032302 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:48:00.032303 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:48:00.032357 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:48:00.032358 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:48:00.033173 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:48:00.033173 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:48:00.034486 (+ 1313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:48:00.034490 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:48:00.035374 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:48:00.035375 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:48:00.035442 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:48:00.035447 (+ 5us) client_negotiation.cc:769] Sending connection context
0805 22:48:00.035488 (+ 41us) client_negotiation.cc:240] Negotiation successful
0805 22:48:00.035526 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186,"mutex_wait_us":3,"thread_start_us":132,"threads_started":1}
I20260805 22:48:00.035699 31274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:48:00.031981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:33267 (local address 127.14.224.129:44453)
0805 22:48:00.032043 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0805 22:48:00.032045 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:48:00.032054 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:48:00.032109 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:48:00.032110 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:48:00.032119 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:48:00.032168 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:48:00.032343 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:48:00.033096 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:48:00.034619 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:48:00.035255 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:48:00.035360 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:48:00.035369 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0805 22:48:00.035591 (+ 222us) server_negotiation.cc:299] Negotiation successful
0805 22:48:00.035639 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260805 22:48:00.036083 31257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:48:00.031903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.129:44453 (local address 127.14.224.131:33267)
0805 22:48:00.031946 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0805 22:48:00.031958 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:48:00.032005 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:48:00.032193 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:48:00.032194 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:48:00.032196 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:48:00.032273 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:48:00.032275 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:48:00.033174 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:48:00.033175 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:48:00.034486 (+ 1311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:48:00.034490 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:48:00.035408 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:48:00.035410 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:48:00.035488 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:48:00.035492 (+ 4us) client_negotiation.cc:769] Sending connection context
0805 22:48:00.035549 (+ 57us) client_negotiation.cc:240] Negotiation successful
0805 22:48:00.035590 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23,"mutex_wait_us":100}
I20260805 22:48:00.036091 30994 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f687f3d33ea946d680b78dfae5383f7d" candidate_uuid: "b02c9f6a517a43d7b1bd32e24c63f4dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b05a3e49778b4170b609717bafc77e52" is_pre_election: true
I20260805 22:48:00.036275 30994 raft_consensus.cc:2454] T f687f3d33ea946d680b78dfae5383f7d P b05a3e49778b4170b609717bafc77e52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b02c9f6a517a43d7b1bd32e24c63f4dc in term 0.
I20260805 22:48:00.036464 30788 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f687f3d33ea946d680b78dfae5383f7d" candidate_uuid: "b02c9f6a517a43d7b1bd32e24c63f4dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7fb3b221c6843beb32e216621e7ca8a" is_pre_election: true
I20260805 22:48:00.036545 31099 leader_election.cc:302] T f687f3d33ea946d680b78dfae5383f7d P b02c9f6a517a43d7b1bd32e24c63f4dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b02c9f6a517a43d7b1bd32e24c63f4dc, b05a3e49778b4170b609717bafc77e52; no voters:
I20260805 22:48:00.036645 30788 raft_consensus.cc:2454] T f687f3d33ea946d680b78dfae5383f7d P c7fb3b221c6843beb32e216621e7ca8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b02c9f6a517a43d7b1bd32e24c63f4dc in term 0.
I20260805 22:48:00.036671 31288 raft_consensus.cc:2781] T f687f3d33ea946d680b78dfae5383f7d P b02c9f6a517a43d7b1bd32e24c63f4dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:48:00.036757 31288 raft_consensus.cc:482] T f687f3d33ea946d680b78dfae5383f7d P b02c9f6a517a43d7b1bd32e24c63f4dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:48:00.036791 31288 raft_consensus.cc:3037] T f687f3d33ea946d680b78dfae5383f7d P b02c9f6a517a43d7b1bd32e24c63f4dc [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:48:00.037547 31288 raft_consensus.cc:504] T f687f3d33ea946d680b78dfae5383f7d P b02c9f6a517a43d7b1bd32e24c63f4dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7fb3b221c6843beb32e216621e7ca8a" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 44453 } } peers { permanent_uuid: "b05a3e49778b4170b609717bafc77e52" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 36213 } } peers { permanent_uuid: "b02c9f6a517a43d7b1bd32e24c63f4dc" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 44787 } }
I20260805 22:48:00.037684 31288 leader_election.cc:288] T f687f3d33ea946d680b78dfae5383f7d P b02c9f6a517a43d7b1bd32e24c63f4dc [CANDIDATE]: Term 1 election: Requested vote from peers c7fb3b221c6843beb32e216621e7ca8a (127.14.224.129:44453), b05a3e49778b4170b609717bafc77e52 (127.14.224.130:36213)
I20260805 22:48:00.037870 30994 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f687f3d33ea946d680b78dfae5383f7d" candidate_uuid: "b02c9f6a517a43d7b1bd32e24c63f4dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b05a3e49778b4170b609717bafc77e52"
I20260805 22:48:00.037945 30994 raft_consensus.cc:3037] T f687f3d33ea946d680b78dfae5383f7d P b05a3e49778b4170b609717bafc77e52 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:48:00.037925 30788 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f687f3d33ea946d680b78dfae5383f7d" candidate_uuid: "b02c9f6a517a43d7b1bd32e24c63f4dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7fb3b221c6843beb32e216621e7ca8a"
I20260805 22:48:00.038008 30788 raft_consensus.cc:3037] T f687f3d33ea946d680b78dfae5383f7d P c7fb3b221c6843beb32e216621e7ca8a [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:48:00.038710 30994 raft_consensus.cc:2454] T f687f3d33ea946d680b78dfae5383f7d P b05a3e49778b4170b609717bafc77e52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b02c9f6a517a43d7b1bd32e24c63f4dc in term 1.
I20260805 22:48:00.038762 30788 raft_consensus.cc:2454] T f687f3d33ea946d680b78dfae5383f7d P c7fb3b221c6843beb32e216621e7ca8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b02c9f6a517a43d7b1bd32e24c63f4dc in term 1.
I20260805 22:48:00.038882 31099 leader_election.cc:302] T f687f3d33ea946d680b78dfae5383f7d P b02c9f6a517a43d7b1bd32e24c63f4dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b02c9f6a517a43d7b1bd32e24c63f4dc, b05a3e49778b4170b609717bafc77e52; no voters:
I20260805 22:48:00.038987 31288 raft_consensus.cc:2781] T f687f3d33ea946d680b78dfae5383f7d P b02c9f6a517a43d7b1bd32e24c63f4dc [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:48:00.039165 31288 raft_consensus.cc:686] T f687f3d33ea946d680b78dfae5383f7d P b02c9f6a517a43d7b1bd32e24c63f4dc [term 1 LEADER]: Becoming Leader. State: Replica: b02c9f6a517a43d7b1bd32e24c63f4dc, State: Running, Role: LEADER
I20260805 22:48:00.039254 31288 consensus_queue.cc:237] T f687f3d33ea946d680b78dfae5383f7d P b02c9f6a517a43d7b1bd32e24c63f4dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7fb3b221c6843beb32e216621e7ca8a" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 44453 } } peers { permanent_uuid: "b05a3e49778b4170b609717bafc77e52" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 36213 } } peers { permanent_uuid: "b02c9f6a517a43d7b1bd32e24c63f4dc" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 44787 } }
I20260805 22:48:00.040345 30564 catalog_manager.cc:5495] T f687f3d33ea946d680b78dfae5383f7d P b02c9f6a517a43d7b1bd32e24c63f4dc reported cstate change: term changed from 0 to 1, leader changed from <none> to b02c9f6a517a43d7b1bd32e24c63f4dc (127.14.224.131). New cstate: current_term: 1 leader_uuid: "b02c9f6a517a43d7b1bd32e24c63f4dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7fb3b221c6843beb32e216621e7ca8a" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 44453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b05a3e49778b4170b609717bafc77e52" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 36213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b02c9f6a517a43d7b1bd32e24c63f4dc" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 44787 } health_report { overall_health: HEALTHY } } }
W20260805 22:48:00.042460 31065 tablet.cc:2369] T f687f3d33ea946d680b78dfae5383f7d P b05a3e49778b4170b609717bafc77e52: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:48:00.046398 31278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:48:00.044395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48862 (local address 127.14.224.131:44787)
0805 22:48:00.044445 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0805 22:48:00.044447 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:48:00.044458 (+ 11us) server_negotiation.cc:407] Connection header received
0805 22:48:00.044488 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:48:00.044488 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:48:00.044505 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:48:00.044562 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:48:00.044656 (+ 94us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:48:00.045130 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:48:00.045813 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:48:00.045992 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:48:00.046033 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:48:00.046144 (+ 111us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:48:00.046241 (+ 97us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:48:00.046294 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0805 22:48:00.046311 (+ 17us) server_negotiation.cc:299] Negotiation successful
0805 22:48:00.046327 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260805 22:48:00.048136 30994 raft_consensus.cc:1261] T f687f3d33ea946d680b78dfae5383f7d P b05a3e49778b4170b609717bafc77e52 [term 1 FOLLOWER]: Refusing update from remote peer b02c9f6a517a43d7b1bd32e24c63f4dc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:48:00.048182 30788 raft_consensus.cc:1261] T f687f3d33ea946d680b78dfae5383f7d P c7fb3b221c6843beb32e216621e7ca8a [term 1 FOLLOWER]: Refusing update from remote peer b02c9f6a517a43d7b1bd32e24c63f4dc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:48:00.048468 31288 consensus_queue.cc:1035] T f687f3d33ea946d680b78dfae5383f7d P b02c9f6a517a43d7b1bd32e24c63f4dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b05a3e49778b4170b609717bafc77e52" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 36213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:48:00.048609 31295 consensus_queue.cc:1035] T f687f3d33ea946d680b78dfae5383f7d P b02c9f6a517a43d7b1bd32e24c63f4dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7fb3b221c6843beb32e216621e7ca8a" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:48:00.050792 31298 mvcc.cc:205] Tried to move back new op lower bound from 7315333447874719744 to 7315333447842263040. Current Snapshot: MvccSnapshot[applied={T|T < 7315333447874719744}]
I20260805 22:48:00.051739 31300 mvcc.cc:205] Tried to move back new op lower bound from 7315333447874719744 to 7315333447842263040. Current Snapshot: MvccSnapshot[applied={T|T < 7315333447874719744 or (T in {7315333447874719744})}]
I20260805 22:48:00.053828 30560 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41262:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:48:00.053918 30560 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41262:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:48:00.054636 30560 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1275de755c0e4bf3bf34d5bab1782067: Sending DeleteTablet for 3 replicas of tablet f687f3d33ea946d680b78dfae5383f7d
I20260805 22:48:00.054986 30960 tablet_service.cc:1514] Processing DeleteTablet for tablet f687f3d33ea946d680b78dfae5383f7d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:48:00 UTC) from {username='kudu', principal='kudu/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:60134
I20260805 22:48:00.055084 30763 tablet_service.cc:1514] Processing DeleteTablet for tablet f687f3d33ea946d680b78dfae5383f7d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:48:00 UTC) from {username='kudu', principal='kudu/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:35336
I20260805 22:48:00.055081 31162 tablet_service.cc:1514] Processing DeleteTablet for tablet f687f3d33ea946d680b78dfae5383f7d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:48:00 UTC) from {username='kudu', principal='kudu/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:48858
I20260805 22:48:00.055469 31313 tablet_replica.cc:330] T f687f3d33ea946d680b78dfae5383f7d P b05a3e49778b4170b609717bafc77e52: stopping tablet replica
I20260805 22:48:00.055508 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 30663
I20260805 22:48:00.055579 31313 raft_consensus.cc:2229] T f687f3d33ea946d680b78dfae5383f7d P b05a3e49778b4170b609717bafc77e52 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:48:00.055680 31313 raft_consensus.cc:2258] T f687f3d33ea946d680b78dfae5383f7d P b05a3e49778b4170b609717bafc77e52 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:48:00.060181 31314 tablet_replica.cc:330] T f687f3d33ea946d680b78dfae5383f7d P b02c9f6a517a43d7b1bd32e24c63f4dc: stopping tablet replica
I20260805 22:48:00.060307 31314 raft_consensus.cc:2229] T f687f3d33ea946d680b78dfae5383f7d P b02c9f6a517a43d7b1bd32e24c63f4dc [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:48:00.060432 31314 raft_consensus.cc:2258] T f687f3d33ea946d680b78dfae5383f7d P b02c9f6a517a43d7b1bd32e24c63f4dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:48:00.063149 31313 ts_tablet_manager.cc:1905] T f687f3d33ea946d680b78dfae5383f7d P b05a3e49778b4170b609717bafc77e52: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:48:00.067241 31313 ts_tablet_manager.cc:1918] T f687f3d33ea946d680b78dfae5383f7d P b05a3e49778b4170b609717bafc77e52: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:48:00.067353 31313 log.cc:1196] T f687f3d33ea946d680b78dfae5383f7d P b05a3e49778b4170b609717bafc77e52: Deleting WAL directory at /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/minicluster-data/ts-1/wal/wals/f687f3d33ea946d680b78dfae5383f7d
I20260805 22:48:00.067631 31313 ts_tablet_manager.cc:1939] T f687f3d33ea946d680b78dfae5383f7d P b05a3e49778b4170b609717bafc77e52: Deleting consensus metadata
I20260805 22:48:00.068116 30544 catalog_manager.cc:4841] TS b05a3e49778b4170b609717bafc77e52 (127.14.224.130:36213): tablet f687f3d33ea946d680b78dfae5383f7d (table test-table [id=fa662a35fe5d4a36a525787c0178832b]) successfully deleted
I20260805 22:48:00.072482 31314 ts_tablet_manager.cc:1905] T f687f3d33ea946d680b78dfae5383f7d P b02c9f6a517a43d7b1bd32e24c63f4dc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:48:00.074628 31314 ts_tablet_manager.cc:1918] T f687f3d33ea946d680b78dfae5383f7d P b02c9f6a517a43d7b1bd32e24c63f4dc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:48:00.074747 31314 log.cc:1196] T f687f3d33ea946d680b78dfae5383f7d P b02c9f6a517a43d7b1bd32e24c63f4dc: Deleting WAL directory at /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970021300824-15234-0/minicluster-data/ts-2/wal/wals/f687f3d33ea946d680b78dfae5383f7d
I20260805 22:48:00.075124 31314 ts_tablet_manager.cc:1939] T f687f3d33ea946d680b78dfae5383f7d P b02c9f6a517a43d7b1bd32e24c63f4dc: Deleting consensus metadata
I20260805 22:48:00.075685 30540 catalog_manager.cc:4841] TS b02c9f6a517a43d7b1bd32e24c63f4dc (127.14.224.131:44787): tablet f687f3d33ea946d680b78dfae5383f7d (table test-table [id=fa662a35fe5d4a36a525787c0178832b]) successfully deleted
W20260805 22:48:00.080417 30540 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.224.129:44453 (error 108)
I20260805 22:48:00.080602 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 30866
I20260805 22:48:00.097445 31276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:48:00.096957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.129:44453 (local address 127.0.0.1:35350)
0805 22:48:00.097309 (+ 352us) negotiation.cc:107] Waiting for socket to connect
0805 22:48:00.097391 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.129:44453: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":313}
W20260805 22:48:00.097699 30540 catalog_manager.cc:4584] TS c7fb3b221c6843beb32e216621e7ca8a (127.14.224.129:44453): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f687f3d33ea946d680b78dfae5383f7d: Network error: Client connection negotiation failed: client connection to 127.14.224.129:44453: connect: Connection refused (error 111)
I20260805 22:48:00.101128 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 31074
I20260805 22:48:00.116139 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 30513
2026-08-05T22:48:00Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2068 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:48:00 dist-test-slave-gjrz krb5kdc[31321](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:48:00 dist-test-slave-gjrz krb5kdc[31321](info): set up 2 sockets
Aug 05 22:48:00 dist-test-slave-gjrz krb5kdc[31321](info): commencing operation
krb5kdc: starting...
W20260805 22:48:01.248102 15234 mini_kdc.cc:121] Time spent starting KDC: real 1.102s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Aug 05 22:48:01 dist-test-slave-gjrz krb5kdc[31321](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970081, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:48:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:48:01Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.14.224.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.14.224.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.14.224.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/krb5kdc/rangeradmin_127.14.224.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.14.224.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/krb5kdc/rangeradmin_127.14.224.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.14.224.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.14.224.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.14.224.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/krb5kdc/rangerlookup_127.14.224.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.14.224.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/krb5kdc/rangerlookup_127.14.224.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.14.224.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.14.224.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.14.224.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/krb5kdc/HTTP_127.14.224.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.14.224.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/krb5kdc/HTTP_127.14.224.148@KRBTEST.COM.keytab.
I20260805 22:48:01.434736 15234 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-task9AL_ND/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/postgres -l logfile start
2026-08-05 22:48:03.964 UTC [31367] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-05 22:48:03.964 UTC [31367] LOG: listening on IPv4 address "127.14.224.148", port 56431
2026-08-05 22:48:03.968 UTC [31367] LOG: listening on Unix socket "/tmp/.s.PGSQL.56431"
2026-08-05 22:48:03.990 UTC [31371] LOG: database system was shut down at 2026-08-05 22:48:02 UTC
2026-08-05 22:48:03.993 UTC [31367] LOG: database system is ready to accept connections
I20260805 22:48:05.035046 15234 mini_postgres.cc:96] Postgres bound to 56431
2026-08-05 22:48:05.042 UTC [31386] FATAL: database "slave" does not exist
127.14.224.148:56431 - accepting connections
I20260805 22:48:05.042997 15234 mini_ranger.cc:161] Starting Ranger...
I20260805 22:48:05.059322 15234 mini_ranger.cc:84] Created miniranger Postgres user
I20260805 22:48:05.571360 15234 mini_ranger.cc:87] Created ranger Postgres database
I20260805 22:48:05.571452 15234 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/ranger-admin
2026-08-05 22:48:05,852 [I] DB FLAVOR :POSTGRES
2026-08-05 22:48:05,852 [I] --------- Verifying Ranger DB connection ---------
2026-08-05 22:48:05,852 [I] Checking connection..
2026-08-05 22:48:05,852 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9AL_ND/build/release/bin/postgresql.jar:/tmp/dist-test-task9AL_ND/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.224.148:56431/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-05 22:48:06,106 [I] Checking connection passed.
2026-08-05 22:48:06,107 [I] --------- Verifying version history table ---------
2026-08-05 22:48:06,107 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9AL_ND/build/release/bin/postgresql.jar:/tmp/dist-test-task9AL_ND/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.224.148:56431/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-05 22:48:06,361 [I] Table x_db_version_h does not exist in database ranger
2026-08-05 22:48:06,361 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9AL_ND/build/release/bin/postgresql.jar:/tmp/dist-test-task9AL_ND/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.224.148:56431/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-05 22:48:06,618 [I] Table x_db_version_h does not exist in database ranger
2026-08-05 22:48:06,618 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-05 22:48:06,618 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9AL_ND/build/release/bin/postgresql.jar:/tmp/dist-test-task9AL_ND/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.224.148:56431/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-task9AL_ND/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-05 22:48:06.883 UTC [31474] WARNING: there is no transaction in progress
2026-08-05 22:48:06,890 [I] create_dbversion_catalog.sql file imported successfully
2026-08-05 22:48:06,890 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9AL_ND/build/release/bin/postgresql.jar:/tmp/dist-test-task9AL_ND/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.224.148:56431/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-05 22:48:07,158 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-05 22:48:07,158 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-05 22:48:07,159 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9AL_ND/build/release/bin/postgresql.jar:/tmp/dist-test-task9AL_ND/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.224.148:56431/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-05 22:48:07,411 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9AL_ND/build/release/bin/postgresql.jar:/tmp/dist-test-task9AL_ND/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.224.148:56431/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-05 22:48:07,678 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9AL_ND/build/release/bin/postgresql.jar:/tmp/dist-test-task9AL_ND/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.224.148:56431/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-gjrz.c.gcp-upstream.internal','N') ;"
2026-08-05 22:48:07,921 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9AL_ND/build/release/bin/postgresql.jar:/tmp/dist-test-task9AL_ND/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.224.148:56431/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-05 22:48:08,170 [I] Table x_portal_user does not exist in database ranger
2026-08-05 22:48:08,171 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9AL_ND/build/release/bin/postgresql.jar:/tmp/dist-test-task9AL_ND/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.224.148:56431/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-05 22:48:08,438 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-05 22:48:08,439 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9AL_ND/build/release/bin/postgresql.jar:/tmp/dist-test-task9AL_ND/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.224.148:56431/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-05 22:48:08,685 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9AL_ND/build/release/bin/postgresql.jar:/tmp/dist-test-task9AL_ND/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.224.148:56431/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-05 22:48:08,921 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-05 22:48:08,921 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9AL_ND/build/release/bin/postgresql.jar:/tmp/dist-test-task9AL_ND/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.224.148:56431/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-task9AL_ND/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-05 22:48:09.960 UTC [31632] WARNING: there is no transaction in progress
2026-08-05 22:48:09.978 UTC [31632] WARNING: there is no transaction in progress
2026-08-05 22:48:09.995 UTC [31632] WARNING: there is no transaction in progress
2026-08-05 22:48:10.014 UTC [31632] WARNING: there is no transaction in progress
2026-08-05 22:48:10.034 UTC [31632] WARNING: there is no transaction in progress
2026-08-05 22:48:10.052 UTC [31632] WARNING: there is no transaction in progress
2026-08-05 22:48:10.111 UTC [31632] WARNING: there is no transaction in progress
2026-08-05 22:48:10.119 UTC [31632] WARNING: there is no transaction in progress
2026-08-05 22:48:10.136 UTC [31632] WARNING: there is no transaction in progress
2026-08-05 22:48:10.147 UTC [31632] WARNING: there is no transaction in progress
2026-08-05 22:48:10.158 UTC [31632] WARNING: there is no transaction in progress
2026-08-05 22:48:10.174 UTC [31632] WARNING: there is no transaction in progress
2026-08-05 22:48:10.185 UTC [31632] WARNING: there is no transaction in progress
2026-08-05 22:48:10.192 UTC [31632] WARNING: there is no transaction in progress
2026-08-05 22:48:10.199 UTC [31632] WARNING: there is no transaction in progress
2026-08-05 22:48:10.206 UTC [31632] WARNING: there is no transaction in progress
2026-08-05 22:48:10,907 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-05 22:48:10,908 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9AL_ND/build/release/bin/postgresql.jar:/tmp/dist-test-task9AL_ND/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.224.148:56431/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-05 22:48:11,172 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-05 22:48:11,172 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9AL_ND/build/release/bin/postgresql.jar:/tmp/dist-test-task9AL_ND/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.224.148:56431/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-05 22:48:11,417 [I] Table x_portal_user already exists in database 'ranger'
2026-08-05 22:48:11,417 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9AL_ND/build/release/bin/postgresql.jar:/tmp/dist-test-task9AL_ND/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.224.148:56431/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-05 22:48:11,679 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-05 22:48:11,679 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9AL_ND/build/release/bin/postgresql.jar:/tmp/dist-test-task9AL_ND/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.224.148:56431/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-05 22:48:11,938 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9AL_ND/build/release/bin/postgresql.jar:/tmp/dist-test-task9AL_ND/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.224.148:56431/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-05 22:48:12,187 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9AL_ND/build/release/bin/postgresql.jar:/tmp/dist-test-task9AL_ND/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.224.148:56431/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-gjrz.c.gcp-upstream.internal';"
2026-08-05 22:48:12,439 [I] CORE_DB_SCHEMA import status has been updated
2026-08-05 22:48:12,440 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9AL_ND/build/release/bin/postgresql.jar:/tmp/dist-test-task9AL_ND/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.224.148:56431/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-05 22:48:12,695 [I] DB_PATCHES have already been applied
I20260805 22:48:12.701355 15234 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/ranger-admin:/tmp/dist-test-task9AL_ND/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-task9AL_ND/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-task9AL_ND/build/release/bin/postgresql.jar:/tmp/dist-test-task9AL_ND/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260805 22:48:12.701422 15234 mini_ranger.cc:193] Using host: 127.14.224.148
I20260805 22:48:12.705215 15234 mini_ranger.cc:227] Ranger admin URL: http://127.14.224.148:33571
Aug 05, 2026 10:48:13 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 05, 2026 10:48:13 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 05, 2026 10:48:13 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/ranger-admin/ews/webapp
Aug 05, 2026 10:48:13 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 05, 2026 10:48:13 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 05, 2026 10:48:13 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/ranger-admin/ews/webapp].
Aug 05, 2026 10:48:13 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260805 22:48:13.916369 15234 mini_ranger.cc:160] Time spent starting Ranger: real 8.873s user 0.000s sys 0.011s
Aug 05, 2026 10:48:33 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 05, 2026 10:48:33 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 05, 2026 10:48:33 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 05, 2026 10:48:33 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 05, 2026 10:48:33 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 05, 2026 10:48:33 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 05, 2026 10:48:33 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 05, 2026 10:48:33 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 05, 2026 10:48:33 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 05, 2026 10:48:33 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 05, 2026 10:48:33 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 05, 2026 10:48:33 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 05, 2026 10:48:33 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 05, 2026 10:48:33 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 05, 2026 10:48:33 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 05, 2026 10:48:33 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 05, 2026 10:48:33 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 05, 2026 10:48:34 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260805 22:48:35.325122 15234 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.14.224.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.14.224.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.14.224.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/krb5kdc/rangerkms_127.14.224.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.14.224.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/krb5kdc/rangerkms_127.14.224.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.14.224.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.14.224.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.14.224.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/krb5kdc/HTTP_127.14.224.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.14.224.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/krb5kdc/HTTP_127.14.224.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 05 22:48:35 dist-test-slave-gjrz krb5kdc[31321](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970115, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260805 22:48:35.418007 15234 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260805 22:48:35.431298 15234 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260805 22:48:36.257377 15234 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260805 22:48:36.257448 15234 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/ranger-kms
I20260805 22:48:36.257467 15234 mini_ranger_kms.cc:227] Using postgres at 127.14.224.148:56431
2026-08-05 22:48:36,452 [I] DB FLAVOR :POSTGRES
2026-08-05 22:48:36,452 [I] --------- Verifying Ranger DB connection ---------
2026-08-05 22:48:36,452 [I] Checking connection
2026-08-05 22:48:36,452 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9AL_ND/build/release/bin/postgresql.jar:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.224.148:56431/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-05 22:48:36,702 [I] connection success
2026-08-05 22:48:36,702 [I] --------- Verifying Ranger DB tables ---------
2026-08-05 22:48:36,702 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-05 22:48:36,703 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9AL_ND/build/release/bin/postgresql.jar:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.224.148:56431/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-05 22:48:36,943 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-05 22:48:36,943 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-05 22:48:36,943 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-05 22:48:36,943 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9AL_ND/build/release/bin/postgresql.jar:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.224.148:56431/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-05 22:48:37,216 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260805 22:48:37.732064 15234 mini_ranger_kms.cc:310] Created kms service
I20260805 22:48:37.944443 15234 mini_ranger_kms.cc:326] Created kudu user
I20260805 22:48:37.988737 15234 mini_ranger_kms.cc:343] Created rangerkms user
Aug 05 22:48:37 dist-test-slave-gjrz krb5kdc[31321](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970115, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.14.224.148@KRBTEST.COM
I20260805 22:48:38.364189 15234 mini_ranger_kms.cc:384] Added ranger policy
I20260805 22:48:38.364311 15234 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/ranger-kms:/tmp/dist-test-task9AL_ND/build/release/bin/postgresql.jar:/tmp/dist-test-task9AL_ND/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-task9AL_ND/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260805 22:48:38.364333 15234 mini_ranger_kms.cc:240] Using host: 127.14.224.148
I20260805 22:48:38.369187 15234 mini_ranger_kms.cc:276] Ranger KMS PID: 31918
I20260805 22:48:38.369307 15234 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.14.224.148:39033
Aug 05, 2026 10:48:39 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 05, 2026 10:48:39 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 05, 2026 10:48:39 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 05, 2026 10:48:39 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 05, 2026 10:48:40 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/ranger-kms/ews/webapp].
Aug 05, 2026 10:48:40 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 05 22:48:40 dist-test-slave-gjrz krb5kdc[31321](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1785970120, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.14.224.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:48:41.040671 15234 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.623s user 0.000s sys 0.181s
I20260805 22:48:41.040796 15234 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260805 22:48:41.040895 15234 mini_ranger_kms.cc:401] 127.14.224.148:39033/kms/v1/keys
Aug 05 22:48:41 dist-test-slave-gjrz krb5kdc[31321](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970120, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.14.224.148@KRBTEST.COM for HTTP/127.14.224.148@KRBTEST.COM
Aug 05 22:48:41 dist-test-slave-gjrz krb5kdc[31321](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970120, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.14.224.148@KRBTEST.COM for HTTP/127.14.224.148@KRBTEST.COM
Aug 05 22:48:44 dist-test-slave-gjrz krb5kdc[31321](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970124, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.14.224.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab.
Entry for principal kudu/127.14.224.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab.
I20260805 22:48:44.078665 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:43365
--webserver_interface=127.14.224.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:41281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.224.190:43365
--ranger_config_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.14.224.148:39033/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:48:44.169320 31999 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:48:44.169591 31999 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:48:44.169617 31999 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:48:44.170934 31999 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:48:44.171002 31999 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:48:44.171023 31999 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:48:44.171036 31999 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:48:44.171046 31999 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:48:44.172981 31999 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:41281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/master-0/wal
--ranger_kms_url=127.14.224.148:39033/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.14.224.190:43365
--ranger_config_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:43365
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.224.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31999
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:48:44.173265 31999 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:48:44.173511 31999 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:48:44.179522 32005 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:48:44.179554 31999 server_base.cc:1034] running on GCE node
W20260805 22:48:44.179577 32006 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:48:44.179522 32009 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:48:44.180230 31999 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:48:44.180586 31999 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:48:44.181743 31999 hybrid_clock.cc:648] HybridClock initialized: now 1785970124181726 us; error 41 us; skew 500 ppm
Aug 05 22:48:44 dist-test-slave-gjrz krb5kdc[31321](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970124, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:48:44.187916 31999 init.cc:377] Logged in from keytab as kudu/127.14.224.190@KRBTEST.COM (short username kudu)
I20260805 22:48:44.188455 31999 webserver.cc:460] Webserver started at http://127.14.224.190:45505/ using document root <none> and password file <none>
I20260805 22:48:44.188694 31999 fs_manager.cc:359] Metadata directory not provided
I20260805 22:48:44.188738 31999 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:48:44.188877 31999 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 05 22:48:44 dist-test-slave-gjrz krb5kdc[31321](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970124, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.190@KRBTEST.COM for HTTP/127.14.224.148@KRBTEST.COM
I20260805 22:48:44.238310 31999 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/master-0/data/instance:
uuid: "c9b9862430be4400ae19377cbe97cc40"
format_stamp: "Formatted at 2026-08-05 22:48:44 on dist-test-slave-gjrz"
server_key: "3a2cdf0f1d97f875b8d9795afcc9a13d"
server_key_iv: "93cde7e060d60c1770158798c374d8ef"
server_key_version: "kuduclusterkey@0"
I20260805 22:48:44.238724 31999 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/master-0/wal/instance:
uuid: "c9b9862430be4400ae19377cbe97cc40"
format_stamp: "Formatted at 2026-08-05 22:48:44 on dist-test-slave-gjrz"
server_key: "3a2cdf0f1d97f875b8d9795afcc9a13d"
server_key_iv: "93cde7e060d60c1770158798c374d8ef"
server_key_version: "kuduclusterkey@0"
I20260805 22:48:44.240409 31999 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.004s
I20260805 22:48:44.253554 32018 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:48:44.255483 31999 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260805 22:48:44.255649 31999 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/master-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/master-0/wal
uuid: "c9b9862430be4400ae19377cbe97cc40"
format_stamp: "Formatted at 2026-08-05 22:48:44 on dist-test-slave-gjrz"
server_key: "3a2cdf0f1d97f875b8d9795afcc9a13d"
server_key_iv: "93cde7e060d60c1770158798c374d8ef"
server_key_version: "kuduclusterkey@0"
I20260805 22:48:44.255774 31999 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:48:44.266832 31999 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:48:44.268713 31999 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:48:44.268853 31999 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:48:44.273660 31999 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.190:43365
I20260805 22:48:44.273684 32089 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.190:43365 every 8 connection(s)
I20260805 22:48:44.274130 31999 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
I20260805 22:48:44.274845 32090 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:48:44.275951 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 31999
I20260805 22:48:44.276062 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/master-0/wal/instance
I20260805 22:48:44.276259 15234 external_mini_cluster.cc:1428] Setting key 1006f52537bdd25f92f35370d6e38b17
I20260805 22:48:44.277758 32090 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9b9862430be4400ae19377cbe97cc40: Bootstrap starting.
I20260805 22:48:44.278400 32090 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c9b9862430be4400ae19377cbe97cc40: Neither blocks nor log segments found. Creating new log.
I20260805 22:48:44.278689 32090 log.cc:824] T 00000000000000000000000000000000 P c9b9862430be4400ae19377cbe97cc40: Log is configured to *not* fsync() on all Append() calls
I20260805 22:48:44.279536 32090 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9b9862430be4400ae19377cbe97cc40: No bootstrap required, opened a new log
I20260805 22:48:44.281827 32090 raft_consensus.cc:348] T 00000000000000000000000000000000 P c9b9862430be4400ae19377cbe97cc40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9b9862430be4400ae19377cbe97cc40" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 43365 } }
I20260805 22:48:44.282037 32090 raft_consensus.cc:374] T 00000000000000000000000000000000 P c9b9862430be4400ae19377cbe97cc40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:48:44.282073 32090 raft_consensus.cc:729] T 00000000000000000000000000000000 P c9b9862430be4400ae19377cbe97cc40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9b9862430be4400ae19377cbe97cc40, State: Initialized, Role: FOLLOWER
I20260805 22:48:44.282244 32090 consensus_queue.cc:260] T 00000000000000000000000000000000 P c9b9862430be4400ae19377cbe97cc40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9b9862430be4400ae19377cbe97cc40" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 43365 } }
I20260805 22:48:44.282322 32090 raft_consensus.cc:388] T 00000000000000000000000000000000 P c9b9862430be4400ae19377cbe97cc40 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:48:44.282353 32090 raft_consensus.cc:482] T 00000000000000000000000000000000 P c9b9862430be4400ae19377cbe97cc40 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:48:44.282416 32090 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c9b9862430be4400ae19377cbe97cc40 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:48:44.282994 32090 raft_consensus.cc:504] T 00000000000000000000000000000000 P c9b9862430be4400ae19377cbe97cc40 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9b9862430be4400ae19377cbe97cc40" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 43365 } }
I20260805 22:48:44.283106 32090 leader_election.cc:302] T 00000000000000000000000000000000 P c9b9862430be4400ae19377cbe97cc40 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c9b9862430be4400ae19377cbe97cc40; no voters:
I20260805 22:48:44.283358 32090 leader_election.cc:288] T 00000000000000000000000000000000 P c9b9862430be4400ae19377cbe97cc40 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:48:44.283414 32095 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c9b9862430be4400ae19377cbe97cc40 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:48:44.283639 32095 raft_consensus.cc:686] T 00000000000000000000000000000000 P c9b9862430be4400ae19377cbe97cc40 [term 1 LEADER]: Becoming Leader. State: Replica: c9b9862430be4400ae19377cbe97cc40, State: Running, Role: LEADER
I20260805 22:48:44.283715 32090 sys_catalog.cc:564] T 00000000000000000000000000000000 P c9b9862430be4400ae19377cbe97cc40 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:48:44.283818 32095 consensus_queue.cc:237] T 00000000000000000000000000000000 P c9b9862430be4400ae19377cbe97cc40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9b9862430be4400ae19377cbe97cc40" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 43365 } }
I20260805 22:48:44.285862 32097 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9b9862430be4400ae19377cbe97cc40 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c9b9862430be4400ae19377cbe97cc40" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9b9862430be4400ae19377cbe97cc40" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 43365 } } }
Aug 05 22:48:44 dist-test-slave-gjrz krb5kdc[31321](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970124, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:48:44.286409 32119 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9b9862430be4400ae19377cbe97cc40 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c9b9862430be4400ae19377cbe97cc40. Latest consensus state: current_term: 1 leader_uuid: "c9b9862430be4400ae19377cbe97cc40" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9b9862430be4400ae19377cbe97cc40" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 43365 } } }
I20260805 22:48:44.286626 32090 ranger_client.cc:318] Using new properties file: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260805 22:48:44.287184 32097 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9b9862430be4400ae19377cbe97cc40 [sys.catalog]: This master's current role is: LEADER
I20260805 22:48:44.288023 32119 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9b9862430be4400ae19377cbe97cc40 [sys.catalog]: This master's current role is: LEADER
I20260805 22:48:44.290992 32123 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:48:44.292142 32123 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:48:44.295459 32093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:48:44.276832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35292 (local address 127.14.224.190:43365)
0805 22:48:44.277037 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0805 22:48:44.277047 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:48:44.279083 (+ 2036us) server_negotiation.cc:407] Connection header received
0805 22:48:44.279705 (+ 622us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:48:44.279714 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:48:44.279781 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:48:44.279938 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:48:44.280696 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:48:44.282097 (+ 1401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:48:44.283238 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:48:44.283911 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:48:44.284033 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:48:44.287206 (+ 3173us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:48:44.287211 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:48:44.287211 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:48:44.287227 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:48:44.292652 (+ 5425us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:48:44.293195 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:48:44.293199 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:48:44.293200 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:48:44.293347 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:48:44.293561 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:48:44.293562 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:48:44.293562 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:48:44.294026 (+ 464us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:48:44.294371 (+ 345us) server_negotiation.cc:1035] Waiting for connection context
0805 22:48:44.294865 (+ 494us) server_negotiation.cc:299] Negotiation successful
0805 22:48:44.295189 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":87,"threads_started":1}
I20260805 22:48:44.295567 32123 catalog_manager.cc:1347] Generated new cluster ID: 6ebce323fc144232b4e5f986af93e579
I20260805 22:48:44.296619 32123 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:48:44.311208 32123 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:48:44.312109 32123 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:48:44.319180 32123 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c9b9862430be4400ae19377cbe97cc40: Generated new TSK 0
I20260805 22:48:44.319707 32123 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.224.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab.
Entry for principal kudu/127.14.224.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab.
I20260805 22:48:45.066182 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.14.224.148:39033/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.129:0
--local_ip_for_outbound_sockets=127.14.224.129
--webserver_interface=127.14.224.129
--webserver_port=0
--tserver_master_addrs=127.14.224.190:43365
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab
--principal=kudu/127.14.224.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:41281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:48:45.185999 32157 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:48:45.186239 32157 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:48:45.186275 32157 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:48:45.187674 32157 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:48:45.187734 32157 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:48:45.187774 32157 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.129
I20260805 22:48:45.189612 32157 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:41281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.14.224.148:39033/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab
--principal=kudu/127.14.224.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.224.129
--webserver_port=0
--tserver_master_addrs=127.14.224.190:43365
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32157
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.129
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:48:45.189946 32157 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:48:45.190305 32157 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:48:45.197491 32169 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:48:45.197491 32166 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:48:45.197747 32157 server_base.cc:1034] running on GCE node
W20260805 22:48:45.197495 32167 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:48:45.198107 32157 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:48:45.198441 32157 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:48:45.199604 32157 hybrid_clock.cc:648] HybridClock initialized: now 1785970125199584 us; error 37 us; skew 500 ppm
Aug 05 22:48:45 dist-test-slave-gjrz krb5kdc[31321](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970125, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:48:45.202988 32157 init.cc:377] Logged in from keytab as kudu/127.14.224.129@KRBTEST.COM (short username kudu)
I20260805 22:48:45.203578 32157 webserver.cc:460] Webserver started at http://127.14.224.129:37537/ using document root <none> and password file <none>
I20260805 22:48:45.203922 32157 fs_manager.cc:359] Metadata directory not provided
I20260805 22:48:45.204010 32157 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:48:45.204195 32157 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 05 22:48:45 dist-test-slave-gjrz krb5kdc[31321](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970125, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.129@KRBTEST.COM for HTTP/127.14.224.148@KRBTEST.COM
I20260805 22:48:45.224982 32157 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/ts-0/data/instance:
uuid: "f148abe8d9284996a6890e66fb4bb766"
format_stamp: "Formatted at 2026-08-05 22:48:45 on dist-test-slave-gjrz"
server_key: "887f4b794961cfea40c0d635b609d22c"
server_key_iv: "8f5e674fa1094c86f75e804a0ba7fd85"
server_key_version: "kuduclusterkey@0"
I20260805 22:48:45.225504 32157 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/ts-0/wal/instance:
uuid: "f148abe8d9284996a6890e66fb4bb766"
format_stamp: "Formatted at 2026-08-05 22:48:45 on dist-test-slave-gjrz"
server_key: "887f4b794961cfea40c0d635b609d22c"
server_key_iv: "8f5e674fa1094c86f75e804a0ba7fd85"
server_key_version: "kuduclusterkey@0"
I20260805 22:48:45.227489 32157 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260805 22:48:45.242481 32178 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:48:45.242709 32157 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:48:45.242805 32157 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/ts-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/ts-0/wal
uuid: "f148abe8d9284996a6890e66fb4bb766"
format_stamp: "Formatted at 2026-08-05 22:48:45 on dist-test-slave-gjrz"
server_key: "887f4b794961cfea40c0d635b609d22c"
server_key_iv: "8f5e674fa1094c86f75e804a0ba7fd85"
server_key_version: "kuduclusterkey@0"
I20260805 22:48:45.242909 32157 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:48:45.267441 32157 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:48:45.270067 32157 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:48:45.270453 32157 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:48:45.270788 32157 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:48:45.271232 32157 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:48:45.271353 32157 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:48:45.271407 32157 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:48:45.271438 32157 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:48:45.279178 32157 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.129:46191
I20260805 22:48:45.279732 32157 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
I20260805 22:48:45.285678 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 32157
I20260805 22:48:45.285810 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/ts-0/wal/instance
I20260805 22:48:45.286043 15234 external_mini_cluster.cc:1428] Setting key a2556153634be5c06aeafc1f9c23f806
I20260805 22:48:45.286213 32342 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.129:46191 every 8 connection(s)
WARNING: no policy specified for kudu/127.14.224.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.130@KRBTEST.COM" created.
Aug 05 22:48:45 dist-test-slave-gjrz krb5kdc[31321](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970125, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.129@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:48:45.311128 32345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:48:45.287444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.129:56961 (local address 127.14.224.190:43365)
0805 22:48:45.296045 (+ 8601us) server_negotiation.cc:206] Beginning negotiation
0805 22:48:45.296048 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:48:45.298201 (+ 2153us) server_negotiation.cc:407] Connection header received
0805 22:48:45.298239 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:48:45.298240 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:48:45.298257 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:48:45.298328 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:48:45.299203 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:48:45.300074 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:48:45.304047 (+ 3973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:48:45.304384 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:48:45.304451 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:48:45.307440 (+ 2989us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:48:45.307442 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:48:45.307443 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:48:45.307452 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:48:45.309203 (+ 1751us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:48:45.309819 (+ 616us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:48:45.309821 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:48:45.309821 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:48:45.309901 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:48:45.310278 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:48:45.310280 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:48:45.310280 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:48:45.310452 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:48:45.310524 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0805 22:48:45.310912 (+ 388us) server_negotiation.cc:299] Negotiation successful
0805 22:48:45.311011 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8557,"thread_start_us":94,"threads_started":1}
I20260805 22:48:45.311345 32346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:48:45.287426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:43365 (local address 127.14.224.129:56961)
0805 22:48:45.297056 (+ 9630us) negotiation.cc:107] Waiting for socket to connect
0805 22:48:45.297141 (+ 85us) client_negotiation.cc:174] Beginning negotiation
0805 22:48:45.297860 (+ 719us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:48:45.298509 (+ 649us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:48:45.298515 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:48:45.298775 (+ 260us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:48:45.299081 (+ 306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:48:45.299089 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:48:45.300298 (+ 1209us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:48:45.300300 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:48:45.303905 (+ 3605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:48:45.303912 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:48:45.304531 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:48:45.304532 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:48:45.304699 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:48:45.305467 (+ 768us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:48:45.305478 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:48:45.307313 (+ 1835us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:48:45.309319 (+ 2006us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:48:45.309329 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:48:45.309332 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:48:45.309713 (+ 381us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:48:45.310001 (+ 288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:48:45.310002 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:48:45.310003 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:48:45.310184 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:48:45.310531 (+ 347us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:48:45.310539 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:48:45.310739 (+ 200us) client_negotiation.cc:769] Sending connection context
0805 22:48:45.310860 (+ 121us) client_negotiation.cc:240] Negotiation successful
0805 22:48:45.311049 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9558,"thread_start_us":102,"threads_started":1}
I20260805 22:48:45.312180 32343 heartbeater.cc:347] Connected to a master server at 127.14.224.190:43365
I20260805 22:48:45.312310 32343 heartbeater.cc:464] Registering TS with master...
I20260805 22:48:45.312533 32343 heartbeater.cc:511] Master 127.14.224.190:43365 requested a full tablet report, sending...
I20260805 22:48:45.313189 32039 ts_manager.cc:194] Registered new tserver with Master: f148abe8d9284996a6890e66fb4bb766 (127.14.224.129:46191)
I20260805 22:48:45.314137 32039 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.224.129@KRBTEST.COM'} at 127.14.224.129:56961
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab.
Entry for principal kudu/127.14.224.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab.
I20260805 22:48:45.323016 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.14.224.148:39033/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.130:0
--local_ip_for_outbound_sockets=127.14.224.130
--webserver_interface=127.14.224.130
--webserver_port=0
--tserver_master_addrs=127.14.224.190:43365
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab
--principal=kudu/127.14.224.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:41281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 05 22:48:45 dist-test-slave-gjrz krb5kdc[31321](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1785970125, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260805 22:48:45.448632 32349 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:48:45.448992 32349 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:48:45.449047 32349 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:48:45.451006 32349 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:48:45.451154 32349 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:48:45.451251 32349 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.130
I20260805 22:48:45.453878 32349 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:41281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.14.224.148:39033/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab
--principal=kudu/127.14.224.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.224.130
--webserver_port=0
--tserver_master_addrs=127.14.224.190:43365
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32349
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.130
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:48:45.454526 32349 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:48:45.454936 32349 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:48:45.462637 32361 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:48:45.463021 32360 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:48:45.463137 32364 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:48:45.463457 32349 server_base.cc:1034] running on GCE node
I20260805 22:48:45.463711 32349 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:48:45.464008 32349 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:48:45.465200 32349 hybrid_clock.cc:648] HybridClock initialized: now 1785970125465174 us; error 34 us; skew 500 ppm
Aug 05 22:48:45 dist-test-slave-gjrz krb5kdc[31321](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970125, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:48:45.468902 32349 init.cc:377] Logged in from keytab as kudu/127.14.224.130@KRBTEST.COM (short username kudu)
I20260805 22:48:45.469401 32349 webserver.cc:460] Webserver started at http://127.14.224.130:45759/ using document root <none> and password file <none>
I20260805 22:48:45.469655 32349 fs_manager.cc:359] Metadata directory not provided
I20260805 22:48:45.469705 32349 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:48:45.469841 32349 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 05 22:48:45 dist-test-slave-gjrz krb5kdc[31321](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970125, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.130@KRBTEST.COM for HTTP/127.14.224.148@KRBTEST.COM
I20260805 22:48:45.484676 32349 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/ts-1/data/instance:
uuid: "bca5b56fee024650b0e58fb145e40fe2"
format_stamp: "Formatted at 2026-08-05 22:48:45 on dist-test-slave-gjrz"
server_key: "266ced20eda19cf9abaf1fa2556e2841"
server_key_iv: "208e704ba51f05056e570396d5fd46f3"
server_key_version: "kuduclusterkey@0"
I20260805 22:48:45.485137 32349 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/ts-1/wal/instance:
uuid: "bca5b56fee024650b0e58fb145e40fe2"
format_stamp: "Formatted at 2026-08-05 22:48:45 on dist-test-slave-gjrz"
server_key: "266ced20eda19cf9abaf1fa2556e2841"
server_key_iv: "208e704ba51f05056e570396d5fd46f3"
server_key_version: "kuduclusterkey@0"
I20260805 22:48:45.489910 32349 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.001s
I20260805 22:48:45.512074 32377 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:48:45.513018 32349 fs_manager.cc:725] Time spent opening block manager: real 0.008s user 0.001s sys 0.000s
I20260805 22:48:45.513155 32349 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/ts-1/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/ts-1/wal
uuid: "bca5b56fee024650b0e58fb145e40fe2"
format_stamp: "Formatted at 2026-08-05 22:48:45 on dist-test-slave-gjrz"
server_key: "266ced20eda19cf9abaf1fa2556e2841"
server_key_iv: "208e704ba51f05056e570396d5fd46f3"
server_key_version: "kuduclusterkey@0"
I20260805 22:48:45.513266 32349 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:48:45.554534 32349 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:48:45.557055 32349 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:48:45.557289 32349 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:48:45.557591 32349 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:48:45.558166 32349 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:48:45.558264 32349 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:48:45.558337 32349 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:48:45.558393 32349 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:48:45.566247 32349 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.130:41899
I20260805 22:48:45.566742 32349 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
I20260805 22:48:45.572255 32540 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.130:41899 every 8 connection(s)
I20260805 22:48:45.572547 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 32349
I20260805 22:48:45.572669 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/ts-1/wal/instance
I20260805 22:48:45.572860 15234 external_mini_cluster.cc:1428] Setting key 0c46c70ac78bb6d3818535887f44026b
Aug 05 22:48:45 dist-test-slave-gjrz krb5kdc[31321](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970125, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.130@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:48:45.580291 32345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:48:45.568705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:59213 (local address 127.14.224.190:43365)
0805 22:48:45.568757 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0805 22:48:45.568760 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:48:45.568996 (+ 236us) server_negotiation.cc:407] Connection header received
0805 22:48:45.569831 (+ 835us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:48:45.569833 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:48:45.569854 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:48:45.569884 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:48:45.570788 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:48:45.571593 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:48:45.573094 (+ 1501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:48:45.573398 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:48:45.573442 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:48:45.576740 (+ 3298us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:48:45.576743 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:48:45.576743 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:48:45.576753 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:48:45.578463 (+ 1710us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:48:45.579056 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:48:45.579058 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:48:45.579058 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:48:45.579126 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:48:45.579459 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:48:45.579461 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:48:45.579461 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:48:45.579628 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:48:45.579681 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0805 22:48:45.580087 (+ 406us) server_negotiation.cc:299] Negotiation successful
0805 22:48:45.580191 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260805 22:48:45.581151 32547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:48:45.568384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:43365 (local address 127.14.224.130:59213)
0805 22:48:45.568857 (+ 473us) negotiation.cc:107] Waiting for socket to connect
0805 22:48:45.568907 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0805 22:48:45.569696 (+ 789us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:48:45.570086 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:48:45.570091 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:48:45.570355 (+ 264us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:48:45.570660 (+ 305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:48:45.570669 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:48:45.571723 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:48:45.571724 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:48:45.572989 (+ 1265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:48:45.572993 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:48:45.573997 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:48:45.573998 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:48:45.574167 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:48:45.574777 (+ 610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:48:45.574787 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:48:45.576598 (+ 1811us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:48:45.578611 (+ 2013us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:48:45.578621 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:48:45.578625 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:48:45.578959 (+ 334us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:48:45.579196 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:48:45.579197 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:48:45.579197 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:48:45.579379 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:48:45.579737 (+ 358us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:48:45.579744 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:48:45.579928 (+ 184us) client_negotiation.cc:769] Sending connection context
0805 22:48:45.580692 (+ 764us) client_negotiation.cc:240] Negotiation successful
0805 22:48:45.580884 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":429,"thread_start_us":94,"threads_started":1}
I20260805 22:48:45.581835 32541 heartbeater.cc:347] Connected to a master server at 127.14.224.190:43365
I20260805 22:48:45.581959 32541 heartbeater.cc:464] Registering TS with master...
I20260805 22:48:45.582172 32541 heartbeater.cc:511] Master 127.14.224.190:43365 requested a full tablet report, sending...
I20260805 22:48:45.582655 32039 ts_manager.cc:194] Registered new tserver with Master: bca5b56fee024650b0e58fb145e40fe2 (127.14.224.130:41899)
I20260805 22:48:45.583146 32039 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.224.130@KRBTEST.COM'} at 127.14.224.130:59213
WARNING: no policy specified for kudu/127.14.224.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab.
Entry for principal kudu/127.14.224.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab.
I20260805 22:48:45.621413 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.14.224.148:39033/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.131:0
--local_ip_for_outbound_sockets=127.14.224.131
--webserver_interface=127.14.224.131
--webserver_port=0
--tserver_master_addrs=127.14.224.190:43365
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab
--principal=kudu/127.14.224.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:41281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:48:45.752584 32550 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:48:45.752978 32550 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:48:45.753073 32550 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:48:45.755016 32550 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:48:45.755314 32550 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:48:45.755432 32550 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.131
I20260805 22:48:45.757933 32550 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:41281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.14.224.148:39033/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab
--principal=kudu/127.14.224.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.224.131
--webserver_port=0
--tserver_master_addrs=127.14.224.190:43365
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32550
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.131
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:48:45.758535 32550 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:48:45.758889 32550 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:48:45.766044 32558 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:48:45.767432 32550 server_base.cc:1034] running on GCE node
W20260805 22:48:45.767467 32564 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:48:45.772341 32560 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:48:45.772801 32550 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:48:45.773173 32550 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:48:45.775362 32550 hybrid_clock.cc:648] HybridClock initialized: now 1785970125775328 us; error 56 us; skew 500 ppm
Aug 05 22:48:45 dist-test-slave-gjrz krb5kdc[31321](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970125, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:48:45.779074 32550 init.cc:377] Logged in from keytab as kudu/127.14.224.131@KRBTEST.COM (short username kudu)
I20260805 22:48:45.779788 32550 webserver.cc:460] Webserver started at http://127.14.224.131:45953/ using document root <none> and password file <none>
I20260805 22:48:45.780107 32550 fs_manager.cc:359] Metadata directory not provided
I20260805 22:48:45.780212 32550 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:48:45.780390 32550 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 05 22:48:45 dist-test-slave-gjrz krb5kdc[31321](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970125, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.131@KRBTEST.COM for HTTP/127.14.224.148@KRBTEST.COM
I20260805 22:48:45.794934 32550 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/ts-2/data/instance:
uuid: "314a7bb38af840608c93f2d90c1d345c"
format_stamp: "Formatted at 2026-08-05 22:48:45 on dist-test-slave-gjrz"
server_key: "ca68b772bd4d1cf12b4e367addb26e2d"
server_key_iv: "611ac0be450ff18cf7cb77263c600c06"
server_key_version: "kuduclusterkey@0"
I20260805 22:48:45.796124 32550 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/ts-2/wal/instance:
uuid: "314a7bb38af840608c93f2d90c1d345c"
format_stamp: "Formatted at 2026-08-05 22:48:45 on dist-test-slave-gjrz"
server_key: "ca68b772bd4d1cf12b4e367addb26e2d"
server_key_iv: "611ac0be450ff18cf7cb77263c600c06"
server_key_version: "kuduclusterkey@0"
I20260805 22:48:45.798561 32550 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260805 22:48:45.813892 32575 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:48:45.814170 32550 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:48:45.814294 32550 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/ts-2/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/ts-2/wal
uuid: "314a7bb38af840608c93f2d90c1d345c"
format_stamp: "Formatted at 2026-08-05 22:48:45 on dist-test-slave-gjrz"
server_key: "ca68b772bd4d1cf12b4e367addb26e2d"
server_key_iv: "611ac0be450ff18cf7cb77263c600c06"
server_key_version: "kuduclusterkey@0"
I20260805 22:48:45.814401 32550 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:48:45.854650 32550 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:48:45.857172 32550 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:48:45.857395 32550 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:48:45.857702 32550 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:48:45.858258 32550 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:48:45.858361 32550 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:48:45.858428 32550 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:48:45.858480 32550 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:48:45.866456 32550 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.131:35165
I20260805 22:48:45.867082 32550 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
I20260805 22:48:45.870072 32737 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.131:35165 every 8 connection(s)
I20260805 22:48:45.872094 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 32550
I20260805 22:48:45.872201 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/ts-2/wal/instance
I20260805 22:48:45.872413 15234 external_mini_cluster.cc:1428] Setting key e0429d58976736db01641c50f7984407
Aug 05 22:48:45 dist-test-slave-gjrz krb5kdc[31321](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970125, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.131@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:48:45.881863 32345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:48:45.870803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:42519 (local address 127.14.224.190:43365)
0805 22:48:45.870855 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0805 22:48:45.870857 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:48:45.871387 (+ 530us) server_negotiation.cc:407] Connection header received
0805 22:48:45.872084 (+ 697us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:48:45.872086 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:48:45.872099 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:48:45.872129 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:48:45.873091 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:48:45.873814 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:48:45.875317 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:48:45.875596 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:48:45.875640 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:48:45.878495 (+ 2855us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:48:45.878497 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:48:45.878497 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:48:45.878507 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:48:45.880220 (+ 1713us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:48:45.880756 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:48:45.880758 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:48:45.880758 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:48:45.880824 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:48:45.881109 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:48:45.881110 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:48:45.881110 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:48:45.881249 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:48:45.881291 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0805 22:48:45.881674 (+ 383us) server_negotiation.cc:299] Negotiation successful
0805 22:48:45.881770 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260805 22:48:45.882441 32741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:48:45.870819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:43365 (local address 127.14.224.131:42519)
0805 22:48:45.871234 (+ 415us) negotiation.cc:107] Waiting for socket to connect
0805 22:48:45.871300 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0805 22:48:45.871948 (+ 648us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:48:45.872340 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:48:45.872344 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:48:45.872669 (+ 325us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:48:45.872977 (+ 308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:48:45.872985 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:48:45.873929 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:48:45.873930 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:48:45.875181 (+ 1251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:48:45.875185 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:48:45.875734 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:48:45.875735 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:48:45.875878 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:48:45.876653 (+ 775us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:48:45.876665 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:48:45.878365 (+ 1700us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:48:45.880327 (+ 1962us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:48:45.880336 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:48:45.880339 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:48:45.880663 (+ 324us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:48:45.880891 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:48:45.880891 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:48:45.880892 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:48:45.881026 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:48:45.881334 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:48:45.881341 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:48:45.881518 (+ 177us) client_negotiation.cc:769] Sending connection context
0805 22:48:45.882009 (+ 491us) client_negotiation.cc:240] Negotiation successful
0805 22:48:45.882203 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":375,"thread_start_us":97,"threads_started":1}
I20260805 22:48:45.883003 32738 heartbeater.cc:347] Connected to a master server at 127.14.224.190:43365
I20260805 22:48:45.883116 32738 heartbeater.cc:464] Registering TS with master...
I20260805 22:48:45.883339 32738 heartbeater.cc:511] Master 127.14.224.190:43365 requested a full tablet report, sending...
I20260805 22:48:45.883791 32039 ts_manager.cc:194] Registered new tserver with Master: 314a7bb38af840608c93f2d90c1d345c (127.14.224.131:35165)
I20260805 22:48:45.884044 15234 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 22:48:45.884311 32039 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.224.131@KRBTEST.COM'} at 127.14.224.131:42519
I20260805 22:48:45.902711 32345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:48:45.892381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35302 (local address 127.14.224.190:43365)
0805 22:48:45.892437 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0805 22:48:45.892439 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:48:45.893911 (+ 1472us) server_negotiation.cc:407] Connection header received
0805 22:48:45.895451 (+ 1540us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:48:45.895453 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:48:45.895467 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:48:45.895496 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:48:45.896274 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:48:45.896990 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:48:45.898004 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:48:45.898283 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:48:45.898321 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:48:45.899866 (+ 1545us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:48:45.899868 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:48:45.899868 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:48:45.899877 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:48:45.901483 (+ 1606us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:48:45.901888 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:48:45.901889 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:48:45.901890 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:48:45.901947 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:48:45.902139 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:48:45.902140 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:48:45.902140 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:48:45.902267 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:48:45.902337 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0805 22:48:45.902534 (+ 197us) server_negotiation.cc:299] Negotiation successful
0805 22:48:45.902616 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260805 22:48:45.905308 32039 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35302:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:48:45.907677 32039 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:48:45.923064 32758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:48:45.914855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.130:41899 (local address 127.0.0.1:36622)
0805 22:48:45.915600 (+ 745us) negotiation.cc:107] Waiting for socket to connect
0805 22:48:45.915609 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0805 22:48:45.915644 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:48:45.916012 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:48:45.916016 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:48:45.916018 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:48:45.916087 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:48:45.916089 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:48:45.917568 (+ 1479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:48:45.917569 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:48:45.918902 (+ 1333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:48:45.918906 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:48:45.922773 (+ 3867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:48:45.922774 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:48:45.922854 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:48:45.922870 (+ 16us) client_negotiation.cc:769] Sending connection context
0805 22:48:45.922916 (+ 46us) client_negotiation.cc:240] Negotiation successful
0805 22:48:45.922968 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":731,"mutex_wait_us":2,"thread_start_us":180,"threads_started":1}
I20260805 22:48:45.923749 32764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:48:45.915210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36622 (local address 127.14.224.130:41899)
0805 22:48:45.915785 (+ 575us) server_negotiation.cc:206] Beginning negotiation
0805 22:48:45.915791 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:48:45.915800 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:48:45.915838 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:48:45.915840 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:48:45.915855 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:48:45.915921 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:48:45.916159 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:48:45.917310 (+ 1151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:48:45.919027 (+ 1717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:48:45.919851 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:48:45.923501 (+ 3650us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:48:45.923595 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0805 22:48:45.923626 (+ 31us) server_negotiation.cc:299] Negotiation successful
0805 22:48:45.923672 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":537,"thread_start_us":94,"threads_started":1}
I20260805 22:48:45.924652 32423 tablet_service.cc:1467] Processing CreateTablet for tablet 32da63f190b84377a7c503677f08307d (DEFAULT_TABLE table=test-table [id=de474d9a7bf441e3a4f37db543239334]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:48:45.925042 32423 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 32da63f190b84377a7c503677f08307d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:48:45.925660 32761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:48:45.915086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.131:35165 (local address 127.0.0.1:58250)
0805 22:48:45.917431 (+ 2345us) negotiation.cc:107] Waiting for socket to connect
0805 22:48:45.917441 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0805 22:48:45.917483 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:48:45.920230 (+ 2747us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:48:45.920232 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:48:45.920233 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:48:45.920272 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:48:45.920274 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:48:45.921504 (+ 1230us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:48:45.921505 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:48:45.922650 (+ 1145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:48:45.922654 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:48:45.925411 (+ 2757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:48:45.925412 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:48:45.925475 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:48:45.925480 (+ 5us) client_negotiation.cc:769] Sending connection context
0805 22:48:45.925529 (+ 49us) client_negotiation.cc:240] Negotiation successful
0805 22:48:45.925576 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2325,"thread_start_us":84,"threads_started":1}
I20260805 22:48:45.927335 32765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:48:45.915343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58250 (local address 127.14.224.131:35165)
0805 22:48:45.920008 (+ 4665us) server_negotiation.cc:206] Beginning negotiation
0805 22:48:45.920012 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:48:45.920021 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:48:45.920059 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:48:45.920061 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:48:45.920077 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:48:45.920149 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:48:45.920337 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:48:45.921413 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:48:45.924478 (+ 3065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:48:45.925229 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:48:45.925318 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:48:45.925371 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0805 22:48:45.927173 (+ 1802us) server_negotiation.cc:299] Negotiation successful
0805 22:48:45.927227 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4622,"thread_start_us":118,"threads_started":1}
I20260805 22:48:45.928016 32646 tablet_service.cc:1467] Processing CreateTablet for tablet 32da63f190b84377a7c503677f08307d (DEFAULT_TABLE table=test-table [id=de474d9a7bf441e3a4f37db543239334]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:48:45.928369 32646 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 32da63f190b84377a7c503677f08307d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:48:45.934769 32763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:48:45.914855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.129:46191 (local address 127.0.0.1:51342)
0805 22:48:45.915385 (+ 530us) negotiation.cc:107] Waiting for socket to connect
0805 22:48:45.915425 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0805 22:48:45.915488 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:48:45.925794 (+ 10306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:48:45.925796 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:48:45.925798 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:48:45.925835 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:48:45.925837 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:48:45.932321 (+ 6484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:48:45.932322 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:48:45.933482 (+ 1160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:48:45.933486 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:48:45.934510 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:48:45.934511 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:48:45.934588 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:48:45.934594 (+ 6us) client_negotiation.cc:769] Sending connection context
0805 22:48:45.934636 (+ 42us) client_negotiation.cc:240] Negotiation successful
0805 22:48:45.934684 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":498,"thread_start_us":78,"threads_started":1}
I20260805 22:48:45.935487 32762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:48:45.914968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51342 (local address 127.14.224.129:46191)
0805 22:48:45.924289 (+ 9321us) server_negotiation.cc:206] Beginning negotiation
0805 22:48:45.924293 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:48:45.924304 (+ 11us) server_negotiation.cc:407] Connection header received
0805 22:48:45.924338 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:48:45.924340 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:48:45.924357 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:48:45.925914 (+ 1557us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:48:45.925988 (+ 74us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:48:45.927060 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:48:45.933627 (+ 6567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:48:45.934410 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:48:45.935221 (+ 811us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:48:45.935340 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0805 22:48:45.935369 (+ 29us) server_negotiation.cc:299] Negotiation successful
0805 22:48:45.935416 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9282,"thread_start_us":90,"threads_started":1}
I20260805 22:48:45.936025 300 tablet_bootstrap.cc:492] T 32da63f190b84377a7c503677f08307d P 314a7bb38af840608c93f2d90c1d345c: Bootstrap starting.
I20260805 22:48:45.936347 32235 tablet_service.cc:1467] Processing CreateTablet for tablet 32da63f190b84377a7c503677f08307d (DEFAULT_TABLE table=test-table [id=de474d9a7bf441e3a4f37db543239334]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:48:45.936719 32235 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 32da63f190b84377a7c503677f08307d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:48:45.937237 300 tablet_bootstrap.cc:654] T 32da63f190b84377a7c503677f08307d P 314a7bb38af840608c93f2d90c1d345c: Neither blocks nor log segments found. Creating new log.
I20260805 22:48:45.937700 300 log.cc:824] T 32da63f190b84377a7c503677f08307d P 314a7bb38af840608c93f2d90c1d345c: Log is configured to *not* fsync() on all Append() calls
I20260805 22:48:45.938753 300 tablet_bootstrap.cc:492] T 32da63f190b84377a7c503677f08307d P 314a7bb38af840608c93f2d90c1d345c: No bootstrap required, opened a new log
I20260805 22:48:45.938827 300 ts_tablet_manager.cc:1397] T 32da63f190b84377a7c503677f08307d P 314a7bb38af840608c93f2d90c1d345c: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260805 22:48:45.939455 32767 tablet_bootstrap.cc:492] T 32da63f190b84377a7c503677f08307d P bca5b56fee024650b0e58fb145e40fe2: Bootstrap starting.
I20260805 22:48:45.940619 32767 tablet_bootstrap.cc:654] T 32da63f190b84377a7c503677f08307d P bca5b56fee024650b0e58fb145e40fe2: Neither blocks nor log segments found. Creating new log.
I20260805 22:48:45.940936 32767 log.cc:824] T 32da63f190b84377a7c503677f08307d P bca5b56fee024650b0e58fb145e40fe2: Log is configured to *not* fsync() on all Append() calls
I20260805 22:48:45.941045 300 raft_consensus.cc:348] T 32da63f190b84377a7c503677f08307d P 314a7bb38af840608c93f2d90c1d345c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bca5b56fee024650b0e58fb145e40fe2" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41899 } } peers { permanent_uuid: "314a7bb38af840608c93f2d90c1d345c" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 35165 } } peers { permanent_uuid: "f148abe8d9284996a6890e66fb4bb766" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 46191 } }
I20260805 22:48:45.941215 300 raft_consensus.cc:374] T 32da63f190b84377a7c503677f08307d P 314a7bb38af840608c93f2d90c1d345c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:48:45.941247 300 raft_consensus.cc:729] T 32da63f190b84377a7c503677f08307d P 314a7bb38af840608c93f2d90c1d345c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 314a7bb38af840608c93f2d90c1d345c, State: Initialized, Role: FOLLOWER
I20260805 22:48:45.941359 300 consensus_queue.cc:260] T 32da63f190b84377a7c503677f08307d P 314a7bb38af840608c93f2d90c1d345c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bca5b56fee024650b0e58fb145e40fe2" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41899 } } peers { permanent_uuid: "314a7bb38af840608c93f2d90c1d345c" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 35165 } } peers { permanent_uuid: "f148abe8d9284996a6890e66fb4bb766" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 46191 } }
I20260805 22:48:45.941612 300 ts_tablet_manager.cc:1428] T 32da63f190b84377a7c503677f08307d P 314a7bb38af840608c93f2d90c1d345c: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260805 22:48:45.942248 32738 heartbeater.cc:503] Master 127.14.224.190:43365 was elected leader, sending a full tablet report...
I20260805 22:48:45.944089 303 tablet_bootstrap.cc:492] T 32da63f190b84377a7c503677f08307d P f148abe8d9284996a6890e66fb4bb766: Bootstrap starting.
I20260805 22:48:45.944305 32767 tablet_bootstrap.cc:492] T 32da63f190b84377a7c503677f08307d P bca5b56fee024650b0e58fb145e40fe2: No bootstrap required, opened a new log
I20260805 22:48:45.944447 32767 ts_tablet_manager.cc:1397] T 32da63f190b84377a7c503677f08307d P bca5b56fee024650b0e58fb145e40fe2: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260805 22:48:45.945128 303 tablet_bootstrap.cc:654] T 32da63f190b84377a7c503677f08307d P f148abe8d9284996a6890e66fb4bb766: Neither blocks nor log segments found. Creating new log.
I20260805 22:48:45.945528 303 log.cc:824] T 32da63f190b84377a7c503677f08307d P f148abe8d9284996a6890e66fb4bb766: Log is configured to *not* fsync() on all Append() calls
I20260805 22:48:45.946755 32767 raft_consensus.cc:348] T 32da63f190b84377a7c503677f08307d P bca5b56fee024650b0e58fb145e40fe2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bca5b56fee024650b0e58fb145e40fe2" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41899 } } peers { permanent_uuid: "314a7bb38af840608c93f2d90c1d345c" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 35165 } } peers { permanent_uuid: "f148abe8d9284996a6890e66fb4bb766" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 46191 } }
I20260805 22:48:45.946996 32767 raft_consensus.cc:374] T 32da63f190b84377a7c503677f08307d P bca5b56fee024650b0e58fb145e40fe2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:48:45.947067 32767 raft_consensus.cc:729] T 32da63f190b84377a7c503677f08307d P bca5b56fee024650b0e58fb145e40fe2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bca5b56fee024650b0e58fb145e40fe2, State: Initialized, Role: FOLLOWER
I20260805 22:48:45.947293 32767 consensus_queue.cc:260] T 32da63f190b84377a7c503677f08307d P bca5b56fee024650b0e58fb145e40fe2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bca5b56fee024650b0e58fb145e40fe2" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41899 } } peers { permanent_uuid: "314a7bb38af840608c93f2d90c1d345c" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 35165 } } peers { permanent_uuid: "f148abe8d9284996a6890e66fb4bb766" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 46191 } }
I20260805 22:48:45.947636 32767 ts_tablet_manager.cc:1428] T 32da63f190b84377a7c503677f08307d P bca5b56fee024650b0e58fb145e40fe2: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260805 22:48:45.947793 32541 heartbeater.cc:503] Master 127.14.224.190:43365 was elected leader, sending a full tablet report...
I20260805 22:48:45.949214 303 tablet_bootstrap.cc:492] T 32da63f190b84377a7c503677f08307d P f148abe8d9284996a6890e66fb4bb766: No bootstrap required, opened a new log
I20260805 22:48:45.949342 303 ts_tablet_manager.cc:1397] T 32da63f190b84377a7c503677f08307d P f148abe8d9284996a6890e66fb4bb766: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260805 22:48:45.952157 303 raft_consensus.cc:348] T 32da63f190b84377a7c503677f08307d P f148abe8d9284996a6890e66fb4bb766 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bca5b56fee024650b0e58fb145e40fe2" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41899 } } peers { permanent_uuid: "314a7bb38af840608c93f2d90c1d345c" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 35165 } } peers { permanent_uuid: "f148abe8d9284996a6890e66fb4bb766" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 46191 } }
I20260805 22:48:45.952426 303 raft_consensus.cc:374] T 32da63f190b84377a7c503677f08307d P f148abe8d9284996a6890e66fb4bb766 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:48:45.952500 303 raft_consensus.cc:729] T 32da63f190b84377a7c503677f08307d P f148abe8d9284996a6890e66fb4bb766 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f148abe8d9284996a6890e66fb4bb766, State: Initialized, Role: FOLLOWER
I20260805 22:48:45.952694 303 consensus_queue.cc:260] T 32da63f190b84377a7c503677f08307d P f148abe8d9284996a6890e66fb4bb766 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bca5b56fee024650b0e58fb145e40fe2" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41899 } } peers { permanent_uuid: "314a7bb38af840608c93f2d90c1d345c" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 35165 } } peers { permanent_uuid: "f148abe8d9284996a6890e66fb4bb766" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 46191 } }
I20260805 22:48:45.953033 303 ts_tablet_manager.cc:1428] T 32da63f190b84377a7c503677f08307d P f148abe8d9284996a6890e66fb4bb766: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20260805 22:48:45.953231 32343 heartbeater.cc:503] Master 127.14.224.190:43365 was elected leader, sending a full tablet report...
W20260805 22:48:46.037364 32344 tablet.cc:2369] T 32da63f190b84377a7c503677f08307d P f148abe8d9284996a6890e66fb4bb766: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 05 22:48:46 dist-test-slave-gjrz krb5kdc[31321](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970125, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.190@KRBTEST.COM for HTTP/127.14.224.148@KRBTEST.COM
W20260805 22:48:46.068128 32545 tablet.cc:2369] T 32da63f190b84377a7c503677f08307d P bca5b56fee024650b0e58fb145e40fe2: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260805 22:48:46.121383 32739 tablet.cc:2369] T 32da63f190b84377a7c503677f08307d P 314a7bb38af840608c93f2d90c1d345c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:48:46.169325 309 raft_consensus.cc:482] T 32da63f190b84377a7c503677f08307d P f148abe8d9284996a6890e66fb4bb766 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:48:46.169472 309 raft_consensus.cc:504] T 32da63f190b84377a7c503677f08307d P f148abe8d9284996a6890e66fb4bb766 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bca5b56fee024650b0e58fb145e40fe2" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41899 } } peers { permanent_uuid: "314a7bb38af840608c93f2d90c1d345c" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 35165 } } peers { permanent_uuid: "f148abe8d9284996a6890e66fb4bb766" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 46191 } }
I20260805 22:48:46.169862 309 leader_election.cc:288] T 32da63f190b84377a7c503677f08307d P f148abe8d9284996a6890e66fb4bb766 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bca5b56fee024650b0e58fb145e40fe2 (127.14.224.130:41899), 314a7bb38af840608c93f2d90c1d345c (127.14.224.131:35165)
I20260805 22:48:46.174192 32764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:48:46.170324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.129:53367 (local address 127.14.224.130:41899)
0805 22:48:46.170368 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0805 22:48:46.170370 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:48:46.170510 (+ 140us) server_negotiation.cc:407] Connection header received
0805 22:48:46.170614 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:48:46.170615 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:48:46.170626 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:48:46.170656 (+ 30us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:48:46.170894 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:48:46.171646 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:48:46.173242 (+ 1596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:48:46.173786 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:48:46.173839 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:48:46.173849 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0805 22:48:46.174063 (+ 214us) server_negotiation.cc:299] Negotiation successful
0805 22:48:46.174113 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260805 22:48:46.174219 32765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:48:46.170111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.129:33131 (local address 127.14.224.131:35165)
0805 22:48:46.170164 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0805 22:48:46.170166 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:48:46.170524 (+ 358us) server_negotiation.cc:407] Connection header received
0805 22:48:46.170618 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:48:46.170619 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:48:46.170629 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:48:46.170678 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:48:46.171007 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:48:46.171772 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:48:46.173244 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:48:46.173804 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:48:46.173855 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:48:46.173864 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0805 22:48:46.174101 (+ 237us) server_negotiation.cc:299] Negotiation successful
0805 22:48:46.174145 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260805 22:48:46.174471 312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:48:46.170061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.131:35165 (local address 127.14.224.129:33131)
0805 22:48:46.170447 (+ 386us) negotiation.cc:107] Waiting for socket to connect
0805 22:48:46.170459 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:48:46.170536 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:48:46.170702 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:48:46.170702 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:48:46.170704 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:48:46.170887 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:48:46.170890 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:48:46.171897 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:48:46.171898 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:48:46.173134 (+ 1236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:48:46.173137 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:48:46.173924 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:48:46.173925 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:48:46.174019 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:48:46.174023 (+ 4us) client_negotiation.cc:769] Sending connection context
0805 22:48:46.174347 (+ 324us) client_negotiation.cc:240] Negotiation successful
0805 22:48:46.174392 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":156,"threads_started":1}
I20260805 22:48:46.174942 32668 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "32da63f190b84377a7c503677f08307d" candidate_uuid: "f148abe8d9284996a6890e66fb4bb766" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "314a7bb38af840608c93f2d90c1d345c" is_pre_election: true
I20260805 22:48:46.175060 314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:48:46.170069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.130:41899 (local address 127.14.224.129:53367)
0805 22:48:46.170436 (+ 367us) negotiation.cc:107] Waiting for socket to connect
0805 22:48:46.170448 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:48:46.170540 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:48:46.170729 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:48:46.170730 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:48:46.170731 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:48:46.170819 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:48:46.170821 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:48:46.171792 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:48:46.171793 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:48:46.173127 (+ 1334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:48:46.173132 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:48:46.173910 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:48:46.173911 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:48:46.173987 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:48:46.173991 (+ 4us) client_negotiation.cc:769] Sending connection context
0805 22:48:46.174910 (+ 919us) client_negotiation.cc:240] Negotiation successful
0805 22:48:46.174963 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":348,"mutex_wait_us":67,"thread_start_us":108,"threads_started":1}
I20260805 22:48:46.175145 32668 raft_consensus.cc:2454] T 32da63f190b84377a7c503677f08307d P 314a7bb38af840608c93f2d90c1d345c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f148abe8d9284996a6890e66fb4bb766 in term 0.
I20260805 22:48:46.175412 32464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "32da63f190b84377a7c503677f08307d" candidate_uuid: "f148abe8d9284996a6890e66fb4bb766" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bca5b56fee024650b0e58fb145e40fe2" is_pre_election: true
I20260805 22:48:46.175505 32188 leader_election.cc:302] T 32da63f190b84377a7c503677f08307d P f148abe8d9284996a6890e66fb4bb766 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 314a7bb38af840608c93f2d90c1d345c, f148abe8d9284996a6890e66fb4bb766; no voters:
I20260805 22:48:46.175561 32464 raft_consensus.cc:2454] T 32da63f190b84377a7c503677f08307d P bca5b56fee024650b0e58fb145e40fe2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f148abe8d9284996a6890e66fb4bb766 in term 0.
I20260805 22:48:46.175657 309 raft_consensus.cc:2781] T 32da63f190b84377a7c503677f08307d P f148abe8d9284996a6890e66fb4bb766 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:48:46.175697 309 raft_consensus.cc:482] T 32da63f190b84377a7c503677f08307d P f148abe8d9284996a6890e66fb4bb766 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:48:46.175717 309 raft_consensus.cc:3037] T 32da63f190b84377a7c503677f08307d P f148abe8d9284996a6890e66fb4bb766 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:48:46.176679 309 raft_consensus.cc:504] T 32da63f190b84377a7c503677f08307d P f148abe8d9284996a6890e66fb4bb766 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bca5b56fee024650b0e58fb145e40fe2" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41899 } } peers { permanent_uuid: "314a7bb38af840608c93f2d90c1d345c" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 35165 } } peers { permanent_uuid: "f148abe8d9284996a6890e66fb4bb766" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 46191 } }
I20260805 22:48:46.176864 309 leader_election.cc:288] T 32da63f190b84377a7c503677f08307d P f148abe8d9284996a6890e66fb4bb766 [CANDIDATE]: Term 1 election: Requested vote from peers bca5b56fee024650b0e58fb145e40fe2 (127.14.224.130:41899), 314a7bb38af840608c93f2d90c1d345c (127.14.224.131:35165)
I20260805 22:48:46.177155 32464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "32da63f190b84377a7c503677f08307d" candidate_uuid: "f148abe8d9284996a6890e66fb4bb766" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bca5b56fee024650b0e58fb145e40fe2"
I20260805 22:48:46.177241 32464 raft_consensus.cc:3037] T 32da63f190b84377a7c503677f08307d P bca5b56fee024650b0e58fb145e40fe2 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:48:46.177242 32668 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "32da63f190b84377a7c503677f08307d" candidate_uuid: "f148abe8d9284996a6890e66fb4bb766" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "314a7bb38af840608c93f2d90c1d345c"
I20260805 22:48:46.177362 32668 raft_consensus.cc:3037] T 32da63f190b84377a7c503677f08307d P 314a7bb38af840608c93f2d90c1d345c [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:48:46.178215 32464 raft_consensus.cc:2454] T 32da63f190b84377a7c503677f08307d P bca5b56fee024650b0e58fb145e40fe2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f148abe8d9284996a6890e66fb4bb766 in term 1.
I20260805 22:48:46.178440 32187 leader_election.cc:302] T 32da63f190b84377a7c503677f08307d P f148abe8d9284996a6890e66fb4bb766 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bca5b56fee024650b0e58fb145e40fe2, f148abe8d9284996a6890e66fb4bb766; no voters:
I20260805 22:48:46.178519 32668 raft_consensus.cc:2454] T 32da63f190b84377a7c503677f08307d P 314a7bb38af840608c93f2d90c1d345c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f148abe8d9284996a6890e66fb4bb766 in term 1.
I20260805 22:48:46.178648 309 raft_consensus.cc:2781] T 32da63f190b84377a7c503677f08307d P f148abe8d9284996a6890e66fb4bb766 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:48:46.178814 309 raft_consensus.cc:686] T 32da63f190b84377a7c503677f08307d P f148abe8d9284996a6890e66fb4bb766 [term 1 LEADER]: Becoming Leader. State: Replica: f148abe8d9284996a6890e66fb4bb766, State: Running, Role: LEADER
I20260805 22:48:46.178922 309 consensus_queue.cc:237] T 32da63f190b84377a7c503677f08307d P f148abe8d9284996a6890e66fb4bb766 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bca5b56fee024650b0e58fb145e40fe2" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41899 } } peers { permanent_uuid: "314a7bb38af840608c93f2d90c1d345c" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 35165 } } peers { permanent_uuid: "f148abe8d9284996a6890e66fb4bb766" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 46191 } }
I20260805 22:48:46.179831 32039 catalog_manager.cc:5495] T 32da63f190b84377a7c503677f08307d P f148abe8d9284996a6890e66fb4bb766 reported cstate change: term changed from 0 to 1, leader changed from <none> to f148abe8d9284996a6890e66fb4bb766 (127.14.224.129). New cstate: current_term: 1 leader_uuid: "f148abe8d9284996a6890e66fb4bb766" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bca5b56fee024650b0e58fb145e40fe2" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "314a7bb38af840608c93f2d90c1d345c" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 35165 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f148abe8d9284996a6890e66fb4bb766" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 46191 } health_report { overall_health: HEALTHY } } }
I20260805 22:48:46.201387 32762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:48:46.197995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51352 (local address 127.14.224.129:46191)
0805 22:48:46.198063 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0805 22:48:46.198065 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:48:46.198075 (+ 10us) server_negotiation.cc:407] Connection header received
0805 22:48:46.198119 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:48:46.198120 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:48:46.198143 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:48:46.198226 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:48:46.198523 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:48:46.199251 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:48:46.200387 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:48:46.200686 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:48:46.200759 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:48:46.200956 (+ 197us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:48:46.201111 (+ 155us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:48:46.201194 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0805 22:48:46.201246 (+ 52us) server_negotiation.cc:299] Negotiation successful
0805 22:48:46.201271 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260805 22:48:46.203990 32464 raft_consensus.cc:1261] T 32da63f190b84377a7c503677f08307d P bca5b56fee024650b0e58fb145e40fe2 [term 1 FOLLOWER]: Refusing update from remote peer f148abe8d9284996a6890e66fb4bb766: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:48:46.203981 32668 raft_consensus.cc:1261] T 32da63f190b84377a7c503677f08307d P 314a7bb38af840608c93f2d90c1d345c [term 1 FOLLOWER]: Refusing update from remote peer f148abe8d9284996a6890e66fb4bb766: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:48:46.204387 309 consensus_queue.cc:1035] T 32da63f190b84377a7c503677f08307d P f148abe8d9284996a6890e66fb4bb766 [LEADER]: Connected to new peer: Peer: permanent_uuid: "314a7bb38af840608c93f2d90c1d345c" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 35165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:48:46.204636 309 consensus_queue.cc:1035] T 32da63f190b84377a7c503677f08307d P f148abe8d9284996a6890e66fb4bb766 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bca5b56fee024650b0e58fb145e40fe2" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:48:46.209738 326 mvcc.cc:205] Tried to move back new op lower bound from 7315333636927901696 to 7315333636829560832. Current Snapshot: MvccSnapshot[applied={T|T < 7315333636927901696}]
I20260805 22:48:46.209932 323 mvcc.cc:205] Tried to move back new op lower bound from 7315333636927901696 to 7315333636829560832. Current Snapshot: MvccSnapshot[applied={T|T < 7315333636927901696 or (T in {7315333636927901696})}]
I20260805 22:48:46.210099 32039 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35302:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:48:46.210202 32039 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35302:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:48:46.210915 32039 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c9b9862430be4400ae19377cbe97cc40: Sending DeleteTablet for 3 replicas of tablet 32da63f190b84377a7c503677f08307d
I20260805 22:48:46.211374 32646 tablet_service.cc:1514] Processing DeleteTablet for tablet 32da63f190b84377a7c503677f08307d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:48:46 UTC) from {username='kudu', principal='kudu/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:58250
I20260805 22:48:46.211596 32235 tablet_service.cc:1514] Processing DeleteTablet for tablet 32da63f190b84377a7c503677f08307d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:48:46 UTC) from {username='kudu', principal='kudu/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:51342
I20260805 22:48:46.211817 32423 tablet_service.cc:1514] Processing DeleteTablet for tablet 32da63f190b84377a7c503677f08307d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:48:46 UTC) from {username='kudu', principal='kudu/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:36622
I20260805 22:48:46.212224 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 32157
I20260805 22:48:46.220088 325 mvcc.cc:205] Tried to move back new op lower bound from 7315333636927901696 to 7315333636829560832. Current Snapshot: MvccSnapshot[applied={T|T < 7315333636927901696}]
I20260805 22:48:46.231487 333 tablet_replica.cc:330] T 32da63f190b84377a7c503677f08307d P 314a7bb38af840608c93f2d90c1d345c: stopping tablet replica
I20260805 22:48:46.231665 333 raft_consensus.cc:2229] T 32da63f190b84377a7c503677f08307d P 314a7bb38af840608c93f2d90c1d345c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:48:46.231844 333 raft_consensus.cc:2258] T 32da63f190b84377a7c503677f08307d P 314a7bb38af840608c93f2d90c1d345c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:48:46.232195 336 tablet_replica.cc:330] T 32da63f190b84377a7c503677f08307d P bca5b56fee024650b0e58fb145e40fe2: stopping tablet replica
I20260805 22:48:46.232403 336 raft_consensus.cc:2229] T 32da63f190b84377a7c503677f08307d P bca5b56fee024650b0e58fb145e40fe2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:48:46.232517 333 ts_tablet_manager.cc:1905] T 32da63f190b84377a7c503677f08307d P 314a7bb38af840608c93f2d90c1d345c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:48:46.232582 336 raft_consensus.cc:2258] T 32da63f190b84377a7c503677f08307d P bca5b56fee024650b0e58fb145e40fe2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:48:46.233059 336 ts_tablet_manager.cc:1905] T 32da63f190b84377a7c503677f08307d P bca5b56fee024650b0e58fb145e40fe2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:48:46.234688 333 ts_tablet_manager.cc:1918] T 32da63f190b84377a7c503677f08307d P 314a7bb38af840608c93f2d90c1d345c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:48:46.234706 336 ts_tablet_manager.cc:1918] T 32da63f190b84377a7c503677f08307d P bca5b56fee024650b0e58fb145e40fe2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:48:46.234771 336 log.cc:1196] T 32da63f190b84377a7c503677f08307d P bca5b56fee024650b0e58fb145e40fe2: Deleting WAL directory at /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/ts-1/wal/wals/32da63f190b84377a7c503677f08307d
I20260805 22:48:46.234831 333 log.cc:1196] T 32da63f190b84377a7c503677f08307d P 314a7bb38af840608c93f2d90c1d345c: Deleting WAL directory at /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970021300824-15234-0/minicluster-data/ts-2/wal/wals/32da63f190b84377a7c503677f08307d
I20260805 22:48:46.235102 336 ts_tablet_manager.cc:1939] T 32da63f190b84377a7c503677f08307d P bca5b56fee024650b0e58fb145e40fe2: Deleting consensus metadata
I20260805 22:48:46.235677 32023 catalog_manager.cc:4841] TS bca5b56fee024650b0e58fb145e40fe2 (127.14.224.130:41899): tablet 32da63f190b84377a7c503677f08307d (table test-table [id=de474d9a7bf441e3a4f37db543239334]) successfully deleted
I20260805 22:48:46.235795 333 ts_tablet_manager.cc:1939] T 32da63f190b84377a7c503677f08307d P 314a7bb38af840608c93f2d90c1d345c: Deleting consensus metadata
I20260805 22:48:46.236281 32024 catalog_manager.cc:4841] TS 314a7bb38af840608c93f2d90c1d345c (127.14.224.131:35165): tablet 32da63f190b84377a7c503677f08307d (table test-table [id=de474d9a7bf441e3a4f37db543239334]) successfully deleted
W20260805 22:48:46.236804 32021 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.224.129:46191 (error 108)
I20260805 22:48:46.237511 32763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:48:46.237361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.129:46191 (local address 127.0.0.1:51358)
0805 22:48:46.237429 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0805 22:48:46.237475 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.129:46191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260805 22:48:46.237640 32021 catalog_manager.cc:4584] TS f148abe8d9284996a6890e66fb4bb766 (127.14.224.129:46191): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 32da63f190b84377a7c503677f08307d: Network error: Client connection negotiation failed: client connection to 127.14.224.129:46191: connect: Connection refused (error 111)
I20260805 22:48:46.239444 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 32349
I20260805 22:48:46.257249 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 32550
I20260805 22:48:46.267323 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 31999
I20260805 22:48:46.282966 15234 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260805 22:48:46.628190 15234 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260805 22:48:46.628317 15234 mini_ranger.cc:66] Stopping Ranger...
I20260805 22:48:46.974102 15234 mini_ranger.cc:68] Stopped Ranger
2026-08-05 22:48:46.974 UTC [31367] LOG: received smart shutdown request
2026-08-05 22:48:46.978 UTC [31367] LOG: background worker "logical replication launcher" (PID 31382) exited with exit code 1
2026-08-05 22:48:46.978 UTC [31372] LOG: shutting down
2026-08-05 22:48:47.137 UTC [31367] LOG: database system is shut down
2026-08-05T22:48:47Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (47103 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:48:47 dist-test-slave-gjrz krb5kdc[350](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:48:47 dist-test-slave-gjrz krb5kdc[350](info): set up 2 sockets
Aug 05 22:48:47 dist-test-slave-gjrz krb5kdc[350](info): commencing operation
krb5kdc: starting...
W20260805 22:48:48.372525 15234 mini_kdc.cc:121] Time spent starting KDC: real 1.123s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Aug 05 22:48:48 dist-test-slave-gjrz krb5kdc[350](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970128, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:48:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:48:48Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.14.224.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.14.224.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.14.224.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/krb5kdc/rangeradmin_127.14.224.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.14.224.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/krb5kdc/rangeradmin_127.14.224.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.14.224.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.14.224.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.14.224.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/krb5kdc/rangerlookup_127.14.224.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.14.224.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/krb5kdc/rangerlookup_127.14.224.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.14.224.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.14.224.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.14.224.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/krb5kdc/HTTP_127.14.224.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.14.224.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/krb5kdc/HTTP_127.14.224.148@KRBTEST.COM.keytab.
I20260805 22:48:48.549659 15234 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-task9AL_ND/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/postgres -l logfile start
2026-08-05 22:48:51.025 UTC [392] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-05 22:48:51.025 UTC [392] LOG: listening on IPv4 address "127.14.224.148", port 47657
2026-08-05 22:48:51.029 UTC [392] LOG: listening on Unix socket "/tmp/.s.PGSQL.47657"
2026-08-05 22:48:51.058 UTC [397] LOG: database system was shut down at 2026-08-05 22:48:49 UTC
2026-08-05 22:48:51.062 UTC [392] LOG: database system is ready to accept connections
I20260805 22:48:52.114357 15234 mini_postgres.cc:96] Postgres bound to 47657
2026-08-05 22:48:52.121 UTC [410] FATAL: database "slave" does not exist
127.14.224.148:47657 - accepting connections
I20260805 22:48:52.121851 15234 mini_ranger.cc:161] Starting Ranger...
I20260805 22:48:52.138321 15234 mini_ranger.cc:84] Created miniranger Postgres user
I20260805 22:48:52.615527 15234 mini_ranger.cc:87] Created ranger Postgres database
I20260805 22:48:52.615597 15234 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ranger-admin
2026-08-05 22:48:52,909 [I] DB FLAVOR :POSTGRES
2026-08-05 22:48:52,910 [I] --------- Verifying Ranger DB connection ---------
2026-08-05 22:48:52,910 [I] Checking connection..
2026-08-05 22:48:52,910 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9AL_ND/build/release/bin/postgresql.jar:/tmp/dist-test-task9AL_ND/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.224.148:47657/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-05 22:48:53,187 [I] Checking connection passed.
2026-08-05 22:48:53,187 [I] --------- Verifying version history table ---------
2026-08-05 22:48:53,187 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9AL_ND/build/release/bin/postgresql.jar:/tmp/dist-test-task9AL_ND/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.224.148:47657/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-05 22:48:53,449 [I] Table x_db_version_h does not exist in database ranger
2026-08-05 22:48:53,449 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9AL_ND/build/release/bin/postgresql.jar:/tmp/dist-test-task9AL_ND/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.224.148:47657/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-05 22:48:53,691 [I] Table x_db_version_h does not exist in database ranger
2026-08-05 22:48:53,691 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-05 22:48:53,692 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9AL_ND/build/release/bin/postgresql.jar:/tmp/dist-test-task9AL_ND/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.224.148:47657/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-task9AL_ND/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-05 22:48:53.950 UTC [502] WARNING: there is no transaction in progress
2026-08-05 22:48:53,959 [I] create_dbversion_catalog.sql file imported successfully
2026-08-05 22:48:53,959 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9AL_ND/build/release/bin/postgresql.jar:/tmp/dist-test-task9AL_ND/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.224.148:47657/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-05 22:48:54,232 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-05 22:48:54,232 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-05 22:48:54,232 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9AL_ND/build/release/bin/postgresql.jar:/tmp/dist-test-task9AL_ND/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.224.148:47657/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-05 22:48:54,505 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9AL_ND/build/release/bin/postgresql.jar:/tmp/dist-test-task9AL_ND/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.224.148:47657/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-05 22:48:54,765 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9AL_ND/build/release/bin/postgresql.jar:/tmp/dist-test-task9AL_ND/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.224.148:47657/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-gjrz.c.gcp-upstream.internal','N') ;"
2026-08-05 22:48:54,999 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9AL_ND/build/release/bin/postgresql.jar:/tmp/dist-test-task9AL_ND/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.224.148:47657/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-05 22:48:55,279 [I] Table x_portal_user does not exist in database ranger
2026-08-05 22:48:55,279 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9AL_ND/build/release/bin/postgresql.jar:/tmp/dist-test-task9AL_ND/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.224.148:47657/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-05 22:48:55,537 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-05 22:48:55,537 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9AL_ND/build/release/bin/postgresql.jar:/tmp/dist-test-task9AL_ND/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.224.148:47657/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-05 22:48:55,782 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9AL_ND/build/release/bin/postgresql.jar:/tmp/dist-test-task9AL_ND/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.224.148:47657/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-05 22:48:56,036 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-05 22:48:56,037 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9AL_ND/build/release/bin/postgresql.jar:/tmp/dist-test-task9AL_ND/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.224.148:47657/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-task9AL_ND/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-05 22:48:57.085 UTC [659] WARNING: there is no transaction in progress
2026-08-05 22:48:57.102 UTC [659] WARNING: there is no transaction in progress
2026-08-05 22:48:57.121 UTC [659] WARNING: there is no transaction in progress
2026-08-05 22:48:57.140 UTC [659] WARNING: there is no transaction in progress
2026-08-05 22:48:57.162 UTC [659] WARNING: there is no transaction in progress
2026-08-05 22:48:57.187 UTC [659] WARNING: there is no transaction in progress
2026-08-05 22:48:57.259 UTC [659] WARNING: there is no transaction in progress
2026-08-05 22:48:57.267 UTC [659] WARNING: there is no transaction in progress
2026-08-05 22:48:57.283 UTC [659] WARNING: there is no transaction in progress
2026-08-05 22:48:57.295 UTC [659] WARNING: there is no transaction in progress
2026-08-05 22:48:57.309 UTC [659] WARNING: there is no transaction in progress
2026-08-05 22:48:57.327 UTC [659] WARNING: there is no transaction in progress
2026-08-05 22:48:57.338 UTC [659] WARNING: there is no transaction in progress
2026-08-05 22:48:57.346 UTC [659] WARNING: there is no transaction in progress
2026-08-05 22:48:57.355 UTC [659] WARNING: there is no transaction in progress
2026-08-05 22:48:57.363 UTC [659] WARNING: there is no transaction in progress
2026-08-05 22:48:58,111 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-05 22:48:58,111 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9AL_ND/build/release/bin/postgresql.jar:/tmp/dist-test-task9AL_ND/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.224.148:47657/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-05 22:48:58,352 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-05 22:48:58,353 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9AL_ND/build/release/bin/postgresql.jar:/tmp/dist-test-task9AL_ND/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.224.148:47657/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-05 22:48:58,594 [I] Table x_portal_user already exists in database 'ranger'
2026-08-05 22:48:58,594 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9AL_ND/build/release/bin/postgresql.jar:/tmp/dist-test-task9AL_ND/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.224.148:47657/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-05 22:48:58,864 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-05 22:48:58,864 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9AL_ND/build/release/bin/postgresql.jar:/tmp/dist-test-task9AL_ND/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.224.148:47657/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-05 22:48:59,138 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9AL_ND/build/release/bin/postgresql.jar:/tmp/dist-test-task9AL_ND/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.224.148:47657/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-05 22:48:59,400 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9AL_ND/build/release/bin/postgresql.jar:/tmp/dist-test-task9AL_ND/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.224.148:47657/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-gjrz.c.gcp-upstream.internal';"
2026-08-05 22:48:59,653 [I] CORE_DB_SCHEMA import status has been updated
2026-08-05 22:48:59,653 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9AL_ND/build/release/bin/postgresql.jar:/tmp/dist-test-task9AL_ND/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.224.148:47657/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-05 22:48:59,924 [I] DB_PATCHES have already been applied
I20260805 22:48:59.930269 15234 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ranger-admin:/tmp/dist-test-task9AL_ND/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-task9AL_ND/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-task9AL_ND/build/release/bin/postgresql.jar:/tmp/dist-test-task9AL_ND/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260805 22:48:59.930346 15234 mini_ranger.cc:193] Using host: 127.14.224.148
I20260805 22:48:59.934320 15234 mini_ranger.cc:227] Ranger admin URL: http://127.14.224.148:36175
Aug 05, 2026 10:49:00 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 05, 2026 10:49:00 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 05, 2026 10:49:00 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ranger-admin/ews/webapp
Aug 05, 2026 10:49:00 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 05, 2026 10:49:00 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 05, 2026 10:49:00 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ranger-admin/ews/webapp].
Aug 05, 2026 10:49:00 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260805 22:49:01.129879 15234 mini_ranger.cc:160] Time spent starting Ranger: real 9.008s user 0.000s sys 0.011s
Aug 05, 2026 10:49:21 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 05, 2026 10:49:21 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 05, 2026 10:49:21 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 05, 2026 10:49:21 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 05, 2026 10:49:21 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 05, 2026 10:49:21 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 05, 2026 10:49:21 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 05, 2026 10:49:21 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 05, 2026 10:49:21 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 05, 2026 10:49:21 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 05, 2026 10:49:21 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 05, 2026 10:49:21 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 05, 2026 10:49:21 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 05, 2026 10:49:21 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 05, 2026 10:49:21 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 05, 2026 10:49:21 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 05, 2026 10:49:21 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 05, 2026 10:49:22 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260805 22:49:22.817145 15234 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.14.224.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.14.224.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.14.224.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/krb5kdc/rangerkms_127.14.224.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.14.224.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/krb5kdc/rangerkms_127.14.224.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.14.224.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.14.224.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.14.224.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/krb5kdc/HTTP_127.14.224.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.14.224.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/krb5kdc/HTTP_127.14.224.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 05 22:49:22 dist-test-slave-gjrz krb5kdc[350](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970162, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260805 22:49:22.904275 15234 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260805 22:49:22.915192 15234 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260805 22:49:23.775309 15234 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260805 22:49:23.775395 15234 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ranger-kms
I20260805 22:49:23.775410 15234 mini_ranger_kms.cc:227] Using postgres at 127.14.224.148:47657
2026-08-05 22:49:23,928 [I] DB FLAVOR :POSTGRES
2026-08-05 22:49:23,928 [I] --------- Verifying Ranger DB connection ---------
2026-08-05 22:49:23,928 [I] Checking connection
2026-08-05 22:49:23,928 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9AL_ND/build/release/bin/postgresql.jar:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.224.148:47657/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-05 22:49:24,170 [I] connection success
2026-08-05 22:49:24,171 [I] --------- Verifying Ranger DB tables ---------
2026-08-05 22:49:24,171 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-05 22:49:24,171 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9AL_ND/build/release/bin/postgresql.jar:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.224.148:47657/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-05 22:49:24,440 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-05 22:49:24,441 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-05 22:49:24,441 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-05 22:49:24,441 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9AL_ND/build/release/bin/postgresql.jar:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.224.148:47657/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-05 22:49:24,706 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260805 22:49:25.187045 15234 mini_ranger_kms.cc:310] Created kms service
I20260805 22:49:25.366845 15234 mini_ranger_kms.cc:326] Created kudu user
I20260805 22:49:25.414865 15234 mini_ranger_kms.cc:343] Created rangerkms user
Aug 05 22:49:25 dist-test-slave-gjrz krb5kdc[350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970162, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.14.224.148@KRBTEST.COM
I20260805 22:49:25.885191 15234 mini_ranger_kms.cc:384] Added ranger policy
I20260805 22:49:25.885427 15234 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ranger-kms:/tmp/dist-test-task9AL_ND/build/release/bin/postgresql.jar:/tmp/dist-test-task9AL_ND/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-task9AL_ND/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260805 22:49:25.885452 15234 mini_ranger_kms.cc:240] Using host: 127.14.224.148
I20260805 22:49:25.890381 15234 mini_ranger_kms.cc:276] Ranger KMS PID: 940
I20260805 22:49:25.890468 15234 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.14.224.148:34699
Aug 05, 2026 10:49:26 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 05, 2026 10:49:26 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 05, 2026 10:49:27 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 05, 2026 10:49:27 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 05, 2026 10:49:27 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ranger-kms/ews/webapp].
Aug 05, 2026 10:49:27 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 05 22:49:28 dist-test-slave-gjrz krb5kdc[350](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1785970168, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.14.224.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:49:28.369494 15234 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.465s user 0.025s sys 0.113s
I20260805 22:49:28.369613 15234 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260805 22:49:28.369660 15234 mini_ranger_kms.cc:401] 127.14.224.148:34699/kms/v1/keys
Aug 05 22:49:28 dist-test-slave-gjrz krb5kdc[350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970168, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.14.224.148@KRBTEST.COM for HTTP/127.14.224.148@KRBTEST.COM
Aug 05 22:49:28 dist-test-slave-gjrz krb5kdc[350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970168, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.14.224.148@KRBTEST.COM for HTTP/127.14.224.148@KRBTEST.COM
Aug 05 22:49:31 dist-test-slave-gjrz krb5kdc[350](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970171, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.14.224.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab.
Entry for principal kudu/127.14.224.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab.
I20260805 22:49:31.349771 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:46255
--webserver_interface=127.14.224.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:36303
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.224.190:46255
--ranger_config_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.14.224.148:34699/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:49:31.434834 1019 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:49:31.435047 1019 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:49:31.435070 1019 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:49:31.436379 1019 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:49:31.436427 1019 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:49:31.436440 1019 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:49:31.436458 1019 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:49:31.436473 1019 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:49:31.438061 1019 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:36303
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/master-0/wal
--ranger_kms_url=127.14.224.148:34699/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.14.224.190:46255
--ranger_config_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:46255
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.224.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1019
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:49:31.438268 1019 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:49:31.438449 1019 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:49:31.443289 1027 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:49:31.443300 1025 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:49:31.443286 1024 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:49:31.443369 1019 server_base.cc:1034] running on GCE node
I20260805 22:49:31.443852 1019 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:49:31.444175 1019 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:49:31.445319 1019 hybrid_clock.cc:648] HybridClock initialized: now 1785970171445304 us; error 30 us; skew 500 ppm
Aug 05 22:49:31 dist-test-slave-gjrz krb5kdc[350](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970171, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:49:31.450543 1019 init.cc:377] Logged in from keytab as kudu/127.14.224.190@KRBTEST.COM (short username kudu)
I20260805 22:49:31.450989 1019 webserver.cc:460] Webserver started at http://127.14.224.190:45681/ using document root <none> and password file <none>
I20260805 22:49:31.451228 1019 fs_manager.cc:359] Metadata directory not provided
I20260805 22:49:31.451290 1019 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:49:31.451428 1019 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 05 22:49:31 dist-test-slave-gjrz krb5kdc[350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970171, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.190@KRBTEST.COM for HTTP/127.14.224.148@KRBTEST.COM
I20260805 22:49:31.499516 1019 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/master-0/data/instance:
uuid: "e20e06ab9d4d48c69bcbf295c057623a"
format_stamp: "Formatted at 2026-08-05 22:49:31 on dist-test-slave-gjrz"
server_key: "3034a839de57a55ea4f9a4621f219442"
server_key_iv: "df5585fa5178673695dc4c5052bf8db5"
server_key_version: "kuduclusterkey@0"
I20260805 22:49:31.500008 1019 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/master-0/wal/instance:
uuid: "e20e06ab9d4d48c69bcbf295c057623a"
format_stamp: "Formatted at 2026-08-05 22:49:31 on dist-test-slave-gjrz"
server_key: "3034a839de57a55ea4f9a4621f219442"
server_key_iv: "df5585fa5178673695dc4c5052bf8db5"
server_key_version: "kuduclusterkey@0"
I20260805 22:49:31.501655 1019 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260805 22:49:31.517915 1038 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:49:31.518205 1019 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:49:31.518339 1019 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/master-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/master-0/wal
uuid: "e20e06ab9d4d48c69bcbf295c057623a"
format_stamp: "Formatted at 2026-08-05 22:49:31 on dist-test-slave-gjrz"
server_key: "3034a839de57a55ea4f9a4621f219442"
server_key_iv: "df5585fa5178673695dc4c5052bf8db5"
server_key_version: "kuduclusterkey@0"
I20260805 22:49:31.518461 1019 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:49:31.535702 1019 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:49:31.537652 1019 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:49:31.537806 1019 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:49:31.543618 1019 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.190:46255
I20260805 22:49:31.543641 1114 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.190:46255 every 8 connection(s)
I20260805 22:49:31.544075 1019 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
I20260805 22:49:31.544816 1115 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:49:31.547124 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 1019
I20260805 22:49:31.547233 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/master-0/wal/instance
I20260805 22:49:31.547384 1115 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e20e06ab9d4d48c69bcbf295c057623a: Bootstrap starting.
I20260805 22:49:31.547492 15234 external_mini_cluster.cc:1428] Setting key 1a1e8213f47d8f748ed38e48350bbe68
I20260805 22:49:31.548211 1115 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e20e06ab9d4d48c69bcbf295c057623a: Neither blocks nor log segments found. Creating new log.
I20260805 22:49:31.548527 1115 log.cc:824] T 00000000000000000000000000000000 P e20e06ab9d4d48c69bcbf295c057623a: Log is configured to *not* fsync() on all Append() calls
I20260805 22:49:31.549496 1115 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e20e06ab9d4d48c69bcbf295c057623a: No bootstrap required, opened a new log
I20260805 22:49:31.552066 1115 raft_consensus.cc:348] T 00000000000000000000000000000000 P e20e06ab9d4d48c69bcbf295c057623a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e20e06ab9d4d48c69bcbf295c057623a" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 46255 } }
I20260805 22:49:31.552245 1115 raft_consensus.cc:374] T 00000000000000000000000000000000 P e20e06ab9d4d48c69bcbf295c057623a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:49:31.552284 1115 raft_consensus.cc:729] T 00000000000000000000000000000000 P e20e06ab9d4d48c69bcbf295c057623a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e20e06ab9d4d48c69bcbf295c057623a, State: Initialized, Role: FOLLOWER
I20260805 22:49:31.552423 1115 consensus_queue.cc:260] T 00000000000000000000000000000000 P e20e06ab9d4d48c69bcbf295c057623a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e20e06ab9d4d48c69bcbf295c057623a" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 46255 } }
I20260805 22:49:31.552501 1115 raft_consensus.cc:388] T 00000000000000000000000000000000 P e20e06ab9d4d48c69bcbf295c057623a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:49:31.552536 1115 raft_consensus.cc:482] T 00000000000000000000000000000000 P e20e06ab9d4d48c69bcbf295c057623a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:49:31.552587 1115 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e20e06ab9d4d48c69bcbf295c057623a [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:49:31.553210 1115 raft_consensus.cc:504] T 00000000000000000000000000000000 P e20e06ab9d4d48c69bcbf295c057623a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e20e06ab9d4d48c69bcbf295c057623a" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 46255 } }
I20260805 22:49:31.553323 1115 leader_election.cc:302] T 00000000000000000000000000000000 P e20e06ab9d4d48c69bcbf295c057623a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e20e06ab9d4d48c69bcbf295c057623a; no voters:
I20260805 22:49:31.553520 1115 leader_election.cc:288] T 00000000000000000000000000000000 P e20e06ab9d4d48c69bcbf295c057623a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:49:31.553565 1121 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e20e06ab9d4d48c69bcbf295c057623a [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:49:31.553743 1121 raft_consensus.cc:686] T 00000000000000000000000000000000 P e20e06ab9d4d48c69bcbf295c057623a [term 1 LEADER]: Becoming Leader. State: Replica: e20e06ab9d4d48c69bcbf295c057623a, State: Running, Role: LEADER
I20260805 22:49:31.553826 1115 sys_catalog.cc:564] T 00000000000000000000000000000000 P e20e06ab9d4d48c69bcbf295c057623a [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:49:31.553900 1121 consensus_queue.cc:237] T 00000000000000000000000000000000 P e20e06ab9d4d48c69bcbf295c057623a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e20e06ab9d4d48c69bcbf295c057623a" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 46255 } }
I20260805 22:49:31.554272 1121 sys_catalog.cc:455] T 00000000000000000000000000000000 P e20e06ab9d4d48c69bcbf295c057623a [sys.catalog]: SysCatalogTable state changed. Reason: New leader e20e06ab9d4d48c69bcbf295c057623a. Latest consensus state: current_term: 1 leader_uuid: "e20e06ab9d4d48c69bcbf295c057623a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e20e06ab9d4d48c69bcbf295c057623a" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 46255 } } }
I20260805 22:49:31.554529 1121 sys_catalog.cc:458] T 00000000000000000000000000000000 P e20e06ab9d4d48c69bcbf295c057623a [sys.catalog]: This master's current role is: LEADER
Aug 05 22:49:31 dist-test-slave-gjrz krb5kdc[350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970171, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:49:31.554456 1123 sys_catalog.cc:455] T 00000000000000000000000000000000 P e20e06ab9d4d48c69bcbf295c057623a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e20e06ab9d4d48c69bcbf295c057623a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e20e06ab9d4d48c69bcbf295c057623a" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 46255 } } }
I20260805 22:49:31.554922 1123 sys_catalog.cc:458] T 00000000000000000000000000000000 P e20e06ab9d4d48c69bcbf295c057623a [sys.catalog]: This master's current role is: LEADER
I20260805 22:49:31.555135 1132 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:49:31.555421 1115 ranger_client.cc:318] Using new properties file: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260805 22:49:31.555773 1132 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:49:31.562800 1118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:31.548130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50836 (local address 127.14.224.190:46255)
0805 22:49:31.548312 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0805 22:49:31.548323 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0805 22:49:31.548360 (+ 37us) server_negotiation.cc:407] Connection header received
0805 22:49:31.548897 (+ 537us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:49:31.548908 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:49:31.548980 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:49:31.549157 (+ 177us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:49:31.549942 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:31.551145 (+ 1203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:31.552064 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:31.552589 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:31.552709 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:31.555487 (+ 2778us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:49:31.555491 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:49:31.555492 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:49:31.555507 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:49:31.560358 (+ 4851us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:31.560865 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:31.560869 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:31.560870 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:31.560990 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:31.561243 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:31.561244 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:31.561244 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:31.561624 (+ 380us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:49:31.562290 (+ 666us) server_negotiation.cc:1035] Waiting for connection context
0805 22:49:31.562370 (+ 80us) server_negotiation.cc:299] Negotiation successful
0805 22:49:31.562541 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":76,"threads_started":1}
I20260805 22:49:31.563629 1132 catalog_manager.cc:1347] Generated new cluster ID: c918942e3cb34070a7f4f0b2b397802d
I20260805 22:49:31.563730 1132 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:49:31.576647 1132 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:49:31.577461 1132 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:49:31.587669 1132 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e20e06ab9d4d48c69bcbf295c057623a: Generated new TSK 0
I20260805 22:49:31.587894 1132 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.224.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab.
Entry for principal kudu/127.14.224.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab.
I20260805 22:49:32.296972 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.14.224.148:34699/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.129:0
--local_ip_for_outbound_sockets=127.14.224.129
--webserver_interface=127.14.224.129
--webserver_port=0
--tserver_master_addrs=127.14.224.190:46255
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab
--principal=kudu/127.14.224.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:36303
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:49:32.397614 1179 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:49:32.397933 1179 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:49:32.397974 1179 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:49:32.399859 1179 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:49:32.399923 1179 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:49:32.399955 1179 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.129
I20260805 22:49:32.401679 1179 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:36303
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.14.224.148:34699/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab
--principal=kudu/127.14.224.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.224.129
--webserver_port=0
--tserver_master_addrs=127.14.224.190:46255
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1179
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.129
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:49:32.401962 1179 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:49:32.402209 1179 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:49:32.408623 1191 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:49:32.408624 1188 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:49:32.408730 1187 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:49:32.408980 1179 server_base.cc:1034] running on GCE node
I20260805 22:49:32.409215 1179 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:49:32.409583 1179 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:49:32.411345 1179 hybrid_clock.cc:648] HybridClock initialized: now 1785970172411319 us; error 40 us; skew 500 ppm
Aug 05 22:49:32 dist-test-slave-gjrz krb5kdc[350](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970172, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:49:32.414563 1179 init.cc:377] Logged in from keytab as kudu/127.14.224.129@KRBTEST.COM (short username kudu)
I20260805 22:49:32.415151 1179 webserver.cc:460] Webserver started at http://127.14.224.129:38537/ using document root <none> and password file <none>
I20260805 22:49:32.415500 1179 fs_manager.cc:359] Metadata directory not provided
I20260805 22:49:32.415606 1179 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:49:32.415824 1179 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 05 22:49:32 dist-test-slave-gjrz krb5kdc[350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970172, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.129@KRBTEST.COM for HTTP/127.14.224.148@KRBTEST.COM
I20260805 22:49:32.435451 1179 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-0/data/instance:
uuid: "df2e713c09f946a087e77a1387d4b20e"
format_stamp: "Formatted at 2026-08-05 22:49:32 on dist-test-slave-gjrz"
server_key: "b0988a9dc95f4f1a4e13970b735a8730"
server_key_iv: "85e4143016ff383abb47cfa7dac9a7db"
server_key_version: "kuduclusterkey@0"
I20260805 22:49:32.436038 1179 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-0/wal/instance:
uuid: "df2e713c09f946a087e77a1387d4b20e"
format_stamp: "Formatted at 2026-08-05 22:49:32 on dist-test-slave-gjrz"
server_key: "b0988a9dc95f4f1a4e13970b735a8730"
server_key_iv: "85e4143016ff383abb47cfa7dac9a7db"
server_key_version: "kuduclusterkey@0"
I20260805 22:49:32.438102 1179 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.000s
I20260805 22:49:32.453665 1205 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:49:32.453912 1179 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.000s
I20260805 22:49:32.454015 1179 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-0/wal
uuid: "df2e713c09f946a087e77a1387d4b20e"
format_stamp: "Formatted at 2026-08-05 22:49:32 on dist-test-slave-gjrz"
server_key: "b0988a9dc95f4f1a4e13970b735a8730"
server_key_iv: "85e4143016ff383abb47cfa7dac9a7db"
server_key_version: "kuduclusterkey@0"
I20260805 22:49:32.454114 1179 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:49:32.468292 1179 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:49:32.470481 1179 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:49:32.470629 1179 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:49:32.470825 1179 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:49:32.471163 1179 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:49:32.471199 1179 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:49:32.471230 1179 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:49:32.471297 1179 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:49:32.478134 1179 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.129:40089
I20260805 22:49:32.478542 1179 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
I20260805 22:49:32.479121 1380 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.129:40089 every 8 connection(s)
I20260805 22:49:32.479768 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 1179
I20260805 22:49:32.479866 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-0/wal/instance
I20260805 22:49:32.480104 15234 external_mini_cluster.cc:1428] Setting key 9ab2a0b7e37565306439bd215970ad1a
Aug 05 22:49:32 dist-test-slave-gjrz krb5kdc[350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970172, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.129@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:49:32.497941 1384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:32.486174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:46255 (local address 127.14.224.129:44955)
0805 22:49:32.486707 (+ 533us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:32.486762 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0805 22:49:32.487483 (+ 721us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:49:32.487967 (+ 484us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:49:32.487972 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:49:32.488255 (+ 283us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:49:32.488552 (+ 297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:32.488558 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:32.489600 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:32.489602 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:32.491016 (+ 1414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:32.491021 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:32.491635 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:32.491636 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:32.491791 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:32.492421 (+ 630us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:49:32.492433 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:49:32.494172 (+ 1739us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:49:32.496236 (+ 2064us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:49:32.496245 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:49:32.496248 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:49:32.496559 (+ 311us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:49:32.496771 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:49:32.496772 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:49:32.496772 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:49:32.496919 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:49:32.497232 (+ 313us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:49:32.497239 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:49:32.497414 (+ 175us) client_negotiation.cc:769] Sending connection context
0805 22:49:32.497519 (+ 105us) client_negotiation.cc:240] Negotiation successful
0805 22:49:32.497686 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":479,"thread_start_us":120,"threads_started":1}
I20260805 22:49:32.498531 1388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:32.486530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.129:44955 (local address 127.14.224.190:46255)
0805 22:49:32.487711 (+ 1181us) server_negotiation.cc:206] Beginning negotiation
0805 22:49:32.487713 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:49:32.487721 (+ 8us) server_negotiation.cc:407] Connection header received
0805 22:49:32.487748 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:49:32.487749 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:49:32.487761 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:49:32.487827 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:49:32.488685 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:32.489472 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:32.491136 (+ 1664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:32.491483 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:32.491548 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:32.494307 (+ 2759us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:49:32.494309 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:49:32.494309 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:49:32.494318 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:49:32.496130 (+ 1812us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:32.496640 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:32.496642 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:32.496642 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:32.496708 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:32.496987 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:32.496987 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:32.496988 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:32.497148 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:49:32.497206 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0805 22:49:32.498339 (+ 1133us) server_negotiation.cc:299] Negotiation successful
0805 22:49:32.498434 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1148,"thread_start_us":81,"threads_started":1}
I20260805 22:49:32.499320 1381 heartbeater.cc:347] Connected to a master server at 127.14.224.190:46255
I20260805 22:49:32.499418 1381 heartbeater.cc:464] Registering TS with master...
I20260805 22:49:32.499619 1381 heartbeater.cc:511] Master 127.14.224.190:46255 requested a full tablet report, sending...
I20260805 22:49:32.500252 1060 ts_manager.cc:194] Registered new tserver with Master: df2e713c09f946a087e77a1387d4b20e (127.14.224.129:40089)
I20260805 22:49:32.501137 1060 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.224.129@KRBTEST.COM'} at 127.14.224.129:44955
WARNING: no policy specified for kudu/127.14.224.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab.
Entry for principal kudu/127.14.224.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab.
I20260805 22:49:32.562314 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.14.224.148:34699/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.130:0
--local_ip_for_outbound_sockets=127.14.224.130
--webserver_interface=127.14.224.130
--webserver_port=0
--tserver_master_addrs=127.14.224.190:46255
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab
--principal=kudu/127.14.224.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:36303
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 05 22:49:32 dist-test-slave-gjrz krb5kdc[350](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1785970172, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260805 22:49:32.690330 1397 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:49:32.690726 1397 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:49:32.690806 1397 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:49:32.692816 1397 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:49:32.692893 1397 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:49:32.692946 1397 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.130
I20260805 22:49:32.695426 1397 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:36303
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.14.224.148:34699/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab
--principal=kudu/127.14.224.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.224.130
--webserver_port=0
--tserver_master_addrs=127.14.224.190:46255
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1397
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.130
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:49:32.695739 1397 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:49:32.696069 1397 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:49:32.702461 1404 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:49:32.702458 1414 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:49:32.703009 1405 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:49:32.703359 1397 server_base.cc:1034] running on GCE node
I20260805 22:49:32.703590 1397 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:49:32.703888 1397 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:49:32.705060 1397 hybrid_clock.cc:648] HybridClock initialized: now 1785970172705035 us; error 40 us; skew 500 ppm
Aug 05 22:49:32 dist-test-slave-gjrz krb5kdc[350](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970172, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:49:32.708396 1397 init.cc:377] Logged in from keytab as kudu/127.14.224.130@KRBTEST.COM (short username kudu)
I20260805 22:49:32.709009 1397 webserver.cc:460] Webserver started at http://127.14.224.130:40625/ using document root <none> and password file <none>
I20260805 22:49:32.709296 1397 fs_manager.cc:359] Metadata directory not provided
I20260805 22:49:32.709359 1397 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:49:32.709539 1397 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 05 22:49:32 dist-test-slave-gjrz krb5kdc[350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970172, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.130@KRBTEST.COM for HTTP/127.14.224.148@KRBTEST.COM
I20260805 22:49:32.731666 1397 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-1/data/instance:
uuid: "e07982be76624ba981d01df046efa39d"
format_stamp: "Formatted at 2026-08-05 22:49:32 on dist-test-slave-gjrz"
server_key: "84333d379299f2810bfb66745931a3ee"
server_key_iv: "fa52c7fecbd7243b654f65fcfa887ac5"
server_key_version: "kuduclusterkey@0"
I20260805 22:49:32.732281 1397 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-1/wal/instance:
uuid: "e07982be76624ba981d01df046efa39d"
format_stamp: "Formatted at 2026-08-05 22:49:32 on dist-test-slave-gjrz"
server_key: "84333d379299f2810bfb66745931a3ee"
server_key_iv: "fa52c7fecbd7243b654f65fcfa887ac5"
server_key_version: "kuduclusterkey@0"
I20260805 22:49:32.736681 1397 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.000s
I20260805 22:49:32.756773 1427 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:49:32.757057 1397 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.001s sys 0.000s
I20260805 22:49:32.757156 1397 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-1/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-1/wal
uuid: "e07982be76624ba981d01df046efa39d"
format_stamp: "Formatted at 2026-08-05 22:49:32 on dist-test-slave-gjrz"
server_key: "84333d379299f2810bfb66745931a3ee"
server_key_iv: "fa52c7fecbd7243b654f65fcfa887ac5"
server_key_version: "kuduclusterkey@0"
I20260805 22:49:32.757251 1397 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:49:32.789175 1397 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:49:32.791832 1397 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:49:32.792024 1397 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:49:32.792284 1397 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:49:32.792760 1397 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:49:32.792819 1397 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:49:32.792852 1397 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:49:32.792917 1397 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:49:32.800225 1397 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.130:46475
I20260805 22:49:32.800781 1397 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
I20260805 22:49:32.801601 1589 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.130:46475 every 8 connection(s)
I20260805 22:49:32.804229 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 1397
I20260805 22:49:32.804333 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-1/wal/instance
I20260805 22:49:32.804540 15234 external_mini_cluster.cc:1428] Setting key ae19171db8b3d8ab21d14c5e731b89c4
Aug 05 22:49:32 dist-test-slave-gjrz krb5kdc[350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970172, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.130@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:49:32.813942 1598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:32.801623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:46255 (local address 127.14.224.130:36503)
0805 22:49:32.801977 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:32.802023 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0805 22:49:32.802659 (+ 636us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:49:32.802968 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:49:32.802973 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:49:32.803228 (+ 255us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:49:32.803547 (+ 319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:32.803554 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:32.804626 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:32.804627 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:32.805943 (+ 1316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:32.805947 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:32.806555 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:32.806556 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:32.806708 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:32.807352 (+ 644us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:49:32.807363 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:49:32.809381 (+ 2018us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:49:32.811957 (+ 2576us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:49:32.811970 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:49:32.811973 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:49:32.812367 (+ 394us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:49:32.812636 (+ 269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:49:32.812637 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:49:32.812638 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:49:32.812803 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:49:32.813142 (+ 339us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:49:32.813150 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:49:32.813356 (+ 206us) client_negotiation.cc:769] Sending connection context
0805 22:49:32.813483 (+ 127us) client_negotiation.cc:240] Negotiation successful
0805 22:49:32.813674 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":308,"thread_start_us":88,"threads_started":1}
I20260805 22:49:32.814742 1388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:32.802297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:36503 (local address 127.14.224.190:46255)
0805 22:49:32.802346 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0805 22:49:32.802348 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:49:32.802359 (+ 11us) server_negotiation.cc:407] Connection header received
0805 22:49:32.802793 (+ 434us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:49:32.802794 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:49:32.802811 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:49:32.802883 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:49:32.803666 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:32.804499 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:32.806061 (+ 1562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:32.806400 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:32.806443 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:32.809503 (+ 3060us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:49:32.809505 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:49:32.809505 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:49:32.809515 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:49:32.811826 (+ 2311us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:32.812483 (+ 657us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:32.812485 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:32.812485 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:32.812559 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:32.812874 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:32.812874 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:32.812875 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:32.813049 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:49:32.813112 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0805 22:49:32.814530 (+ 1418us) server_negotiation.cc:299] Negotiation successful
0805 22:49:32.814643 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260805 22:49:32.815344 1590 heartbeater.cc:347] Connected to a master server at 127.14.224.190:46255
I20260805 22:49:32.815465 1590 heartbeater.cc:464] Registering TS with master...
I20260805 22:49:32.815680 1590 heartbeater.cc:511] Master 127.14.224.190:46255 requested a full tablet report, sending...
I20260805 22:49:32.816143 1060 ts_manager.cc:194] Registered new tserver with Master: e07982be76624ba981d01df046efa39d (127.14.224.130:46475)
I20260805 22:49:32.816650 1060 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.224.130@KRBTEST.COM'} at 127.14.224.130:36503
WARNING: no policy specified for kudu/127.14.224.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab.
Entry for principal kudu/127.14.224.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab.
I20260805 22:49:32.840855 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.14.224.148:34699/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.131:0
--local_ip_for_outbound_sockets=127.14.224.131
--webserver_interface=127.14.224.131
--webserver_port=0
--tserver_master_addrs=127.14.224.190:46255
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab
--principal=kudu/127.14.224.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:36303
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:49:32.955729 1604 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:49:32.956035 1604 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:49:32.956075 1604 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:49:32.957912 1604 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:49:32.958031 1604 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:49:32.958088 1604 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.131
I20260805 22:49:32.960600 1604 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:36303
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.14.224.148:34699/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab
--principal=kudu/127.14.224.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.224.131
--webserver_port=0
--tserver_master_addrs=127.14.224.190:46255
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1604
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.131
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:49:32.960875 1604 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:49:32.961210 1604 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:49:32.968078 1614 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:49:32.967981 1617 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:49:32.968304 1621 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:49:32.972769 1604 server_base.cc:1034] running on GCE node
I20260805 22:49:32.973095 1604 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:49:32.973475 1604 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:49:32.974655 1604 hybrid_clock.cc:648] HybridClock initialized: now 1785970172974634 us; error 46 us; skew 500 ppm
Aug 05 22:49:32 dist-test-slave-gjrz krb5kdc[350](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970172, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:49:32.978226 1604 init.cc:377] Logged in from keytab as kudu/127.14.224.131@KRBTEST.COM (short username kudu)
I20260805 22:49:32.978811 1604 webserver.cc:460] Webserver started at http://127.14.224.131:45813/ using document root <none> and password file <none>
I20260805 22:49:32.979146 1604 fs_manager.cc:359] Metadata directory not provided
I20260805 22:49:32.979223 1604 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:49:32.979430 1604 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 05 22:49:32 dist-test-slave-gjrz krb5kdc[350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970172, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.131@KRBTEST.COM for HTTP/127.14.224.148@KRBTEST.COM
I20260805 22:49:33.003461 1604 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-2/data/instance:
uuid: "1f809c7fca474b23898665591f8b7f50"
format_stamp: "Formatted at 2026-08-05 22:49:32 on dist-test-slave-gjrz"
server_key: "fed3cbcd5743dac5c1440c186d38ae99"
server_key_iv: "f95c2d101ea08e2f971eefadbc9cdcb1"
server_key_version: "kuduclusterkey@0"
I20260805 22:49:33.004007 1604 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-2/wal/instance:
uuid: "1f809c7fca474b23898665591f8b7f50"
format_stamp: "Formatted at 2026-08-05 22:49:32 on dist-test-slave-gjrz"
server_key: "fed3cbcd5743dac5c1440c186d38ae99"
server_key_iv: "f95c2d101ea08e2f971eefadbc9cdcb1"
server_key_version: "kuduclusterkey@0"
I20260805 22:49:33.007735 1604 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.000s
I20260805 22:49:33.022869 1629 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:49:33.023139 1604 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260805 22:49:33.023241 1604 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-2/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-2/wal
uuid: "1f809c7fca474b23898665591f8b7f50"
format_stamp: "Formatted at 2026-08-05 22:49:32 on dist-test-slave-gjrz"
server_key: "fed3cbcd5743dac5c1440c186d38ae99"
server_key_iv: "f95c2d101ea08e2f971eefadbc9cdcb1"
server_key_version: "kuduclusterkey@0"
I20260805 22:49:33.023458 1604 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:49:33.045993 1604 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:49:33.048635 1604 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:49:33.048868 1604 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:49:33.049168 1604 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:49:33.049618 1604 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:49:33.049707 1604 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:49:33.049778 1604 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:49:33.049834 1604 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:49:33.056524 1604 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.131:36837
I20260805 22:49:33.057099 1604 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
I20260805 22:49:33.060518 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 1604
I20260805 22:49:33.060631 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-2/wal/instance
I20260805 22:49:33.060834 15234 external_mini_cluster.cc:1428] Setting key d4f9e1e77d69f0efeb6e2632471284b3
I20260805 22:49:33.060117 1798 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.131:36837 every 8 connection(s)
Aug 05 22:49:33 dist-test-slave-gjrz krb5kdc[350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970172, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.131@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:49:33.072993 1388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:33.061099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:49695 (local address 127.14.224.190:46255)
0805 22:49:33.061148 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0805 22:49:33.061150 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:49:33.061520 (+ 370us) server_negotiation.cc:407] Connection header received
0805 22:49:33.062243 (+ 723us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:49:33.062244 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:49:33.062256 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:49:33.062321 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:49:33.063065 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:33.063844 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:33.065537 (+ 1693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:33.065856 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:33.065897 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:33.068773 (+ 2876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:49:33.068775 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:49:33.068775 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:49:33.068784 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:49:33.070546 (+ 1762us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:33.071092 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:33.071094 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:33.071095 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:33.071161 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:33.071536 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:33.071538 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:33.071538 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:33.071685 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:49:33.071728 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0805 22:49:33.072777 (+ 1049us) server_negotiation.cc:299] Negotiation successful
0805 22:49:33.072890 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260805 22:49:33.073839 1801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:33.060776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:46255 (local address 127.14.224.131:49695)
0805 22:49:33.061370 (+ 594us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:33.061434 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0805 22:49:33.062127 (+ 693us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:49:33.062407 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:49:33.062412 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:49:33.062667 (+ 255us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:49:33.062957 (+ 290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:33.062964 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:33.063992 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:33.063994 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:33.065321 (+ 1327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:33.065326 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:33.066083 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:33.066083 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:33.066236 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:33.066852 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:49:33.066863 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:49:33.068648 (+ 1785us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:49:33.070663 (+ 2015us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:49:33.070673 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:49:33.070676 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:49:33.071000 (+ 324us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:49:33.071230 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:49:33.071231 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:49:33.071231 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:49:33.071460 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:49:33.071771 (+ 311us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:49:33.071778 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:49:33.071958 (+ 180us) client_negotiation.cc:769] Sending connection context
0805 22:49:33.073369 (+ 1411us) client_negotiation.cc:240] Negotiation successful
0805 22:49:33.073581 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":548,"thread_start_us":102,"threads_started":1}
I20260805 22:49:33.074509 1799 heartbeater.cc:347] Connected to a master server at 127.14.224.190:46255
I20260805 22:49:33.074621 1799 heartbeater.cc:464] Registering TS with master...
I20260805 22:49:33.074832 1799 heartbeater.cc:511] Master 127.14.224.190:46255 requested a full tablet report, sending...
I20260805 22:49:33.075314 1060 ts_manager.cc:194] Registered new tserver with Master: 1f809c7fca474b23898665591f8b7f50 (127.14.224.131:36837)
I20260805 22:49:33.075839 1060 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.224.131@KRBTEST.COM'} at 127.14.224.131:49695
I20260805 22:49:33.083388 15234 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 22:49:33.084287 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 1179
I20260805 22:49:33.131598 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 1397
I20260805 22:49:33.144804 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 1604
Aug 05 22:49:33 dist-test-slave-gjrz krb5kdc[350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970172, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.190@KRBTEST.COM for HTTP/127.14.224.148@KRBTEST.COM
I20260805 22:49:33.182487 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 1019
I20260805 22:49:33.199375 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:46255
--webserver_interface=127.14.224.190
--webserver_port=45681
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:36303
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.224.190:46255
--ranger_config_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.14.224.148:34699/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.14.224.148:34699/kms with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:49:33.292042 1802 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:49:33.292287 1802 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:49:33.292321 1802 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:49:33.293619 1802 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:49:33.293679 1802 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:49:33.293699 1802 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:49:33.293715 1802 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:49:33.293730 1802 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:49:33.295578 1802 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:36303
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.14.224.148:34699/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.14.224.190:46255
--ranger_config_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:46255
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.224.190
--webserver_port=45681
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1802
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:49:33.295869 1802 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:49:33.296109 1802 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:49:33.301051 1809 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:49:33.301057 1808 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:49:33.301069 1813 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:49:33.301505 1802 server_base.cc:1034] running on GCE node
I20260805 22:49:33.301787 1802 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:49:33.302153 1802 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:49:33.303355 1802 hybrid_clock.cc:648] HybridClock initialized: now 1785970173303328 us; error 38 us; skew 500 ppm
Aug 05 22:49:33 dist-test-slave-gjrz krb5kdc[350](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970173, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:49:33.306612 1802 init.cc:377] Logged in from keytab as kudu/127.14.224.190@KRBTEST.COM (short username kudu)
I20260805 22:49:33.307199 1802 webserver.cc:460] Webserver started at http://127.14.224.190:45681/ using document root <none> and password file <none>
I20260805 22:49:33.307505 1802 fs_manager.cc:359] Metadata directory not provided
I20260805 22:49:33.307592 1802 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 05 22:49:33 dist-test-slave-gjrz krb5kdc[350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970173, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.190@KRBTEST.COM for HTTP/127.14.224.148@KRBTEST.COM
I20260805 22:49:33.376387 1802 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:49:33.377274 1826 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:49:33.377496 1802 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:49:33.377591 1802 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/master-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/master-0/wal
uuid: "e20e06ab9d4d48c69bcbf295c057623a"
format_stamp: "Formatted at 2026-08-05 22:49:31 on dist-test-slave-gjrz"
server_key: "3034a839de57a55ea4f9a4621f219442"
server_key_iv: "df5585fa5178673695dc4c5052bf8db5"
server_key_version: "kuduclusterkey@0"
I20260805 22:49:33.377980 1802 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:49:33.387705 1802 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:49:33.389626 1802 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:49:33.389745 1802 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:49:33.393900 1802 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.190:46255
I20260805 22:49:33.393985 1909 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.190:46255 every 8 connection(s)
I20260805 22:49:33.394343 1802 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
I20260805 22:49:33.395738 1911 sys_catalog.cc:263] Verifying existing consensus state
I20260805 22:49:33.396456 1911 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e20e06ab9d4d48c69bcbf295c057623a: Bootstrap starting.
I20260805 22:49:33.399849 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 1802
I20260805 22:49:33.400166 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.14.224.148:34699/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.129:40089
--local_ip_for_outbound_sockets=127.14.224.129
--tserver_master_addrs=127.14.224.190:46255
--webserver_port=38537
--webserver_interface=127.14.224.129
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab
--principal=kudu/127.14.224.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:36303
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.14.224.148:34699/kms with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 22:49:33.404552 1911 log.cc:824] T 00000000000000000000000000000000 P e20e06ab9d4d48c69bcbf295c057623a: Log is configured to *not* fsync() on all Append() calls
I20260805 22:49:33.406322 1911 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e20e06ab9d4d48c69bcbf295c057623a: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260805 22:49:33.406595 1911 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e20e06ab9d4d48c69bcbf295c057623a: Bootstrap complete.
I20260805 22:49:33.408890 1911 raft_consensus.cc:348] T 00000000000000000000000000000000 P e20e06ab9d4d48c69bcbf295c057623a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e20e06ab9d4d48c69bcbf295c057623a" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 46255 } }
I20260805 22:49:33.409152 1911 raft_consensus.cc:729] T 00000000000000000000000000000000 P e20e06ab9d4d48c69bcbf295c057623a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e20e06ab9d4d48c69bcbf295c057623a, State: Initialized, Role: FOLLOWER
I20260805 22:49:33.409322 1911 consensus_queue.cc:260] T 00000000000000000000000000000000 P e20e06ab9d4d48c69bcbf295c057623a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e20e06ab9d4d48c69bcbf295c057623a" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 46255 } }
I20260805 22:49:33.409399 1911 raft_consensus.cc:388] T 00000000000000000000000000000000 P e20e06ab9d4d48c69bcbf295c057623a [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:49:33.409449 1911 raft_consensus.cc:482] T 00000000000000000000000000000000 P e20e06ab9d4d48c69bcbf295c057623a [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:49:33.409497 1911 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e20e06ab9d4d48c69bcbf295c057623a [term 1 FOLLOWER]: Advancing to term 2
I20260805 22:49:33.410567 1911 raft_consensus.cc:504] T 00000000000000000000000000000000 P e20e06ab9d4d48c69bcbf295c057623a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e20e06ab9d4d48c69bcbf295c057623a" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 46255 } }
I20260805 22:49:33.410676 1911 leader_election.cc:302] T 00000000000000000000000000000000 P e20e06ab9d4d48c69bcbf295c057623a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e20e06ab9d4d48c69bcbf295c057623a; no voters:
I20260805 22:49:33.410856 1911 leader_election.cc:288] T 00000000000000000000000000000000 P e20e06ab9d4d48c69bcbf295c057623a [CANDIDATE]: Term 2 election: Requested vote from peers
I20260805 22:49:33.410907 1924 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e20e06ab9d4d48c69bcbf295c057623a [term 2 FOLLOWER]: Leader election won for term 2
I20260805 22:49:33.411125 1924 raft_consensus.cc:686] T 00000000000000000000000000000000 P e20e06ab9d4d48c69bcbf295c057623a [term 2 LEADER]: Becoming Leader. State: Replica: e20e06ab9d4d48c69bcbf295c057623a, State: Running, Role: LEADER
I20260805 22:49:33.411161 1911 sys_catalog.cc:564] T 00000000000000000000000000000000 P e20e06ab9d4d48c69bcbf295c057623a [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:49:33.411309 1924 consensus_queue.cc:237] T 00000000000000000000000000000000 P e20e06ab9d4d48c69bcbf295c057623a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e20e06ab9d4d48c69bcbf295c057623a" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 46255 } }
I20260805 22:49:33.411656 1925 sys_catalog.cc:455] T 00000000000000000000000000000000 P e20e06ab9d4d48c69bcbf295c057623a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "e20e06ab9d4d48c69bcbf295c057623a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e20e06ab9d4d48c69bcbf295c057623a" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 46255 } } }
I20260805 22:49:33.411736 1925 sys_catalog.cc:458] T 00000000000000000000000000000000 P e20e06ab9d4d48c69bcbf295c057623a [sys.catalog]: This master's current role is: LEADER
I20260805 22:49:33.411957 1926 sys_catalog.cc:455] T 00000000000000000000000000000000 P e20e06ab9d4d48c69bcbf295c057623a [sys.catalog]: SysCatalogTable state changed. Reason: New leader e20e06ab9d4d48c69bcbf295c057623a. Latest consensus state: current_term: 2 leader_uuid: "e20e06ab9d4d48c69bcbf295c057623a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e20e06ab9d4d48c69bcbf295c057623a" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 46255 } } }
I20260805 22:49:33.412078 1926 sys_catalog.cc:458] T 00000000000000000000000000000000 P e20e06ab9d4d48c69bcbf295c057623a [sys.catalog]: This master's current role is: LEADER
I20260805 22:49:33.412828 1911 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260805 22:49:33.414925 1931 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:49:33.415987 1931 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:49:33.416210 1931 catalog_manager.cc:1259] Loaded cluster ID: c918942e3cb34070a7f4f0b2b397802d
I20260805 22:49:33.416276 1931 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:49:33.417827 1931 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:49:33.418080 1931 catalog_manager.cc:5879] T 00000000000000000000000000000000 P e20e06ab9d4d48c69bcbf295c057623a: Loaded TSK: 0
I20260805 22:49:33.418326 1931 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260805 22:49:33.507699 1919 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:49:33.508050 1919 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:49:33.508109 1919 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:49:33.509388 1919 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:49:33.509435 1919 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:49:33.509474 1919 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.129
I20260805 22:49:33.511251 1919 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:36303
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.14.224.148:34699/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab
--principal=kudu/127.14.224.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.129:40089
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.224.129
--webserver_port=38537
--tserver_master_addrs=127.14.224.190:46255
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1919
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.129
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:49:33.511564 1919 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:49:33.511842 1919 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:49:33.517231 1969 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:49:33.517289 1966 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:49:33.517443 1965 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:49:33.517771 1919 server_base.cc:1034] running on GCE node
I20260805 22:49:33.517972 1919 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:49:33.518226 1919 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:49:33.519338 1919 hybrid_clock.cc:648] HybridClock initialized: now 1785970173519317 us; error 36 us; skew 500 ppm
Aug 05 22:49:33 dist-test-slave-gjrz krb5kdc[350](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970173, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:49:33.522004 1919 init.cc:377] Logged in from keytab as kudu/127.14.224.129@KRBTEST.COM (short username kudu)
I20260805 22:49:33.522480 1919 webserver.cc:460] Webserver started at http://127.14.224.129:38537/ using document root <none> and password file <none>
I20260805 22:49:33.522743 1919 fs_manager.cc:359] Metadata directory not provided
I20260805 22:49:33.522881 1919 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 05 22:49:33 dist-test-slave-gjrz krb5kdc[350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970173, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.129@KRBTEST.COM for HTTP/127.14.224.148@KRBTEST.COM
I20260805 22:49:33.555228 1919 fs_manager.cc:709] Time spent opening directory manager: real 0.008s user 0.001s sys 0.000s
I20260805 22:49:33.556535 1979 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:49:33.556761 1919 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:49:33.556856 1919 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-0/wal
uuid: "df2e713c09f946a087e77a1387d4b20e"
format_stamp: "Formatted at 2026-08-05 22:49:32 on dist-test-slave-gjrz"
server_key: "b0988a9dc95f4f1a4e13970b735a8730"
server_key_iv: "85e4143016ff383abb47cfa7dac9a7db"
server_key_version: "kuduclusterkey@0"
I20260805 22:49:33.557370 1919 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:49:33.585961 1919 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:49:33.588498 1919 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:49:33.588658 1919 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:49:33.588896 1919 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:49:33.589279 1919 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:49:33.589318 1919 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:49:33.589349 1919 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:49:33.589388 1919 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:49:33.596437 1919 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.129:40089
I20260805 22:49:33.596522 2161 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.129:40089 every 8 connection(s)
I20260805 22:49:33.596885 1919 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
I20260805 22:49:33.598688 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 1919
I20260805 22:49:33.599005 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.14.224.148:34699/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.130:46475
--local_ip_for_outbound_sockets=127.14.224.130
--tserver_master_addrs=127.14.224.190:46255
--webserver_port=40625
--webserver_interface=127.14.224.130
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab
--principal=kudu/127.14.224.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:36303
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.14.224.148:34699/kms with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 05 22:49:33 dist-test-slave-gjrz krb5kdc[350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970173, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.129@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:49:33.609019 2167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:33.597725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:46255 (local address 127.14.224.129:53201)
0805 22:49:33.597918 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:33.597971 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0805 22:49:33.598479 (+ 508us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:49:33.599050 (+ 571us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:49:33.599055 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:49:33.599321 (+ 266us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:49:33.599625 (+ 304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:33.599633 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:33.601342 (+ 1709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:33.601344 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:33.602412 (+ 1068us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:33.602417 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:33.603076 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:33.603078 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:33.603208 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:33.603793 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:49:33.603803 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:49:33.605203 (+ 1400us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:49:33.607119 (+ 1916us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:49:33.607129 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:49:33.607132 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:49:33.607506 (+ 374us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:49:33.607802 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:49:33.607803 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:49:33.607804 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:49:33.607922 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:49:33.608339 (+ 417us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:49:33.608347 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:49:33.608479 (+ 132us) client_negotiation.cc:769] Sending connection context
0805 22:49:33.608574 (+ 95us) client_negotiation.cc:240] Negotiation successful
0805 22:49:33.608763 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":91,"threads_started":1}
I20260805 22:49:33.609005 2169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:33.597804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.129:53201 (local address 127.14.224.190:46255)
0805 22:49:33.598063 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0805 22:49:33.598073 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:49:33.598121 (+ 48us) server_negotiation.cc:407] Connection header received
0805 22:49:33.598754 (+ 633us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:49:33.598763 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:49:33.598830 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:49:33.598986 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:49:33.599781 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:33.601202 (+ 1421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:33.602516 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:33.602949 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:33.603058 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:33.605334 (+ 2276us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:49:33.605340 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:49:33.605340 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:49:33.605353 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:49:33.607006 (+ 1653us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:33.607621 (+ 615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:33.607625 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:33.607625 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:33.607736 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:33.607992 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:33.607993 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:33.607993 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:33.608271 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:49:33.608348 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0805 22:49:33.608695 (+ 347us) server_negotiation.cc:299] Negotiation successful
0805 22:49:33.608817 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":189,"thread_start_us":93,"threads_started":1}
I20260805 22:49:33.610266 2162 heartbeater.cc:347] Connected to a master server at 127.14.224.190:46255
I20260805 22:49:33.610375 2162 heartbeater.cc:464] Registering TS with master...
I20260805 22:49:33.610590 2162 heartbeater.cc:511] Master 127.14.224.190:46255 requested a full tablet report, sending...
W20260805 22:49:33.611774 2162 heartbeater.cc:644] Failed to heartbeat to 127.14.224.190:46255 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260805 22:49:33.611855 2162 heartbeater.cc:464] Registering TS with master...
I20260805 22:49:33.611927 2162 heartbeater.cc:511] Master 127.14.224.190:46255 requested a full tablet report, sending...
I20260805 22:49:33.613687 2162 heartbeater.cc:464] Registering TS with master...
I20260805 22:49:33.613781 2162 heartbeater.cc:511] Master 127.14.224.190:46255 requested a full tablet report, sending...
W20260805 22:49:33.614084 2162 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260805 22:49:33.723942 2171 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:49:33.724347 2171 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:49:33.724439 2171 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:49:33.726619 2171 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:49:33.726752 2171 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:49:33.726840 2171 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.130
I20260805 22:49:33.729029 2171 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:36303
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.14.224.148:34699/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab
--principal=kudu/127.14.224.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.130:46475
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.224.130
--webserver_port=40625
--tserver_master_addrs=127.14.224.190:46255
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2171
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.130
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:49:33.729295 2171 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:49:33.729544 2171 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:49:33.736006 2183 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:49:33.736022 2177 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:49:33.736155 2179 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:49:33.736478 2171 server_base.cc:1034] running on GCE node
I20260805 22:49:33.736830 2171 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:49:33.737167 2171 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:49:33.738390 2171 hybrid_clock.cc:648] HybridClock initialized: now 1785970173738361 us; error 39 us; skew 500 ppm
Aug 05 22:49:33 dist-test-slave-gjrz krb5kdc[350](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970173, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:49:33.741698 2171 init.cc:377] Logged in from keytab as kudu/127.14.224.130@KRBTEST.COM (short username kudu)
I20260805 22:49:33.742370 2171 webserver.cc:460] Webserver started at http://127.14.224.130:40625/ using document root <none> and password file <none>
I20260805 22:49:33.742687 2171 fs_manager.cc:359] Metadata directory not provided
I20260805 22:49:33.742769 2171 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 05 22:49:33 dist-test-slave-gjrz krb5kdc[350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970173, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.130@KRBTEST.COM for HTTP/127.14.224.148@KRBTEST.COM
I20260805 22:49:33.762784 2171 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:49:33.763717 2192 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:49:33.763916 2171 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:49:33.764015 2171 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-1/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-1/wal
uuid: "e07982be76624ba981d01df046efa39d"
format_stamp: "Formatted at 2026-08-05 22:49:32 on dist-test-slave-gjrz"
server_key: "84333d379299f2810bfb66745931a3ee"
server_key_iv: "fa52c7fecbd7243b654f65fcfa887ac5"
server_key_version: "kuduclusterkey@0"
I20260805 22:49:33.764415 2171 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:49:33.782699 2171 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:49:33.785291 2171 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:49:33.785449 2171 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:49:33.785709 2171 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:49:33.786073 2171 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:49:33.786173 2171 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:49:33.786239 2171 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:49:33.786284 2171 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:49:33.793433 2171 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.130:46475
I20260805 22:49:33.793617 2365 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.130:46475 every 8 connection(s)
I20260805 22:49:33.793922 2171 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
I20260805 22:49:33.797119 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 2171
I20260805 22:49:33.797428 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.14.224.148:34699/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.131:36837
--local_ip_for_outbound_sockets=127.14.224.131
--tserver_master_addrs=127.14.224.190:46255
--webserver_port=45813
--webserver_interface=127.14.224.131
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab
--principal=kudu/127.14.224.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:36303
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.14.224.148:34699/kms with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 05 22:49:33 dist-test-slave-gjrz krb5kdc[350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970173, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.130@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:49:33.805459 2370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:33.794786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:46255 (local address 127.14.224.130:35453)
0805 22:49:33.794988 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:33.795145 (+ 157us) client_negotiation.cc:174] Beginning negotiation
0805 22:49:33.795872 (+ 727us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:49:33.796187 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:49:33.796192 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:49:33.796456 (+ 264us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:49:33.796773 (+ 317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:33.796781 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:33.797759 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:33.797759 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:33.798916 (+ 1157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:33.798931 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:33.799514 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:33.799514 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:33.799625 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:33.800161 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:49:33.800170 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:49:33.801546 (+ 1376us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:49:33.803546 (+ 2000us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:49:33.803554 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:49:33.803557 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:49:33.803912 (+ 355us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:49:33.804147 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:49:33.804148 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:49:33.804148 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:49:33.804317 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:49:33.804684 (+ 367us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:49:33.804692 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:49:33.804881 (+ 189us) client_negotiation.cc:769] Sending connection context
0805 22:49:33.804998 (+ 117us) client_negotiation.cc:240] Negotiation successful
0805 22:49:33.805182 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":83,"threads_started":1}
I20260805 22:49:33.806010 2169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:33.795069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:35453 (local address 127.14.224.190:46255)
0805 22:49:33.795144 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0805 22:49:33.795146 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:49:33.795233 (+ 87us) server_negotiation.cc:407] Connection header received
0805 22:49:33.796019 (+ 786us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:49:33.796020 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:49:33.796034 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:49:33.796093 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:49:33.796910 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:33.797642 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:33.799041 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:33.799359 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:33.799401 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:33.801643 (+ 2242us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:49:33.801645 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:49:33.801646 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:49:33.801654 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:49:33.803362 (+ 1708us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:33.804005 (+ 643us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:33.804006 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:33.804006 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:33.804075 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:33.804418 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:33.804431 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:33.804432 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:33.804587 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:49:33.804653 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0805 22:49:33.805815 (+ 1162us) server_negotiation.cc:299] Negotiation successful
0805 22:49:33.805916 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260805 22:49:33.806839 2366 heartbeater.cc:347] Connected to a master server at 127.14.224.190:46255
I20260805 22:49:33.806977 2366 heartbeater.cc:464] Registering TS with master...
I20260805 22:49:33.807214 2366 heartbeater.cc:511] Master 127.14.224.190:46255 requested a full tablet report, sending...
W20260805 22:49:33.807991 2366 heartbeater.cc:644] Failed to heartbeat to 127.14.224.190:46255 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260805 22:49:33.808069 2366 heartbeater.cc:464] Registering TS with master...
I20260805 22:49:33.808142 2366 heartbeater.cc:511] Master 127.14.224.190:46255 requested a full tablet report, sending...
I20260805 22:49:33.808588 2366 heartbeater.cc:464] Registering TS with master...
I20260805 22:49:33.808668 2366 heartbeater.cc:511] Master 127.14.224.190:46255 requested a full tablet report, sending...
W20260805 22:49:33.809064 2366 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260805 22:49:33.902874 2371 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:49:33.903100 2371 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:49:33.903134 2371 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:49:33.904564 2371 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:49:33.904631 2371 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:49:33.904670 2371 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.131
I20260805 22:49:33.906558 2371 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:36303
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.14.224.148:34699/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab
--principal=kudu/127.14.224.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.131:36837
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.224.131
--webserver_port=45813
--tserver_master_addrs=127.14.224.190:46255
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2371
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.131
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:49:33.906840 2371 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:49:33.907089 2371 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:49:33.913255 2384 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:49:33.913283 2387 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:49:33.913739 2371 server_base.cc:1034] running on GCE node
W20260805 22:49:33.913789 2383 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:49:33.913977 2371 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:49:33.914237 2371 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:49:33.921551 2371 hybrid_clock.cc:648] HybridClock initialized: now 1785970173921522 us; error 41 us; skew 500 ppm
Aug 05 22:49:33 dist-test-slave-gjrz krb5kdc[350](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970173, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:49:33.924765 2371 init.cc:377] Logged in from keytab as kudu/127.14.224.131@KRBTEST.COM (short username kudu)
I20260805 22:49:33.925365 2371 webserver.cc:460] Webserver started at http://127.14.224.131:45813/ using document root <none> and password file <none>
I20260805 22:49:33.925680 2371 fs_manager.cc:359] Metadata directory not provided
I20260805 22:49:33.925760 2371 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 05 22:49:33 dist-test-slave-gjrz krb5kdc[350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970173, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.131@KRBTEST.COM for HTTP/127.14.224.148@KRBTEST.COM
I20260805 22:49:33.941742 2371 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:49:33.942749 2399 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:49:33.942941 2371 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:49:33.943048 2371 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-2/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-2/wal
uuid: "1f809c7fca474b23898665591f8b7f50"
format_stamp: "Formatted at 2026-08-05 22:49:32 on dist-test-slave-gjrz"
server_key: "fed3cbcd5743dac5c1440c186d38ae99"
server_key_iv: "f95c2d101ea08e2f971eefadbc9cdcb1"
server_key_version: "kuduclusterkey@0"
I20260805 22:49:33.943568 2371 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:49:33.987968 2371 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:49:33.991286 2371 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:49:33.991513 2371 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:49:33.991822 2371 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:49:33.992293 2371 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:49:33.992393 2371 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:49:33.992471 2371 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:49:33.992533 2371 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:49:33.999855 2371 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.131:36837
I20260805 22:49:33.999954 2579 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.131:36837 every 8 connection(s)
I20260805 22:49:34.000348 2371 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
I20260805 22:49:34.007361 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 2371
Aug 05 22:49:34 dist-test-slave-gjrz krb5kdc[350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970173, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.131@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:49:34.011868 2169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:34.001198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:52447 (local address 127.14.224.190:46255)
0805 22:49:34.001249 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0805 22:49:34.001251 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:49:34.001519 (+ 268us) server_negotiation.cc:407] Connection header received
0805 22:49:34.002267 (+ 748us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:49:34.002269 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:49:34.002284 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:49:34.002317 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:49:34.003199 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:34.004004 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:34.005172 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:34.005377 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:34.005565 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:34.008577 (+ 3012us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:49:34.008579 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:49:34.008579 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:49:34.008588 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:49:34.010163 (+ 1575us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:34.010585 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:34.010587 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:34.010587 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:34.010645 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:34.011023 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:34.011024 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:34.011025 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:34.011211 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:49:34.011253 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0805 22:49:34.011658 (+ 405us) server_negotiation.cc:299] Negotiation successful
0805 22:49:34.011772 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260805 22:49:34.012094 2583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:34.001196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:46255 (local address 127.14.224.131:52447)
0805 22:49:34.001375 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:34.001427 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0805 22:49:34.002112 (+ 685us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:49:34.002514 (+ 402us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:49:34.002519 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:49:34.002764 (+ 245us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:49:34.003078 (+ 314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:34.003085 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:34.004249 (+ 1164us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:34.004249 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:34.005073 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:34.005075 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:34.005589 (+ 514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:34.005590 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:34.005751 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:34.006570 (+ 819us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:49:34.006582 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:49:34.008460 (+ 1878us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:49:34.010243 (+ 1783us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:49:34.010253 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:49:34.010256 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:49:34.010512 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:49:34.010735 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:49:34.010736 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:49:34.010736 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:49:34.010945 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:49:34.011327 (+ 382us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:49:34.011335 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:49:34.011527 (+ 192us) client_negotiation.cc:769] Sending connection context
0805 22:49:34.011628 (+ 101us) client_negotiation.cc:240] Negotiation successful
0805 22:49:34.011839 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":90,"threads_started":1}
I20260805 22:49:34.012617 2580 heartbeater.cc:347] Connected to a master server at 127.14.224.190:46255
I20260805 22:49:34.012780 2580 heartbeater.cc:464] Registering TS with master...
I20260805 22:49:34.013053 2580 heartbeater.cc:511] Master 127.14.224.190:46255 requested a full tablet report, sending...
W20260805 22:49:34.013813 2580 heartbeater.cc:644] Failed to heartbeat to 127.14.224.190:46255 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260805 22:49:34.013954 2580 heartbeater.cc:464] Registering TS with master...
I20260805 22:49:34.014067 2580 heartbeater.cc:511] Master 127.14.224.190:46255 requested a full tablet report, sending...
I20260805 22:49:34.014438 2580 heartbeater.cc:464] Registering TS with master...
I20260805 22:49:34.014547 2580 heartbeater.cc:511] Master 127.14.224.190:46255 requested a full tablet report, sending...
W20260805 22:49:34.015599 2580 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260805 22:49:34.019642 2586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:34.008053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50840 (local address 127.14.224.190:46255)
0805 22:49:34.008198 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0805 22:49:34.008200 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:49:34.008208 (+ 8us) server_negotiation.cc:407] Connection header received
0805 22:49:34.008233 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:49:34.008233 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:49:34.008246 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:49:34.009047 (+ 801us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:49:34.009088 (+ 41us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:34.009821 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:34.010908 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:34.011200 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:34.011284 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:34.012816 (+ 1532us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:49:34.012847 (+ 31us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:49:34.012848 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:49:34.012857 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:49:34.015473 (+ 2616us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:34.018576 (+ 3103us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:34.018578 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:34.018578 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:34.018673 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:34.018954 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:34.018955 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:34.018955 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:34.019114 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:49:34.019340 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0805 22:49:34.019413 (+ 73us) server_negotiation.cc:299] Negotiation successful
0805 22:49:34.019535 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":102,"threads_started":1}
Aug 05 22:49:34 dist-test-slave-gjrz krb5kdc[350](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1785970174, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:49:34.614274 2162 heartbeater.cc:464] Registering TS with master...
I20260805 22:49:34.614452 2162 heartbeater.cc:511] Master 127.14.224.190:46255 requested a full tablet report, sending...
I20260805 22:49:34.614931 1851 ts_manager.cc:194] Registered new tserver with Master: df2e713c09f946a087e77a1387d4b20e (127.14.224.129:40089)
I20260805 22:49:34.615983 1851 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.224.129@KRBTEST.COM'} at 127.14.224.129:53201
I20260805 22:49:34.809278 2366 heartbeater.cc:464] Registering TS with master...
I20260805 22:49:34.809474 2366 heartbeater.cc:511] Master 127.14.224.190:46255 requested a full tablet report, sending...
I20260805 22:49:34.809896 1851 ts_manager.cc:194] Registered new tserver with Master: e07982be76624ba981d01df046efa39d (127.14.224.130:46475)
I20260805 22:49:34.810416 1851 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.224.130@KRBTEST.COM'} at 127.14.224.130:35453
Aug 05 22:49:34 dist-test-slave-gjrz krb5kdc[350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970174, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.190@KRBTEST.COM for HTTP/127.14.224.148@KRBTEST.COM
I20260805 22:49:35.015873 2580 heartbeater.cc:464] Registering TS with master...
I20260805 22:49:35.016075 2580 heartbeater.cc:511] Master 127.14.224.190:46255 requested a full tablet report, sending...
I20260805 22:49:35.016444 1851 ts_manager.cc:194] Registered new tserver with Master: 1f809c7fca474b23898665591f8b7f50 (127.14.224.131:36837)
I20260805 22:49:35.016827 1851 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.224.131@KRBTEST.COM'} at 127.14.224.131:52447
I20260805 22:49:35.018129 15234 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 22:49:35.025194 2610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:35.019079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50852 (local address 127.14.224.190:46255)
0805 22:49:35.019224 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0805 22:49:35.019226 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:49:35.019234 (+ 8us) server_negotiation.cc:407] Connection header received
0805 22:49:35.019281 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:49:35.019282 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:49:35.019293 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:49:35.019353 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:49:35.019902 (+ 549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:35.020405 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:35.021118 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:35.021329 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:35.021384 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:35.022564 (+ 1180us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:49:35.022566 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:49:35.022566 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:49:35.022574 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:49:35.024035 (+ 1461us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:35.024358 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:35.024360 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:35.024360 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:35.024431 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:35.024603 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:35.024604 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:35.024604 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:35.024719 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:49:35.024809 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0805 22:49:35.024911 (+ 102us) server_negotiation.cc:299] Negotiation successful
0805 22:49:35.025001 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":93,"threads_started":1}
I20260805 22:49:35.027072 1851 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50852:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:49:35.028825 1851 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:49:35.035241 2625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:35.031458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.130:46475 (local address 127.0.0.1:52300)
0805 22:49:35.032131 (+ 673us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:35.032171 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0805 22:49:35.032238 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:49:35.032464 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:49:35.032467 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:49:35.032469 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:49:35.032548 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:35.032551 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:35.033376 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:35.033377 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:35.034282 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:35.034285 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:35.034941 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:35.034942 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:35.035023 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:35.035037 (+ 14us) client_negotiation.cc:769] Sending connection context
0805 22:49:35.035103 (+ 66us) client_negotiation.cc:240] Negotiation successful
0805 22:49:35.035160 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":642,"thread_start_us":97,"threads_started":1}
I20260805 22:49:35.035248 2621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:35.031743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52300 (local address 127.14.224.130:46475)
0805 22:49:35.031874 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0805 22:49:35.031879 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:49:35.032319 (+ 440us) server_negotiation.cc:407] Connection header received
0805 22:49:35.032361 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:49:35.032364 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:49:35.032380 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:49:35.032459 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:49:35.032628 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:35.033293 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:35.034345 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:35.034854 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:35.034938 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:35.035002 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0805 22:49:35.035127 (+ 125us) server_negotiation.cc:299] Negotiation successful
0805 22:49:35.035172 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97,"thread_start_us":59,"threads_started":1}
I20260805 22:49:35.036615 2259 tablet_service.cc:1467] Processing CreateTablet for tablet 5f95924338354ff8a232840fe6b5f1e6 (DEFAULT_TABLE table=test-table [id=1a1f096e6cf44ceda3d4ff945b15f638]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:49:35.036981 2259 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f95924338354ff8a232840fe6b5f1e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:49:35.043125 2625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:35.031459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.131:36837 (local address 127.0.0.1:37260)
0805 22:49:35.035902 (+ 4443us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:35.035915 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0805 22:49:35.035962 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:49:35.039411 (+ 3449us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:49:35.039413 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:49:35.039414 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:49:35.039466 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:35.039468 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:35.040696 (+ 1228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:35.040697 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:35.041834 (+ 1137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:35.041836 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:35.042882 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:35.042883 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:35.042948 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:35.042952 (+ 4us) client_negotiation.cc:769] Sending connection context
0805 22:49:35.042997 (+ 45us) client_negotiation.cc:240] Negotiation successful
0805 22:49:35.043040 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4431,"mutex_wait_us":2,"thread_start_us":97,"threads_started":1}
I20260805 22:49:35.043764 2623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:35.031758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37260 (local address 127.14.224.131:36837)
0805 22:49:35.039162 (+ 7404us) server_negotiation.cc:206] Beginning negotiation
0805 22:49:35.039167 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:49:35.039177 (+ 10us) server_negotiation.cc:407] Connection header received
0805 22:49:35.039213 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:49:35.039215 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:49:35.039231 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:49:35.039323 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:49:35.039542 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:35.040596 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:35.041951 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:35.042719 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:35.042794 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:35.042848 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0805 22:49:35.043637 (+ 789us) server_negotiation.cc:299] Negotiation successful
0805 22:49:35.043681 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7362,"thread_start_us":71,"threads_started":1}
I20260805 22:49:35.044440 2618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:35.031957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.129:40089 (local address 127.0.0.1:49864)
0805 22:49:35.038943 (+ 6986us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:35.038957 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0805 22:49:35.039026 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:49:35.040735 (+ 1709us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:49:35.040736 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:49:35.040738 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:49:35.040784 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:35.040786 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:35.042007 (+ 1221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:35.042008 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:35.043100 (+ 1092us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:35.043104 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:35.044185 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:35.044186 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:35.044255 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:35.044259 (+ 4us) client_negotiation.cc:769] Sending connection context
0805 22:49:35.044308 (+ 49us) client_negotiation.cc:240] Negotiation successful
0805 22:49:35.044349 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6964,"thread_start_us":70,"threads_started":1}
I20260805 22:49:35.044564 2475 tablet_service.cc:1467] Processing CreateTablet for tablet 5f95924338354ff8a232840fe6b5f1e6 (DEFAULT_TABLE table=test-table [id=1a1f096e6cf44ceda3d4ff945b15f638]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:49:35.044785 2626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:35.032060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49864 (local address 127.14.224.129:40089)
0805 22:49:35.032587 (+ 527us) server_negotiation.cc:206] Beginning negotiation
0805 22:49:35.032591 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:49:35.040460 (+ 7869us) server_negotiation.cc:407] Connection header received
0805 22:49:35.040506 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:49:35.040508 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:49:35.040526 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:49:35.040603 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:49:35.040868 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:35.041903 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:35.043206 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:35.044012 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:35.044090 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:35.044145 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0805 22:49:35.044661 (+ 516us) server_negotiation.cc:299] Negotiation successful
0805 22:49:35.044704 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":496,"thread_start_us":69,"threads_started":1}
I20260805 22:49:35.044919 2475 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f95924338354ff8a232840fe6b5f1e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:49:35.045266 2629 tablet_bootstrap.cc:492] T 5f95924338354ff8a232840fe6b5f1e6 P e07982be76624ba981d01df046efa39d: Bootstrap starting.
I20260805 22:49:35.045591 2049 tablet_service.cc:1467] Processing CreateTablet for tablet 5f95924338354ff8a232840fe6b5f1e6 (DEFAULT_TABLE table=test-table [id=1a1f096e6cf44ceda3d4ff945b15f638]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:49:35.045926 2049 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f95924338354ff8a232840fe6b5f1e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:49:35.045991 2629 tablet_bootstrap.cc:654] T 5f95924338354ff8a232840fe6b5f1e6 P e07982be76624ba981d01df046efa39d: Neither blocks nor log segments found. Creating new log.
I20260805 22:49:35.046325 2629 log.cc:824] T 5f95924338354ff8a232840fe6b5f1e6 P e07982be76624ba981d01df046efa39d: Log is configured to *not* fsync() on all Append() calls
I20260805 22:49:35.047142 2629 tablet_bootstrap.cc:492] T 5f95924338354ff8a232840fe6b5f1e6 P e07982be76624ba981d01df046efa39d: No bootstrap required, opened a new log
I20260805 22:49:35.047207 2629 ts_tablet_manager.cc:1397] T 5f95924338354ff8a232840fe6b5f1e6 P e07982be76624ba981d01df046efa39d: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260805 22:49:35.049116 2632 tablet_bootstrap.cc:492] T 5f95924338354ff8a232840fe6b5f1e6 P 1f809c7fca474b23898665591f8b7f50: Bootstrap starting.
I20260805 22:49:35.049837 2632 tablet_bootstrap.cc:654] T 5f95924338354ff8a232840fe6b5f1e6 P 1f809c7fca474b23898665591f8b7f50: Neither blocks nor log segments found. Creating new log.
I20260805 22:49:35.049861 2629 raft_consensus.cc:348] T 5f95924338354ff8a232840fe6b5f1e6 P e07982be76624ba981d01df046efa39d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f809c7fca474b23898665591f8b7f50" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 36837 } } peers { permanent_uuid: "df2e713c09f946a087e77a1387d4b20e" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 40089 } } peers { permanent_uuid: "e07982be76624ba981d01df046efa39d" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 46475 } }
I20260805 22:49:35.050202 2632 log.cc:824] T 5f95924338354ff8a232840fe6b5f1e6 P 1f809c7fca474b23898665591f8b7f50: Log is configured to *not* fsync() on all Append() calls
I20260805 22:49:35.050338 2629 raft_consensus.cc:374] T 5f95924338354ff8a232840fe6b5f1e6 P e07982be76624ba981d01df046efa39d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:49:35.050495 2629 raft_consensus.cc:729] T 5f95924338354ff8a232840fe6b5f1e6 P e07982be76624ba981d01df046efa39d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e07982be76624ba981d01df046efa39d, State: Initialized, Role: FOLLOWER
I20260805 22:49:35.050616 2634 tablet_bootstrap.cc:492] T 5f95924338354ff8a232840fe6b5f1e6 P df2e713c09f946a087e77a1387d4b20e: Bootstrap starting.
I20260805 22:49:35.050729 2629 consensus_queue.cc:260] T 5f95924338354ff8a232840fe6b5f1e6 P e07982be76624ba981d01df046efa39d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f809c7fca474b23898665591f8b7f50" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 36837 } } peers { permanent_uuid: "df2e713c09f946a087e77a1387d4b20e" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 40089 } } peers { permanent_uuid: "e07982be76624ba981d01df046efa39d" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 46475 } }
I20260805 22:49:35.051127 2629 ts_tablet_manager.cc:1428] T 5f95924338354ff8a232840fe6b5f1e6 P e07982be76624ba981d01df046efa39d: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20260805 22:49:35.051314 2634 tablet_bootstrap.cc:654] T 5f95924338354ff8a232840fe6b5f1e6 P df2e713c09f946a087e77a1387d4b20e: Neither blocks nor log segments found. Creating new log.
I20260805 22:49:35.051412 2366 heartbeater.cc:503] Master 127.14.224.190:46255 was elected leader, sending a full tablet report...
I20260805 22:49:35.051782 2634 log.cc:824] T 5f95924338354ff8a232840fe6b5f1e6 P df2e713c09f946a087e77a1387d4b20e: Log is configured to *not* fsync() on all Append() calls
I20260805 22:49:35.052591 2632 tablet_bootstrap.cc:492] T 5f95924338354ff8a232840fe6b5f1e6 P 1f809c7fca474b23898665591f8b7f50: No bootstrap required, opened a new log
I20260805 22:49:35.052747 2632 ts_tablet_manager.cc:1397] T 5f95924338354ff8a232840fe6b5f1e6 P 1f809c7fca474b23898665591f8b7f50: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260805 22:49:35.055332 2632 raft_consensus.cc:348] T 5f95924338354ff8a232840fe6b5f1e6 P 1f809c7fca474b23898665591f8b7f50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f809c7fca474b23898665591f8b7f50" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 36837 } } peers { permanent_uuid: "df2e713c09f946a087e77a1387d4b20e" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 40089 } } peers { permanent_uuid: "e07982be76624ba981d01df046efa39d" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 46475 } }
I20260805 22:49:35.055540 2632 raft_consensus.cc:374] T 5f95924338354ff8a232840fe6b5f1e6 P 1f809c7fca474b23898665591f8b7f50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:49:35.055577 2632 raft_consensus.cc:729] T 5f95924338354ff8a232840fe6b5f1e6 P 1f809c7fca474b23898665591f8b7f50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f809c7fca474b23898665591f8b7f50, State: Initialized, Role: FOLLOWER
I20260805 22:49:35.055757 2632 consensus_queue.cc:260] T 5f95924338354ff8a232840fe6b5f1e6 P 1f809c7fca474b23898665591f8b7f50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f809c7fca474b23898665591f8b7f50" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 36837 } } peers { permanent_uuid: "df2e713c09f946a087e77a1387d4b20e" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 40089 } } peers { permanent_uuid: "e07982be76624ba981d01df046efa39d" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 46475 } }
I20260805 22:49:35.056049 2632 ts_tablet_manager.cc:1428] T 5f95924338354ff8a232840fe6b5f1e6 P 1f809c7fca474b23898665591f8b7f50: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260805 22:49:35.056083 2580 heartbeater.cc:503] Master 127.14.224.190:46255 was elected leader, sending a full tablet report...
I20260805 22:49:35.057588 2634 tablet_bootstrap.cc:492] T 5f95924338354ff8a232840fe6b5f1e6 P df2e713c09f946a087e77a1387d4b20e: No bootstrap required, opened a new log
I20260805 22:49:35.057684 2634 ts_tablet_manager.cc:1397] T 5f95924338354ff8a232840fe6b5f1e6 P df2e713c09f946a087e77a1387d4b20e: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.001s
I20260805 22:49:35.060563 2634 raft_consensus.cc:348] T 5f95924338354ff8a232840fe6b5f1e6 P df2e713c09f946a087e77a1387d4b20e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f809c7fca474b23898665591f8b7f50" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 36837 } } peers { permanent_uuid: "df2e713c09f946a087e77a1387d4b20e" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 40089 } } peers { permanent_uuid: "e07982be76624ba981d01df046efa39d" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 46475 } }
I20260805 22:49:35.060822 2634 raft_consensus.cc:374] T 5f95924338354ff8a232840fe6b5f1e6 P df2e713c09f946a087e77a1387d4b20e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:49:35.060923 2634 raft_consensus.cc:729] T 5f95924338354ff8a232840fe6b5f1e6 P df2e713c09f946a087e77a1387d4b20e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df2e713c09f946a087e77a1387d4b20e, State: Initialized, Role: FOLLOWER
I20260805 22:49:35.061115 2634 consensus_queue.cc:260] T 5f95924338354ff8a232840fe6b5f1e6 P df2e713c09f946a087e77a1387d4b20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f809c7fca474b23898665591f8b7f50" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 36837 } } peers { permanent_uuid: "df2e713c09f946a087e77a1387d4b20e" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 40089 } } peers { permanent_uuid: "e07982be76624ba981d01df046efa39d" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 46475 } }
I20260805 22:49:35.061542 2634 ts_tablet_manager.cc:1428] T 5f95924338354ff8a232840fe6b5f1e6 P df2e713c09f946a087e77a1387d4b20e: Time spent starting tablet: real 0.004s user 0.003s sys 0.001s
I20260805 22:49:35.061581 2162 heartbeater.cc:503] Master 127.14.224.190:46255 was elected leader, sending a full tablet report...
W20260805 22:49:35.098282 2163 tablet.cc:2369] T 5f95924338354ff8a232840fe6b5f1e6 P df2e713c09f946a087e77a1387d4b20e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:49:35.114135 2640 raft_consensus.cc:482] T 5f95924338354ff8a232840fe6b5f1e6 P 1f809c7fca474b23898665591f8b7f50 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:49:35.114302 2640 raft_consensus.cc:504] T 5f95924338354ff8a232840fe6b5f1e6 P 1f809c7fca474b23898665591f8b7f50 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f809c7fca474b23898665591f8b7f50" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 36837 } } peers { permanent_uuid: "df2e713c09f946a087e77a1387d4b20e" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 40089 } } peers { permanent_uuid: "e07982be76624ba981d01df046efa39d" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 46475 } }
I20260805 22:49:35.115064 2640 leader_election.cc:288] T 5f95924338354ff8a232840fe6b5f1e6 P 1f809c7fca474b23898665591f8b7f50 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df2e713c09f946a087e77a1387d4b20e (127.14.224.129:40089), e07982be76624ba981d01df046efa39d (127.14.224.130:46475)
I20260805 22:49:35.118788 2626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:35.115162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:40809 (local address 127.14.224.129:40089)
0805 22:49:35.115212 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0805 22:49:35.115214 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:49:35.115299 (+ 85us) server_negotiation.cc:407] Connection header received
0805 22:49:35.115426 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:49:35.115427 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:49:35.115436 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:49:35.115492 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:49:35.115722 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:35.116447 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:35.117858 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:35.118402 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:35.118449 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:35.118458 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0805 22:49:35.118671 (+ 213us) server_negotiation.cc:299] Negotiation successful
0805 22:49:35.118713 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260805 22:49:35.119278 2621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:35.115343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:50391 (local address 127.14.224.130:46475)
0805 22:49:35.115388 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0805 22:49:35.115390 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:49:35.115483 (+ 93us) server_negotiation.cc:407] Connection header received
0805 22:49:35.115784 (+ 301us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:49:35.115785 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:49:35.115794 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:49:35.115822 (+ 28us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:49:35.116023 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:35.116723 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:35.118149 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:35.118753 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:35.118803 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:35.118812 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0805 22:49:35.119134 (+ 322us) server_negotiation.cc:299] Negotiation successful
0805 22:49:35.119186 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260805 22:49:35.119367 2643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:35.114897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.129:40089 (local address 127.14.224.131:40809)
0805 22:49:35.115213 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:35.115225 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:49:35.115324 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:49:35.115516 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:49:35.115517 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:49:35.115518 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:49:35.115600 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:35.115602 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:35.116544 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:35.116545 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:35.117752 (+ 1207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:35.117755 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:35.118533 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:35.118534 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:35.118599 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:35.118603 (+ 4us) client_negotiation.cc:769] Sending connection context
0805 22:49:35.119196 (+ 593us) client_negotiation.cc:240] Negotiation successful
0805 22:49:35.119245 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":294,"thread_start_us":123,"threads_started":1}
I20260805 22:49:35.119714 2082 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f95924338354ff8a232840fe6b5f1e6" candidate_uuid: "1f809c7fca474b23898665591f8b7f50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df2e713c09f946a087e77a1387d4b20e" is_pre_election: true
I20260805 22:49:35.119781 2644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:35.114899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.130:46475 (local address 127.14.224.131:50391)
0805 22:49:35.115426 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:35.115435 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0805 22:49:35.115705 (+ 270us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:49:35.115884 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:49:35.115885 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:49:35.115886 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:49:35.115949 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:35.115950 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:35.116832 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:35.116833 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:35.118043 (+ 1210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:35.118047 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:35.118944 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:35.118945 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:35.119041 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:35.119045 (+ 4us) client_negotiation.cc:769] Sending connection context
0805 22:49:35.119654 (+ 609us) client_negotiation.cc:240] Negotiation successful
0805 22:49:35.119701 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":508,"thread_start_us":128,"threads_started":1}
I20260805 22:49:35.119889 2082 raft_consensus.cc:2454] T 5f95924338354ff8a232840fe6b5f1e6 P df2e713c09f946a087e77a1387d4b20e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f809c7fca474b23898665591f8b7f50 in term 0.
I20260805 22:49:35.120141 2401 leader_election.cc:302] T 5f95924338354ff8a232840fe6b5f1e6 P 1f809c7fca474b23898665591f8b7f50 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f809c7fca474b23898665591f8b7f50, df2e713c09f946a087e77a1387d4b20e; no voters:
I20260805 22:49:35.120141 2285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f95924338354ff8a232840fe6b5f1e6" candidate_uuid: "1f809c7fca474b23898665591f8b7f50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e07982be76624ba981d01df046efa39d" is_pre_election: true
I20260805 22:49:35.120288 2285 raft_consensus.cc:2454] T 5f95924338354ff8a232840fe6b5f1e6 P e07982be76624ba981d01df046efa39d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f809c7fca474b23898665591f8b7f50 in term 0.
I20260805 22:49:35.120343 2640 raft_consensus.cc:2781] T 5f95924338354ff8a232840fe6b5f1e6 P 1f809c7fca474b23898665591f8b7f50 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:49:35.120391 2640 raft_consensus.cc:482] T 5f95924338354ff8a232840fe6b5f1e6 P 1f809c7fca474b23898665591f8b7f50 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:49:35.120420 2640 raft_consensus.cc:3037] T 5f95924338354ff8a232840fe6b5f1e6 P 1f809c7fca474b23898665591f8b7f50 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:49:35.121309 2640 raft_consensus.cc:504] T 5f95924338354ff8a232840fe6b5f1e6 P 1f809c7fca474b23898665591f8b7f50 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f809c7fca474b23898665591f8b7f50" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 36837 } } peers { permanent_uuid: "df2e713c09f946a087e77a1387d4b20e" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 40089 } } peers { permanent_uuid: "e07982be76624ba981d01df046efa39d" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 46475 } }
I20260805 22:49:35.121670 2082 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f95924338354ff8a232840fe6b5f1e6" candidate_uuid: "1f809c7fca474b23898665591f8b7f50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df2e713c09f946a087e77a1387d4b20e"
I20260805 22:49:35.121752 2082 raft_consensus.cc:3037] T 5f95924338354ff8a232840fe6b5f1e6 P df2e713c09f946a087e77a1387d4b20e [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:49:35.122654 2082 raft_consensus.cc:2454] T 5f95924338354ff8a232840fe6b5f1e6 P df2e713c09f946a087e77a1387d4b20e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f809c7fca474b23898665591f8b7f50 in term 1.
I20260805 22:49:35.122912 2401 leader_election.cc:302] T 5f95924338354ff8a232840fe6b5f1e6 P 1f809c7fca474b23898665591f8b7f50 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f809c7fca474b23898665591f8b7f50, df2e713c09f946a087e77a1387d4b20e; no voters:
I20260805 22:49:35.123319 2285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f95924338354ff8a232840fe6b5f1e6" candidate_uuid: "1f809c7fca474b23898665591f8b7f50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e07982be76624ba981d01df046efa39d"
I20260805 22:49:35.123418 2285 raft_consensus.cc:3037] T 5f95924338354ff8a232840fe6b5f1e6 P e07982be76624ba981d01df046efa39d [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:49:35.123767 2646 raft_consensus.cc:2781] T 5f95924338354ff8a232840fe6b5f1e6 P 1f809c7fca474b23898665591f8b7f50 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:49:35.123941 2646 raft_consensus.cc:686] T 5f95924338354ff8a232840fe6b5f1e6 P 1f809c7fca474b23898665591f8b7f50 [term 1 LEADER]: Becoming Leader. State: Replica: 1f809c7fca474b23898665591f8b7f50, State: Running, Role: LEADER
I20260805 22:49:35.124053 2646 consensus_queue.cc:237] T 5f95924338354ff8a232840fe6b5f1e6 P 1f809c7fca474b23898665591f8b7f50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f809c7fca474b23898665591f8b7f50" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 36837 } } peers { permanent_uuid: "df2e713c09f946a087e77a1387d4b20e" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 40089 } } peers { permanent_uuid: "e07982be76624ba981d01df046efa39d" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 46475 } }
I20260805 22:49:35.124240 2285 raft_consensus.cc:2454] T 5f95924338354ff8a232840fe6b5f1e6 P e07982be76624ba981d01df046efa39d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f809c7fca474b23898665591f8b7f50 in term 1.
I20260805 22:49:35.124549 2640 leader_election.cc:288] T 5f95924338354ff8a232840fe6b5f1e6 P 1f809c7fca474b23898665591f8b7f50 [CANDIDATE]: Term 1 election: Requested vote from peers df2e713c09f946a087e77a1387d4b20e (127.14.224.129:40089), e07982be76624ba981d01df046efa39d (127.14.224.130:46475)
I20260805 22:49:35.125046 1851 catalog_manager.cc:5495] T 5f95924338354ff8a232840fe6b5f1e6 P 1f809c7fca474b23898665591f8b7f50 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f809c7fca474b23898665591f8b7f50 (127.14.224.131). New cstate: current_term: 1 leader_uuid: "1f809c7fca474b23898665591f8b7f50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f809c7fca474b23898665591f8b7f50" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 36837 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df2e713c09f946a087e77a1387d4b20e" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 40089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e07982be76624ba981d01df046efa39d" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 46475 } health_report { overall_health: UNKNOWN } } }
I20260805 22:49:35.134665 2623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:35.131510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37272 (local address 127.14.224.131:36837)
0805 22:49:35.131575 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0805 22:49:35.131577 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:49:35.131585 (+ 8us) server_negotiation.cc:407] Connection header received
0805 22:49:35.131628 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:49:35.131629 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:49:35.131652 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:49:35.131728 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:49:35.131878 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:35.132596 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:35.133685 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:35.134004 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:35.134079 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:35.134267 (+ 188us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:49:35.134434 (+ 167us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:49:35.134529 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0805 22:49:35.134551 (+ 22us) server_negotiation.cc:299] Negotiation successful
0805 22:49:35.134579 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260805 22:49:35.136807 2285 raft_consensus.cc:1261] T 5f95924338354ff8a232840fe6b5f1e6 P e07982be76624ba981d01df046efa39d [term 1 FOLLOWER]: Refusing update from remote peer 1f809c7fca474b23898665591f8b7f50: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:49:35.136842 2082 raft_consensus.cc:1261] T 5f95924338354ff8a232840fe6b5f1e6 P df2e713c09f946a087e77a1387d4b20e [term 1 FOLLOWER]: Refusing update from remote peer 1f809c7fca474b23898665591f8b7f50: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:49:35.137323 2646 consensus_queue.cc:1035] T 5f95924338354ff8a232840fe6b5f1e6 P 1f809c7fca474b23898665591f8b7f50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e07982be76624ba981d01df046efa39d" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 46475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:49:35.137481 2640 consensus_queue.cc:1035] T 5f95924338354ff8a232840fe6b5f1e6 P 1f809c7fca474b23898665591f8b7f50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df2e713c09f946a087e77a1387d4b20e" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 40089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:49:35.143537 1851 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50852:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:49:35.143671 1851 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50852:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:49:35.144613 1851 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e20e06ab9d4d48c69bcbf295c057623a: Sending DeleteTablet for 3 replicas of tablet 5f95924338354ff8a232840fe6b5f1e6
I20260805 22:49:35.145045 2259 tablet_service.cc:1514] Processing DeleteTablet for tablet 5f95924338354ff8a232840fe6b5f1e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:49:35 UTC) from {username='kudu', principal='kudu/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:52300
I20260805 22:49:35.145087 2049 tablet_service.cc:1514] Processing DeleteTablet for tablet 5f95924338354ff8a232840fe6b5f1e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:49:35 UTC) from {username='kudu', principal='kudu/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:49864
I20260805 22:49:35.145347 2662 tablet_replica.cc:330] T 5f95924338354ff8a232840fe6b5f1e6 P df2e713c09f946a087e77a1387d4b20e: stopping tablet replica
I20260805 22:49:35.145498 2662 raft_consensus.cc:2229] T 5f95924338354ff8a232840fe6b5f1e6 P df2e713c09f946a087e77a1387d4b20e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:49:35.145529 2475 tablet_service.cc:1514] Processing DeleteTablet for tablet 5f95924338354ff8a232840fe6b5f1e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:49:35 UTC) from {username='kudu', principal='kudu/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:37260
I20260805 22:49:35.145592 2662 raft_consensus.cc:2258] T 5f95924338354ff8a232840fe6b5f1e6 P df2e713c09f946a087e77a1387d4b20e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:49:35.145771 2660 tablet_replica.cc:330] T 5f95924338354ff8a232840fe6b5f1e6 P e07982be76624ba981d01df046efa39d: stopping tablet replica
I20260805 22:49:35.145893 2660 raft_consensus.cc:2229] T 5f95924338354ff8a232840fe6b5f1e6 P e07982be76624ba981d01df046efa39d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:49:35.145964 2660 raft_consensus.cc:2258] T 5f95924338354ff8a232840fe6b5f1e6 P e07982be76624ba981d01df046efa39d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:49:35.146137 2664 tablet_replica.cc:330] T 5f95924338354ff8a232840fe6b5f1e6 P 1f809c7fca474b23898665591f8b7f50: stopping tablet replica
I20260805 22:49:35.146237 2664 raft_consensus.cc:2229] T 5f95924338354ff8a232840fe6b5f1e6 P 1f809c7fca474b23898665591f8b7f50 [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:49:35.146365 2664 raft_consensus.cc:2258] T 5f95924338354ff8a232840fe6b5f1e6 P 1f809c7fca474b23898665591f8b7f50 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:49:35.147665 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 1919
I20260805 22:49:35.150537 2664 ts_tablet_manager.cc:1905] T 5f95924338354ff8a232840fe6b5f1e6 P 1f809c7fca474b23898665591f8b7f50: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:49:35.152518 2664 ts_tablet_manager.cc:1918] T 5f95924338354ff8a232840fe6b5f1e6 P 1f809c7fca474b23898665591f8b7f50: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:49:35.152602 2664 log.cc:1196] T 5f95924338354ff8a232840fe6b5f1e6 P 1f809c7fca474b23898665591f8b7f50: Deleting WAL directory at /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-2/wal/wals/5f95924338354ff8a232840fe6b5f1e6
I20260805 22:49:35.152859 2664 ts_tablet_manager.cc:1939] T 5f95924338354ff8a232840fe6b5f1e6 P 1f809c7fca474b23898665591f8b7f50: Deleting consensus metadata
I20260805 22:49:35.158310 1830 catalog_manager.cc:4841] TS 1f809c7fca474b23898665591f8b7f50 (127.14.224.131:36837): tablet 5f95924338354ff8a232840fe6b5f1e6 (table test-table [id=1a1f096e6cf44ceda3d4ff945b15f638]) successfully deleted
I20260805 22:49:35.163182 2660 ts_tablet_manager.cc:1905] T 5f95924338354ff8a232840fe6b5f1e6 P e07982be76624ba981d01df046efa39d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:49:35.165426 2660 ts_tablet_manager.cc:1918] T 5f95924338354ff8a232840fe6b5f1e6 P e07982be76624ba981d01df046efa39d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:49:35.165525 2660 log.cc:1196] T 5f95924338354ff8a232840fe6b5f1e6 P e07982be76624ba981d01df046efa39d: Deleting WAL directory at /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970021300824-15234-0/minicluster-data/ts-1/wal/wals/5f95924338354ff8a232840fe6b5f1e6
I20260805 22:49:35.165799 2660 ts_tablet_manager.cc:1939] T 5f95924338354ff8a232840fe6b5f1e6 P e07982be76624ba981d01df046efa39d: Deleting consensus metadata
I20260805 22:49:35.166321 1831 catalog_manager.cc:4841] TS e07982be76624ba981d01df046efa39d (127.14.224.130:46475): tablet 5f95924338354ff8a232840fe6b5f1e6 (table test-table [id=1a1f096e6cf44ceda3d4ff945b15f638]) successfully deleted
W20260805 22:49:35.171676 1827 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.224.129:40089 (error 108)
I20260805 22:49:35.172693 2618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:35.172562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.129:40089 (local address 127.0.0.1:49874)
0805 22:49:35.172620 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:35.172654 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.129:40089: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260805 22:49:35.172926 1827 catalog_manager.cc:4584] TS df2e713c09f946a087e77a1387d4b20e (127.14.224.129:40089): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 5f95924338354ff8a232840fe6b5f1e6: Network error: Client connection negotiation failed: client connection to 127.14.224.129:40089: connect: Connection refused (error 111)
I20260805 22:49:35.173205 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 2171
I20260805 22:49:35.225853 2618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:35.225718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.129:40089 (local address 127.0.0.1:49880)
0805 22:49:35.225771 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:35.225805 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.129:40089: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260805 22:49:35.229933 2618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:35.229799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.129:40089 (local address 127.0.0.1:49890)
0805 22:49:35.229858 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:35.229890 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.129:40089: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260805 22:49:35.231696 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 2371
I20260805 22:49:35.243121 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 1802
I20260805 22:49:35.254833 15234 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260805 22:49:35.599553 15234 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260805 22:49:35.599660 15234 mini_ranger.cc:66] Stopping Ranger...
I20260805 22:49:35.944309 15234 mini_ranger.cc:68] Stopped Ranger
2026-08-05 22:49:35.944 UTC [392] LOG: received smart shutdown request
2026-08-05 22:49:35.949 UTC [392] LOG: background worker "logical replication launcher" (PID 407) exited with exit code 1
2026-08-05 22:49:35.949 UTC [398] LOG: shutting down
2026-08-05 22:49:36.114 UTC [392] LOG: database system is shut down
2026-08-05T22:49:36Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (48970 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:49:36 dist-test-slave-gjrz krb5kdc[2687](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:49:36 dist-test-slave-gjrz krb5kdc[2687](info): set up 2 sockets
Aug 05 22:49:36 dist-test-slave-gjrz krb5kdc[2687](info): commencing operation
krb5kdc: starting...
W20260805 22:49:37.348706 15234 mini_kdc.cc:121] Time spent starting KDC: real 1.128s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Aug 05 22:49:37 dist-test-slave-gjrz krb5kdc[2687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970177, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:49:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:49:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.224.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab.
Entry for principal kudu/127.14.224.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab.
I20260805 22:49:37.477701 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:37589
--webserver_interface=127.14.224.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:42901
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.224.190:37589,127.14.224.189:43849,127.14.224.188:33363
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:49:37.567607 2706 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:49:37.567844 2706 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:49:37.567878 2706 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:49:37.569079 2706 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:49:37.569130 2706 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:49:37.569149 2706 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:49:37.569164 2706 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:49:37.569180 2706 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:49:37.570793 2706 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:42901
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.224.190:37589,127.14.224.189:43849,127.14.224.188:33363
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:37589
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.224.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2706
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:49:37.571071 2706 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:49:37.571323 2706 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:49:37.576152 2712 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:49:37.576159 2716 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:49:37.576148 2718 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:49:37.576187 2706 server_base.cc:1034] running on GCE node
I20260805 22:49:37.576565 2706 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:49:37.576905 2706 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:49:37.578073 2706 hybrid_clock.cc:648] HybridClock initialized: now 1785970177578054 us; error 33 us; skew 500 ppm
Aug 05 22:49:37 dist-test-slave-gjrz krb5kdc[2687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970177, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:49:37.584829 2706 init.cc:377] Logged in from keytab as kudu/127.14.224.190@KRBTEST.COM (short username kudu)
I20260805 22:49:37.585369 2706 webserver.cc:460] Webserver started at http://127.14.224.190:39727/ using document root <none> and password file <none>
I20260805 22:49:37.585592 2706 fs_manager.cc:359] Metadata directory not provided
I20260805 22:49:37.585634 2706 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:49:37.585736 2706 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:49:37.586824 2706 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/minicluster-data/master-0/data/instance:
uuid: "e24c28dca2ed47c3b9cda7af8a6b1ce1"
format_stamp: "Formatted at 2026-08-05 22:49:37 on dist-test-slave-gjrz"
server_key: "a09aaa1465ff265c4548b345efea10cc"
server_key_iv: "7e9db4d6d9c364730561f00f70e82747"
server_key_version: "encryptionkey@0"
I20260805 22:49:37.587162 2706 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/minicluster-data/master-0/wal/instance:
uuid: "e24c28dca2ed47c3b9cda7af8a6b1ce1"
format_stamp: "Formatted at 2026-08-05 22:49:37 on dist-test-slave-gjrz"
server_key: "a09aaa1465ff265c4548b345efea10cc"
server_key_iv: "7e9db4d6d9c364730561f00f70e82747"
server_key_version: "encryptionkey@0"
I20260805 22:49:37.588521 2706 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:49:37.589268 2730 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:49:37.589432 2706 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260805 22:49:37.589515 2706 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/minicluster-data/master-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/minicluster-data/master-0/wal
uuid: "e24c28dca2ed47c3b9cda7af8a6b1ce1"
format_stamp: "Formatted at 2026-08-05 22:49:37 on dist-test-slave-gjrz"
server_key: "a09aaa1465ff265c4548b345efea10cc"
server_key_iv: "7e9db4d6d9c364730561f00f70e82747"
server_key_version: "encryptionkey@0"
I20260805 22:49:37.589602 2706 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:49:37.611068 2706 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:49:37.612962 2706 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:49:37.613091 2706 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:49:37.617079 2706 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.190:37589
I20260805 22:49:37.617425 2809 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.190:37589 every 8 connection(s)
I20260805 22:49:37.617465 2706 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
I20260805 22:49:37.618204 2810 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:49:37.620206 2810 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.224.190" port: 37589 } has no permanent_uuid. Determining permanent_uuid...
I20260805 22:49:37.624030 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 2706
I20260805 22:49:37.624153 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/minicluster-data/master-0/wal/instance
I20260805 22:49:37.624353 15234 external_mini_cluster.cc:1428] Setting key 8ab0803e4fd50c766f62996fc5c03ae6
Aug 05 22:49:37 dist-test-slave-gjrz krb5kdc[2687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970177, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.190@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:49:37.630750 2815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:37.620975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34522 (local address 127.14.224.190:37589)
0805 22:49:37.621206 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0805 22:49:37.621214 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:49:37.621292 (+ 78us) server_negotiation.cc:407] Connection header received
0805 22:49:37.621898 (+ 606us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:49:37.621901 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:49:37.621923 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:49:37.622004 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:49:37.622589 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:37.623506 (+ 917us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:37.624671 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:37.625006 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:37.625108 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:37.627570 (+ 2462us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:49:37.627578 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:49:37.627578 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:49:37.627585 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:49:37.629083 (+ 1498us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:37.629549 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:37.629551 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:37.629551 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:37.629639 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:37.629882 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:37.629883 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:37.629883 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:37.630137 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:49:37.630204 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0805 22:49:37.630428 (+ 224us) server_negotiation.cc:299] Negotiation successful
0805 22:49:37.630563 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":16,"server-negotiator.queue_time_us":206,"thread_start_us":95,"threads_started":1}
I20260805 22:49:37.630764 2812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:37.620960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:37589 (local address 127.0.0.1:34522)
0805 22:49:37.621158 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:37.621205 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0805 22:49:37.621723 (+ 518us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:49:37.622014 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:49:37.622017 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:49:37.622327 (+ 310us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:49:37.622490 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:37.622495 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:37.623598 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:37.623600 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:37.624584 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:37.624588 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:37.625133 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:37.625135 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:37.625222 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:37.625750 (+ 528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:49:37.625761 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:49:37.627458 (+ 1697us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:49:37.629198 (+ 1740us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:49:37.629207 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:49:37.629210 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:49:37.629474 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:49:37.629707 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:49:37.629708 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:49:37.629709 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:49:37.629825 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:49:37.630208 (+ 383us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:49:37.630216 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:49:37.630298 (+ 82us) client_negotiation.cc:769] Sending connection context
0805 22:49:37.630401 (+ 103us) client_negotiation.cc:240] Negotiation successful
0805 22:49:37.630652 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"mutex_wait_us":73,"thread_start_us":89,"threads_started":1}
I20260805 22:49:37.631666 2810 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.224.189" port: 43849 } has no permanent_uuid. Determining permanent_uuid...
I20260805 22:49:37.632026 2812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:37.631903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.189:43849 (local address 127.0.0.1:50690)
0805 22:49:37.631952 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:37.632001 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.189:43849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260805 22:49:37.632166 2735 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.224.189:43849: connect: Connection refused (error 111)
I20260805 22:49:37.632649 2812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:37.632516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.189:43849 (local address 127.0.0.1:50706)
0805 22:49:37.632595 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:37.632625 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.189:43849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260805 22:49:37.632757 2810 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.224.189:43849: Network error: Client connection negotiation failed: client connection to 127.14.224.189:43849: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.14.224.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.189.keytab.
Entry for principal kudu/127.14.224.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.189.keytab.
I20260805 22:49:37.650359 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.189:43849
--webserver_interface=127.14.224.189
--webserver_port=0
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.189.keytab
--principal=kudu/127.14.224.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:42901
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.224.190:37589,127.14.224.189:43849,127.14.224.188:33363
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 22:49:37.682009 2810 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.224.189" port: 43849 } attempt: 1
I20260805 22:49:37.682606 2812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:37.682422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.189:43849 (local address 127.0.0.1:50712)
0805 22:49:37.682504 (+ 82us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:37.682561 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.189:43849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260805 22:49:37.682989 2812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:37.682892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.189:43849 (local address 127.0.0.1:50718)
0805 22:49:37.682934 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:37.682965 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.189:43849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260805 22:49:37.683104 2810 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.224.189:43849: Network error: Client connection negotiation failed: client connection to 127.14.224.189:43849: connect: Connection refused (error 111)
W20260805 22:49:37.735040 2819 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:49:37.735303 2819 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:49:37.735327 2819 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:49:37.736536 2819 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:49:37.736588 2819 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:49:37.736603 2819 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:49:37.736613 2819 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:49:37.736626 2819 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:49:37.738205 2819 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:42901
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.14.224.190:37589,127.14.224.189:43849,127.14.224.188:33363
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.189.keytab
--principal=kudu/127.14.224.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.189:43849
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.14.224.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2819
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:49:37.738468 2819 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:49:37.738698 2819 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:49:37.743729 2827 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:49:37.743718 2833 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:49:37.743765 2819 server_base.cc:1034] running on GCE node
W20260805 22:49:37.743718 2829 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:49:37.744321 2819 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:49:37.744635 2819 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:49:37.745790 2819 hybrid_clock.cc:648] HybridClock initialized: now 1785970177745774 us; error 31 us; skew 500 ppm
Aug 05 22:49:37 dist-test-slave-gjrz krb5kdc[2687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970177, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:49:37.748368 2819 init.cc:377] Logged in from keytab as kudu/127.14.224.189@KRBTEST.COM (short username kudu)
I20260805 22:49:37.748816 2819 webserver.cc:460] Webserver started at http://127.14.224.189:40293/ using document root <none> and password file <none>
I20260805 22:49:37.749001 2819 fs_manager.cc:359] Metadata directory not provided
I20260805 22:49:37.749042 2819 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:49:37.749135 2819 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:49:37.750185 2819 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/minicluster-data/master-1/data/instance:
uuid: "79a77f8c40fc4c15abf7072221337a3d"
format_stamp: "Formatted at 2026-08-05 22:49:37 on dist-test-slave-gjrz"
server_key: "1560b29c7512b392a65649b498e4f78e"
server_key_iv: "277d9af0b56942e29c706e942b956e37"
server_key_version: "encryptionkey@0"
I20260805 22:49:37.750497 2819 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/minicluster-data/master-1/wal/instance:
uuid: "79a77f8c40fc4c15abf7072221337a3d"
format_stamp: "Formatted at 2026-08-05 22:49:37 on dist-test-slave-gjrz"
server_key: "1560b29c7512b392a65649b498e4f78e"
server_key_iv: "277d9af0b56942e29c706e942b956e37"
server_key_version: "encryptionkey@0"
I20260805 22:49:37.751281 2810 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.224.189" port: 43849 } attempt: 2
I20260805 22:49:37.751667 2812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:37.751548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.189:43849 (local address 127.0.0.1:50722)
0805 22:49:37.751601 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:37.751635 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.189:43849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260805 22:49:37.751935 2819 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260805 22:49:37.752027 2812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:37.751932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.189:43849 (local address 127.0.0.1:50730)
0805 22:49:37.751970 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:37.752002 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.189:43849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260805 22:49:37.752116 2810 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.224.189:43849: Network error: Client connection negotiation failed: client connection to 127.14.224.189:43849: connect: Connection refused (error 111)
I20260805 22:49:37.752743 2841 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:49:37.752893 2819 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260805 22:49:37.752983 2819 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/minicluster-data/master-1/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/minicluster-data/master-1/wal
uuid: "79a77f8c40fc4c15abf7072221337a3d"
format_stamp: "Formatted at 2026-08-05 22:49:37 on dist-test-slave-gjrz"
server_key: "1560b29c7512b392a65649b498e4f78e"
server_key_iv: "277d9af0b56942e29c706e942b956e37"
server_key_version: "encryptionkey@0"
I20260805 22:49:37.753080 2819 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:49:37.781149 2819 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:49:37.783365 2819 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:49:37.783507 2819 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:49:37.787577 2819 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.189:43849
I20260805 22:49:37.787622 2913 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.189:43849 every 8 connection(s)
I20260805 22:49:37.787981 2819 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/minicluster-data/master-1/data/info.pb
I20260805 22:49:37.788859 2914 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:49:37.790503 2914 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.224.190" port: 37589 } has no permanent_uuid. Determining permanent_uuid...
Aug 05 22:49:37 dist-test-slave-gjrz krb5kdc[2687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970177, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.189@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:49:37.796631 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 2819
I20260805 22:49:37.796742 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/minicluster-data/master-1/wal/instance
I20260805 22:49:37.796911 15234 external_mini_cluster.cc:1428] Setting key 3f4a98b65f3899b88c7c639eb2cedda4
I20260805 22:49:37.799324 2815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:37.791298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34524 (local address 127.14.224.190:37589)
0805 22:49:37.791350 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0805 22:49:37.791352 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:49:37.791559 (+ 207us) server_negotiation.cc:407] Connection header received
0805 22:49:37.792038 (+ 479us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:49:37.792039 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:49:37.792050 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:49:37.792109 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:49:37.792767 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:37.793287 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:37.794255 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:37.794458 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:37.794505 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:37.796553 (+ 2048us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:49:37.796555 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:49:37.796555 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:49:37.796564 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:49:37.797974 (+ 1410us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:37.798358 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:37.798359 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:37.798359 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:37.798422 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:37.798648 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:37.798650 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:37.798650 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:37.798778 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:49:37.798840 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0805 22:49:37.799091 (+ 251us) server_negotiation.cc:299] Negotiation successful
0805 22:49:37.799205 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260805 22:49:37.799468 2916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:37.791234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:37589 (local address 127.0.0.1:34524)
0805 22:49:37.791443 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:37.791486 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0805 22:49:37.791963 (+ 477us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:49:37.792173 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:49:37.792178 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:49:37.792486 (+ 308us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:49:37.792694 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:37.792699 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:37.793374 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:37.793375 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:37.794180 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:37.794183 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:37.794514 (+ 331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:37.794514 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:37.794610 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:37.795056 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:49:37.795063 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:49:37.796463 (+ 1400us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:49:37.798061 (+ 1598us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:49:37.798069 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:49:37.798070 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:49:37.798292 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:49:37.798477 (+ 185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:49:37.798477 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:49:37.798478 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:49:37.798567 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:49:37.798840 (+ 273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:49:37.798848 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:49:37.798971 (+ 123us) client_negotiation.cc:769] Sending connection context
0805 22:49:37.799059 (+ 88us) client_negotiation.cc:240] Negotiation successful
0805 22:49:37.799217 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":110,"threads_started":1}
I20260805 22:49:37.800024 2914 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.224.189" port: 43849 } has no permanent_uuid. Determining permanent_uuid...
Aug 05 22:49:37 dist-test-slave-gjrz krb5kdc[2687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970177, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.189@KRBTEST.COM for kudu/127.14.224.189@KRBTEST.COM
WARNING: no policy specified for kudu/127.14.224.188@KRBTEST.COM; defaulting to no policy
I20260805 22:49:37.807044 2916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:37.800270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.189:43849 (local address 127.0.0.1:50736)
0805 22:49:37.800468 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:37.800480 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:49:37.800530 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:49:37.800662 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:49:37.800663 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:49:37.800797 (+ 134us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:49:37.800840 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:37.800841 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:37.801660 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:37.801661 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:37.802180 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:37.802182 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:37.802595 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:37.802596 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:37.802661 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:37.803019 (+ 358us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:49:37.803024 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:49:37.804402 (+ 1378us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:49:37.806052 (+ 1650us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:49:37.806053 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:49:37.806054 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:49:37.806242 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:49:37.806434 (+ 192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:49:37.806435 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:49:37.806436 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:49:37.806486 (+ 50us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:49:37.806738 (+ 252us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:49:37.806739 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:49:37.806775 (+ 36us) client_negotiation.cc:769] Sending connection context
0805 22:49:37.806833 (+ 58us) client_negotiation.cc:240] Negotiation successful
0805 22:49:37.806943 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26}
I20260805 22:49:37.807144 2919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:37.800335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50736 (local address 127.14.224.189:43849)
0805 22:49:37.800487 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0805 22:49:37.800491 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:49:37.800528 (+ 37us) server_negotiation.cc:407] Connection header received
0805 22:49:37.800572 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:49:37.800574 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:49:37.800587 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:49:37.800656 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:49:37.800903 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:37.801570 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:37.802250 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:37.802532 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:37.802590 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:37.804498 (+ 1908us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:49:37.804509 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:49:37.804509 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:49:37.804517 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:49:37.805976 (+ 1459us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:37.806324 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:37.806328 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:37.806328 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:37.806379 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:37.806536 (+ 157us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:37.806537 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:37.806537 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:37.806678 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:49:37.806752 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0805 22:49:37.806868 (+ 116us) server_negotiation.cc:299] Negotiation successful
0805 22:49:37.807030 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":72,"server-negotiator.queue_time_us":126,"thread_start_us":89,"threads_started":1}
I20260805 22:49:37.807768 2914 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.224.188" port: 33363 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.188@KRBTEST.COM" created.
I20260805 22:49:37.808125 2916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:37.807990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.188:33363 (local address 127.0.0.1:60830)
0805 22:49:37.808040 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:37.808096 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.188:33363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260805 22:49:37.808279 2843 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.224.188:33363: connect: Connection refused (error 111)
I20260805 22:49:37.808665 2916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:37.808577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.188:33363 (local address 127.0.0.1:60840)
0805 22:49:37.808615 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:37.808640 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.188:33363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260805 22:49:37.808799 2914 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.224.188:33363: Network error: Client connection negotiation failed: client connection to 127.14.224.188:33363: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.188.keytab.
Entry for principal kudu/127.14.224.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.188.keytab.
I20260805 22:49:37.824213 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.188:33363
--webserver_interface=127.14.224.188
--webserver_port=0
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.188.keytab
--principal=kudu/127.14.224.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:42901
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.224.190:37589,127.14.224.189:43849,127.14.224.188:33363
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 22:49:37.843300 2810 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.224.189" port: 43849 } attempt: 3
Aug 05 22:49:37 dist-test-slave-gjrz krb5kdc[2687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970177, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.190@KRBTEST.COM for kudu/127.14.224.189@KRBTEST.COM
I20260805 22:49:37.850684 2919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:37.843764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50750 (local address 127.14.224.189:43849)
0805 22:49:37.843848 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0805 22:49:37.843850 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:49:37.843859 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:49:37.843887 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:49:37.843888 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:49:37.843896 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:49:37.843943 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:49:37.844345 (+ 402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:37.845132 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:37.845815 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:37.846032 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:37.846089 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:37.848229 (+ 2140us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:49:37.848231 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:49:37.848231 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:49:37.848239 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:49:37.849544 (+ 1305us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:37.849969 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:37.849971 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:37.849971 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:37.850035 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:37.850224 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:37.850225 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:37.850225 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:37.850338 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:49:37.850388 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0805 22:49:37.850538 (+ 150us) server_negotiation.cc:299] Negotiation successful
0805 22:49:37.850612 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260805 22:49:37.850718 2812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:37.843674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.189:43849 (local address 127.0.0.1:50750)
0805 22:49:37.843739 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:37.843753 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0805 22:49:37.843798 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:49:37.843959 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:49:37.843960 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:49:37.844163 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:49:37.844263 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:37.844267 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:37.845208 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:37.845209 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:37.845729 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:37.845731 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:37.846097 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:37.846098 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:37.846185 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:37.846607 (+ 422us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:49:37.846612 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:49:37.848133 (+ 1521us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:49:37.849639 (+ 1506us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:49:37.849641 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:49:37.849641 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:49:37.849870 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:49:37.850104 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:49:37.850104 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:49:37.850105 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:49:37.850171 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:49:37.850388 (+ 217us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:49:37.850389 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:49:37.850451 (+ 62us) client_negotiation.cc:769] Sending connection context
0805 22:49:37.850516 (+ 65us) client_negotiation.cc:240] Negotiation successful
0805 22:49:37.850621 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260805 22:49:37.851101 2810 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.224.188" port: 33363 } has no permanent_uuid. Determining permanent_uuid...
I20260805 22:49:37.851523 2812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:37.851392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.188:33363 (local address 127.0.0.1:60848)
0805 22:49:37.851456 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:37.851496 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.188:33363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260805 22:49:37.851859 2812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:37.851773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.188:33363 (local address 127.0.0.1:60852)
0805 22:49:37.851817 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:37.851843 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.188:33363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260805 22:49:37.851953 2810 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.224.188:33363: Network error: Client connection negotiation failed: client connection to 127.14.224.188:33363: connect: Connection refused (error 111)
I20260805 22:49:37.858021 2914 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.224.188" port: 33363 } attempt: 1
I20260805 22:49:37.858528 2916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:37.858381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.188:33363 (local address 127.0.0.1:60860)
0805 22:49:37.858442 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:37.858495 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.188:33363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260805 22:49:37.858834 2916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:37.858761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.188:33363 (local address 127.0.0.1:60868)
0805 22:49:37.858795 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:37.858818 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.188:33363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260805 22:49:37.858909 2914 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.224.188:33363: Network error: Client connection negotiation failed: client connection to 127.14.224.188:33363: connect: Connection refused (error 111)
I20260805 22:49:37.883131 2810 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.224.188" port: 33363 } attempt: 1
I20260805 22:49:37.883692 2812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:37.883548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.188:33363 (local address 127.0.0.1:60878)
0805 22:49:37.883614 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:37.883660 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.188:33363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260805 22:49:37.884081 2812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:37.883942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.188:33363 (local address 127.0.0.1:60880)
0805 22:49:37.884019 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:37.884053 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.188:33363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260805 22:49:37.884244 2810 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.224.188:33363: Network error: Client connection negotiation failed: client connection to 127.14.224.188:33363: connect: Connection refused (error 111)
W20260805 22:49:37.910498 2925 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:49:37.910734 2925 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:49:37.910766 2925 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:49:37.912016 2925 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:49:37.912081 2925 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:49:37.912102 2925 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:49:37.912118 2925 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:49:37.912135 2925 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:49:37.913763 2925 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:42901
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.14.224.190:37589,127.14.224.189:43849,127.14.224.188:33363
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.188.keytab
--principal=kudu/127.14.224.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.188:33363
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.14.224.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2925
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:49:37.914040 2925 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:49:37.914280 2925 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:49:37.919127 2940 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:49:37.919298 2938 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:49:37.919169 2925 server_base.cc:1034] running on GCE node
W20260805 22:49:37.919127 2933 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:49:37.919669 2925 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:49:37.919991 2925 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:49:37.921159 2925 hybrid_clock.cc:648] HybridClock initialized: now 1785970177921146 us; error 34 us; skew 500 ppm
Aug 05 22:49:37 dist-test-slave-gjrz krb5kdc[2687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970177, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:49:37.923718 2925 init.cc:377] Logged in from keytab as kudu/127.14.224.188@KRBTEST.COM (short username kudu)
I20260805 22:49:37.924175 2925 webserver.cc:460] Webserver started at http://127.14.224.188:44923/ using document root <none> and password file <none>
I20260805 22:49:37.924405 2925 fs_manager.cc:359] Metadata directory not provided
I20260805 22:49:37.924458 2925 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:49:37.924587 2925 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:49:37.925647 2925 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/minicluster-data/master-2/data/instance:
uuid: "46cad7611cc540fc9d808c1e090978bf"
format_stamp: "Formatted at 2026-08-05 22:49:37 on dist-test-slave-gjrz"
server_key: "a637eb79cd84a42ec411cd91c7015bd1"
server_key_iv: "479866c710cd78ac2171b27ecaf763b5"
server_key_version: "encryptionkey@0"
I20260805 22:49:37.926102 2925 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/minicluster-data/master-2/wal/instance:
uuid: "46cad7611cc540fc9d808c1e090978bf"
format_stamp: "Formatted at 2026-08-05 22:49:37 on dist-test-slave-gjrz"
server_key: "a637eb79cd84a42ec411cd91c7015bd1"
server_key_iv: "479866c710cd78ac2171b27ecaf763b5"
server_key_version: "encryptionkey@0"
I20260805 22:49:37.927039 2914 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.224.188" port: 33363 } attempt: 2
I20260805 22:49:37.927479 2916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:37.927339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.188:33363 (local address 127.0.0.1:60882)
0805 22:49:37.927411 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:37.927448 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.188:33363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260805 22:49:37.927702 2925 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260805 22:49:37.927836 2916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:37.927739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.188:33363 (local address 127.0.0.1:60884)
0805 22:49:37.927782 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:37.927810 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.188:33363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260805 22:49:37.927969 2914 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.224.188:33363: Network error: Client connection negotiation failed: client connection to 127.14.224.188:33363: connect: Connection refused (error 111)
I20260805 22:49:37.928539 2951 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:49:37.928694 2925 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260805 22:49:37.928782 2925 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/minicluster-data/master-2/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/minicluster-data/master-2/wal
uuid: "46cad7611cc540fc9d808c1e090978bf"
format_stamp: "Formatted at 2026-08-05 22:49:37 on dist-test-slave-gjrz"
server_key: "a637eb79cd84a42ec411cd91c7015bd1"
server_key_iv: "479866c710cd78ac2171b27ecaf763b5"
server_key_version: "encryptionkey@0"
I20260805 22:49:37.928850 2925 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:49:37.959403 2810 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.224.188" port: 33363 } attempt: 2
I20260805 22:49:37.959925 2812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:37.959780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.188:33363 (local address 127.0.0.1:60896)
0805 22:49:37.959837 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:37.959875 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.188:33363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260805 22:49:37.960295 2812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:37.960215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.188:33363 (local address 127.0.0.1:60900)
0805 22:49:37.960251 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:37.960277 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.188:33363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
W20260805 22:49:37.960390 2810 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.224.188:33363: Network error: Client connection negotiation failed: client connection to 127.14.224.188:33363: connect: Connection refused (error 111)
I20260805 22:49:37.963999 2925 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:49:37.965867 2925 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:49:37.965988 2925 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:49:37.969833 2925 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.188:33363
I20260805 22:49:37.969882 3037 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.188:33363 every 8 connection(s)
I20260805 22:49:37.970225 2925 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/minicluster-data/master-2/data/info.pb
I20260805 22:49:37.971093 3038 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:49:37.972662 3038 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.224.190" port: 37589 } has no permanent_uuid. Determining permanent_uuid...
Aug 05 22:49:37 dist-test-slave-gjrz krb5kdc[2687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970177, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.188@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:49:37.980346 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 2925
I20260805 22:49:37.980470 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970021300824-15234-0/minicluster-data/master-2/wal/instance
I20260805 22:49:37.980688 15234 external_mini_cluster.cc:1428] Setting key 8c1dc153e7ae8e04ee3be7bbed2b71fb
I20260805 22:49:37.981336 2815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:37.973401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34528 (local address 127.14.224.190:37589)
0805 22:49:37.973463 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0805 22:49:37.973465 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:49:37.973652 (+ 187us) server_negotiation.cc:407] Connection header received
0805 22:49:37.974134 (+ 482us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:49:37.974136 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:49:37.974149 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:49:37.974202 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:49:37.974839 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:37.975357 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:37.976313 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:37.976513 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:37.976573 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:37.978661 (+ 2088us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:49:37.978663 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:49:37.978663 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:49:37.978671 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:49:37.979807 (+ 1136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:37.980221 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:37.980222 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:37.980222 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:37.980281 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:37.980592 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:37.980593 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:37.980593 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:37.980712 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:49:37.980782 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0805 22:49:37.981150 (+ 368us) server_negotiation.cc:299] Negotiation successful
0805 22:49:37.981245 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260805 22:49:37.981495 3040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:37.973337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:37589 (local address 127.0.0.1:34528)
0805 22:49:37.973528 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:37.973572 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0805 22:49:37.974024 (+ 452us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:49:37.974288 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:49:37.974292 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:49:37.974544 (+ 252us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:49:37.974747 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:37.974751 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:37.975441 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:37.975442 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:37.976227 (+ 785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:37.976230 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:37.976591 (+ 361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:37.976592 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:37.976719 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:37.977171 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:49:37.977178 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:49:37.978563 (+ 1385us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:49:37.979882 (+ 1319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:49:37.979890 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:49:37.979892 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:49:37.980129 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:49:37.980339 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:49:37.980340 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:49:37.980340 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:49:37.980491 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:49:37.980786 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:49:37.980795 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:49:37.980949 (+ 154us) client_negotiation.cc:769] Sending connection context
0805 22:49:37.981101 (+ 152us) client_negotiation.cc:240] Negotiation successful
0805 22:49:37.981271 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":95,"threads_started":1}
I20260805 22:49:37.982039 3038 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.224.189" port: 43849 } has no permanent_uuid. Determining permanent_uuid...
Aug 05 22:49:37 dist-test-slave-gjrz krb5kdc[2687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970177, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.188@KRBTEST.COM for kudu/127.14.224.189@KRBTEST.COM
Aug 05 22:49:37 dist-test-slave-gjrz krb5kdc[2687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970177, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.224.188@KRBTEST.COM
I20260805 22:49:37.989461 3040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:37.982304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.189:43849 (local address 127.0.0.1:50758)
0805 22:49:37.982402 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:37.982412 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0805 22:49:37.982444 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:49:37.982583 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:49:37.982583 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:49:37.982695 (+ 112us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:49:37.982744 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:37.982745 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:37.983575 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:37.983576 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:37.984364 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:37.984367 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:37.984830 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:37.984831 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:37.984881 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:37.985267 (+ 386us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:49:37.985271 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:49:37.986613 (+ 1342us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:49:37.988449 (+ 1836us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:49:37.988450 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:49:37.988451 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:49:37.988649 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:49:37.988851 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:49:37.988851 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:49:37.988851 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:49:37.988907 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:49:37.989148 (+ 241us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:49:37.989149 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:49:37.989200 (+ 51us) client_negotiation.cc:769] Sending connection context
0805 22:49:37.989251 (+ 51us) client_negotiation.cc:240] Negotiation successful
0805 22:49:37.989345 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":81}
I20260805 22:49:37.989463 2919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:37.982376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50758 (local address 127.14.224.189:43849)
0805 22:49:37.982435 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0805 22:49:37.982437 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:49:37.982445 (+ 8us) server_negotiation.cc:407] Connection header received
0805 22:49:37.982495 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:49:37.982496 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:49:37.982507 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:49:37.982577 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:49:37.982801 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:37.983506 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:37.984448 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:37.984757 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:37.984822 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:37.986714 (+ 1892us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:49:37.986716 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:49:37.986716 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:49:37.986725 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:49:37.988368 (+ 1643us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:37.988724 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:37.988725 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:37.988725 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:37.988792 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:37.988966 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:37.988966 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:37.988967 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:37.989089 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:49:37.989140 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0805 22:49:37.989295 (+ 155us) server_negotiation.cc:299] Negotiation successful
0805 22:49:37.989380 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260805 22:49:37.989880 3038 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.224.188" port: 33363 } has no permanent_uuid. Determining permanent_uuid...
I20260805 22:49:37.990326 3043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:37.981087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60904 (local address 127.14.224.188:33363)
0805 22:49:37.981482 (+ 395us) server_negotiation.cc:206] Beginning negotiation
0805 22:49:37.981488 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:49:37.981509 (+ 21us) server_negotiation.cc:407] Connection header received
0805 22:49:37.981532 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:49:37.981534 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:49:37.981548 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:49:37.981626 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:49:37.982342 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:37.983419 (+ 1077us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:37.984449 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:37.984912 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:37.984963 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:37.987211 (+ 2248us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:49:37.987224 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:49:37.987224 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:49:37.987232 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:49:37.988832 (+ 1600us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:37.989191 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:37.989194 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:37.989195 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:37.989248 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:37.989446 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:37.989446 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:37.989447 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:37.989631 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:49:37.989788 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0805 22:49:37.990147 (+ 359us) server_negotiation.cc:299] Negotiation successful
0805 22:49:37.990234 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":365,"thread_start_us":112,"threads_started":1}
Aug 05 22:49:37 dist-test-slave-gjrz krb5kdc[2687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970177, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.188@KRBTEST.COM for kudu/127.14.224.188@KRBTEST.COM
Aug 05 22:49:37 dist-test-slave-gjrz krb5kdc[2687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970177, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:49:37.997941 3040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:37.990169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.188:33363 (local address 127.0.0.1:60916)
0805 22:49:37.990212 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:37.990222 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0805 22:49:37.990258 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:49:37.990516 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:49:37.990517 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:49:37.990665 (+ 148us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:49:37.990704 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:37.990707 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:37.991489 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:37.991490 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:37.992175 (+ 685us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:37.992178 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:37.992665 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:37.992666 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:37.992715 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:37.993169 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:49:37.993174 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:49:37.994602 (+ 1428us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:49:37.996964 (+ 2362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:49:37.996965 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:49:37.996965 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:49:37.997130 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:49:37.997331 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:49:37.997332 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:49:37.997332 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:49:37.997384 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:49:37.997639 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:49:37.997640 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:49:37.997685 (+ 45us) client_negotiation.cc:769] Sending connection context
0805 22:49:37.997742 (+ 57us) client_negotiation.cc:240] Negotiation successful
0805 22:49:37.997851 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25}
I20260805 22:49:37.998051 3045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:37.990230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60916 (local address 127.14.224.188:33363)
0805 22:49:37.990391 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0805 22:49:37.990393 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:49:37.990398 (+ 5us) server_negotiation.cc:407] Connection header received
0805 22:49:37.990415 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:49:37.990416 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:49:37.990426 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:49:37.990508 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:49:37.990777 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:37.991431 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:37.992246 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:37.992600 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:37.992668 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:37.994696 (+ 2028us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:49:37.994697 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:49:37.994698 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:49:37.994704 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:49:37.996883 (+ 2179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:37.997200 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:37.997202 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:37.997202 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:37.997268 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:37.997438 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:37.997439 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:37.997439 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:37.997553 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:49:37.997614 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0805 22:49:37.997778 (+ 164us) server_negotiation.cc:299] Negotiation successful
0805 22:49:37.997916 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":47,"server-negotiator.queue_time_us":143,"thread_start_us":109,"threads_started":1}
I20260805 22:49:37.998638 2815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:37.991207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34544 (local address 127.14.224.190:37589)
0805 22:49:37.991304 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0805 22:49:37.991306 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:49:37.991313 (+ 7us) server_negotiation.cc:407] Connection header received
0805 22:49:37.991337 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:49:37.991338 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:49:37.991348 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:49:37.991394 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:49:37.991997 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:37.992646 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:37.993406 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:37.993681 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:37.993748 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:37.995941 (+ 2193us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:49:37.995942 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:49:37.995943 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:49:37.995953 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:49:37.997329 (+ 1376us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:37.997641 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:37.997642 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:37.997642 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:37.997696 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:37.997872 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:37.997872 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:37.997873 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:37.998005 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:49:37.998202 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0805 22:49:37.998462 (+ 260us) server_negotiation.cc:299] Negotiation successful
0805 22:49:37.998538 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260805 22:49:37.999835 3038 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 46cad7611cc540fc9d808c1e090978bf: Bootstrap starting.
I20260805 22:49:38.000594 3038 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 46cad7611cc540fc9d808c1e090978bf: Neither blocks nor log segments found. Creating new log.
I20260805 22:49:38.000895 3038 log.cc:824] T 00000000000000000000000000000000 P 46cad7611cc540fc9d808c1e090978bf: Log is configured to *not* fsync() on all Append() calls
I20260805 22:49:38.001681 3038 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 46cad7611cc540fc9d808c1e090978bf: No bootstrap required, opened a new log
Aug 05 22:49:38 dist-test-slave-gjrz krb5kdc[2687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970177, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.224.189@KRBTEST.COM
I20260805 22:49:38.003525 3038 raft_consensus.cc:348] T 00000000000000000000000000000000 P 46cad7611cc540fc9d808c1e090978bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e24c28dca2ed47c3b9cda7af8a6b1ce1" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 37589 } } peers { permanent_uuid: "79a77f8c40fc4c15abf7072221337a3d" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 43849 } } peers { permanent_uuid: "46cad7611cc540fc9d808c1e090978bf" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 33363 } }
I20260805 22:49:38.003705 3038 raft_consensus.cc:374] T 00000000000000000000000000000000 P 46cad7611cc540fc9d808c1e090978bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:49:38.003744 3038 raft_consensus.cc:729] T 00000000000000000000000000000000 P 46cad7611cc540fc9d808c1e090978bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46cad7611cc540fc9d808c1e090978bf, State: Initialized, Role: FOLLOWER
I20260805 22:49:38.003883 3038 consensus_queue.cc:260] T 00000000000000000000000000000000 P 46cad7611cc540fc9d808c1e090978bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e24c28dca2ed47c3b9cda7af8a6b1ce1" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 37589 } } peers { permanent_uuid: "79a77f8c40fc4c15abf7072221337a3d" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 43849 } } peers { permanent_uuid: "46cad7611cc540fc9d808c1e090978bf" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 33363 } }
I20260805 22:49:38.004225 3048 sys_catalog.cc:455] T 00000000000000000000000000000000 P 46cad7611cc540fc9d808c1e090978bf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e24c28dca2ed47c3b9cda7af8a6b1ce1" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 37589 } } peers { permanent_uuid: "79a77f8c40fc4c15abf7072221337a3d" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 43849 } } peers { permanent_uuid: "46cad7611cc540fc9d808c1e090978bf" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 33363 } } }
I20260805 22:49:38.004292 3038 sys_catalog.cc:564] T 00000000000000000000000000000000 P 46cad7611cc540fc9d808c1e090978bf [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:49:38.004333 3048 sys_catalog.cc:458] T 00000000000000000000000000000000 P 46cad7611cc540fc9d808c1e090978bf [sys.catalog]: This master's current role is: FOLLOWER
W20260805 22:49:38.006120 3066 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 46cad7611cc540fc9d808c1e090978bf: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260805 22:49:38.006503 3066 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260805 22:49:38.007616 2919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:37.999364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50760 (local address 127.14.224.189:43849)
0805 22:49:37.999432 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0805 22:49:37.999435 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:49:37.999445 (+ 10us) server_negotiation.cc:407] Connection header received
0805 22:49:37.999470 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:49:37.999471 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:49:37.999482 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:49:37.999541 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:49:37.999985 (+ 444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:38.000457 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:38.001198 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:38.001398 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:38.001455 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:38.003971 (+ 2516us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:49:38.003973 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:49:38.003973 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:49:38.003982 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:49:38.006262 (+ 2280us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:38.006676 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:38.006677 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:38.006677 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:38.006748 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:38.007001 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:38.007001 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:38.007002 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:38.007165 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:49:38.007400 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0805 22:49:38.007444 (+ 44us) server_negotiation.cc:299] Negotiation successful
0805 22:49:38.007531 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260805 22:49:38.007542 2925 master_runner.cc:186] Error getting master registration for 127.14.224.190:37589: OK, instance_id { permanent_uuid: "e24c28dca2ed47c3b9cda7af8a6b1ce1" instance_seqno: 1785970177615958 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260805 22:49:38.009217 2925 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260805 22:49:38.010772 15234 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:49:38.019160 2914 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.224.188" port: 33363 } attempt: 3
I20260805 22:49:38.020836 2815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:38.012271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34560 (local address 127.14.224.190:37589)
0805 22:49:38.012322 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0805 22:49:38.012325 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:49:38.012440 (+ 115us) server_negotiation.cc:407] Connection header received
0805 22:49:38.012593 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:49:38.012594 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:49:38.012607 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:49:38.012637 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:49:38.013288 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:38.014137 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:38.015169 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:38.015505 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:38.015576 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:38.017197 (+ 1621us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:49:38.017199 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:49:38.017199 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:49:38.017207 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:49:38.018738 (+ 1531us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:38.019796 (+ 1058us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:38.019797 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:38.019797 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:38.019861 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:38.020074 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:38.020075 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:38.020075 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:38.020219 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:49:38.020303 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0805 22:49:38.020650 (+ 347us) server_negotiation.cc:299] Negotiation successful
0805 22:49:38.020738 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260805 22:49:38.021178 2919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:38.012490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50768 (local address 127.14.224.189:43849)
0805 22:49:38.012532 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0805 22:49:38.012534 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:49:38.013354 (+ 820us) server_negotiation.cc:407] Connection header received
0805 22:49:38.013441 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:49:38.013442 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:49:38.013451 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:49:38.013478 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:49:38.014273 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:38.014976 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:38.015917 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:38.016161 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:38.016223 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:38.017451 (+ 1228us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:49:38.017453 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:49:38.017453 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:49:38.017461 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:49:38.019080 (+ 1619us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:38.019561 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:38.019562 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:38.019562 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:38.019620 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:38.020419 (+ 799us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:38.020420 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:38.020420 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:38.020561 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:49:38.020646 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0805 22:49:38.020979 (+ 333us) server_negotiation.cc:299] Negotiation successful
0805 22:49:38.021066 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260805 22:49:38.021509 3045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:38.012539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60930 (local address 127.14.224.188:33363)
0805 22:49:38.012582 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0805 22:49:38.012583 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0805 22:49:38.012725 (+ 142us) server_negotiation.cc:407] Connection header received
0805 22:49:38.012775 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:49:38.012776 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:49:38.012787 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:49:38.012840 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:49:38.013500 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:38.014249 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:38.015313 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:38.015633 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:38.015677 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:38.017244 (+ 1567us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:49:38.017246 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:49:38.017246 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:49:38.017254 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:49:38.018968 (+ 1714us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:38.019490 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:38.019491 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:38.019492 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:38.019551 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:38.020095 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:38.020096 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:38.020097 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:38.020285 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:49:38.020361 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0805 22:49:38.021321 (+ 960us) server_negotiation.cc:299] Negotiation successful
0805 22:49:38.021417 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
Aug 05 22:49:38 dist-test-slave-gjrz krb5kdc[2687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970177, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.189@KRBTEST.COM for kudu/127.14.224.188@KRBTEST.COM
I20260805 22:49:38.026338 2916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:38.019492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.188:33363 (local address 127.0.0.1:60940)
0805 22:49:38.019692 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:38.019704 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:49:38.019739 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:49:38.019871 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:49:38.019872 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:49:38.020028 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:49:38.020081 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:38.020084 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:38.021003 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:38.021004 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:38.021759 (+ 755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:38.021762 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:38.022254 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:38.022255 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:38.022311 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:38.022725 (+ 414us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:49:38.022729 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:49:38.023958 (+ 1229us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:49:38.025387 (+ 1429us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:49:38.025388 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:49:38.025389 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:49:38.025561 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:49:38.025736 (+ 175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:49:38.025737 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:49:38.025737 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:49:38.025796 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:49:38.026020 (+ 224us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:49:38.026020 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:49:38.026066 (+ 46us) client_negotiation.cc:769] Sending connection context
0805 22:49:38.026128 (+ 62us) client_negotiation.cc:240] Negotiation successful
0805 22:49:38.026239 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177}
I20260805 22:49:38.026338 3043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:38.019702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60940 (local address 127.14.224.188:33363)
0805 22:49:38.019745 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0805 22:49:38.019746 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0805 22:49:38.019754 (+ 8us) server_negotiation.cc:407] Connection header received
0805 22:49:38.019784 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:49:38.019784 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:49:38.019794 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:49:38.019844 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:49:38.020166 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:38.020869 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:38.021846 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:38.022138 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:38.022198 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:38.024053 (+ 1855us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:49:38.024055 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:49:38.024055 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:49:38.024063 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:49:38.025301 (+ 1238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:38.025626 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:38.025627 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:38.025627 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:38.025682 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:38.025847 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:38.025848 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:38.025848 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:38.025964 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:49:38.026028 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0805 22:49:38.026157 (+ 129us) server_negotiation.cc:299] Negotiation successful
0805 22:49:38.026239 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260805 22:49:38.027760 2914 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 79a77f8c40fc4c15abf7072221337a3d: Bootstrap starting.
I20260805 22:49:38.028622 2914 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 79a77f8c40fc4c15abf7072221337a3d: Neither blocks nor log segments found. Creating new log.
I20260805 22:49:38.028853 2914 log.cc:824] T 00000000000000000000000000000000 P 79a77f8c40fc4c15abf7072221337a3d: Log is configured to *not* fsync() on all Append() calls
I20260805 22:49:38.029577 2914 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 79a77f8c40fc4c15abf7072221337a3d: No bootstrap required, opened a new log
I20260805 22:49:38.031030 2914 raft_consensus.cc:348] T 00000000000000000000000000000000 P 79a77f8c40fc4c15abf7072221337a3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e24c28dca2ed47c3b9cda7af8a6b1ce1" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 37589 } } peers { permanent_uuid: "79a77f8c40fc4c15abf7072221337a3d" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 43849 } } peers { permanent_uuid: "46cad7611cc540fc9d808c1e090978bf" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 33363 } }
I20260805 22:49:38.031193 2914 raft_consensus.cc:374] T 00000000000000000000000000000000 P 79a77f8c40fc4c15abf7072221337a3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:49:38.031247 2914 raft_consensus.cc:729] T 00000000000000000000000000000000 P 79a77f8c40fc4c15abf7072221337a3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79a77f8c40fc4c15abf7072221337a3d, State: Initialized, Role: FOLLOWER
I20260805 22:49:38.031400 2914 consensus_queue.cc:260] T 00000000000000000000000000000000 P 79a77f8c40fc4c15abf7072221337a3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e24c28dca2ed47c3b9cda7af8a6b1ce1" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 37589 } } peers { permanent_uuid: "79a77f8c40fc4c15abf7072221337a3d" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 43849 } } peers { permanent_uuid: "46cad7611cc540fc9d808c1e090978bf" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 33363 } }
I20260805 22:49:38.031764 2914 sys_catalog.cc:564] T 00000000000000000000000000000000 P 79a77f8c40fc4c15abf7072221337a3d [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:49:38.031713 3078 sys_catalog.cc:455] T 00000000000000000000000000000000 P 79a77f8c40fc4c15abf7072221337a3d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e24c28dca2ed47c3b9cda7af8a6b1ce1" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 37589 } } peers { permanent_uuid: "79a77f8c40fc4c15abf7072221337a3d" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 43849 } } peers { permanent_uuid: "46cad7611cc540fc9d808c1e090978bf" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 33363 } } }
I20260805 22:49:38.031826 3078 sys_catalog.cc:458] T 00000000000000000000000000000000 P 79a77f8c40fc4c15abf7072221337a3d [sys.catalog]: This master's current role is: FOLLOWER
W20260805 22:49:38.034575 3093 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 79a77f8c40fc4c15abf7072221337a3d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260805 22:49:38.034796 3093 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260805 22:49:38.035383 2847 tablet.cc:2369] T 00000000000000000000000000000000 P 79a77f8c40fc4c15abf7072221337a3d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:49:38.033833 2819 master_runner.cc:186] Error getting master registration for 127.14.224.190:37589: OK, instance_id { permanent_uuid: "e24c28dca2ed47c3b9cda7af8a6b1ce1" instance_seqno: 1785970177615958 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260805 22:49:38.036036 2819 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260805 22:49:38.059569 2810 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.224.188" port: 33363 } attempt: 3
Aug 05 22:49:38 dist-test-slave-gjrz krb5kdc[2687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970177, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.190@KRBTEST.COM for kudu/127.14.224.188@KRBTEST.COM
I20260805 22:49:38.066627 3043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:38.059985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60954 (local address 127.14.224.188:33363)
0805 22:49:38.060039 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0805 22:49:38.060041 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:49:38.060072 (+ 31us) server_negotiation.cc:407] Connection header received
0805 22:49:38.060152 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:49:38.060153 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:49:38.060163 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:49:38.060208 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:49:38.060526 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:38.061002 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:38.061639 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:38.061819 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:38.061887 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:38.063661 (+ 1774us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:49:38.063662 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:49:38.063662 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:49:38.063669 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:49:38.065069 (+ 1400us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:38.065825 (+ 756us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:38.065827 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:38.065827 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:38.065895 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:38.066100 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:38.066101 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:38.066102 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:38.066227 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:49:38.066285 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0805 22:49:38.066436 (+ 151us) server_negotiation.cc:299] Negotiation successful
0805 22:49:38.066530 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260805 22:49:38.066627 2812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:38.059931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.188:33363 (local address 127.0.0.1:60954)
0805 22:49:38.059993 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:38.060004 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:49:38.060086 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:49:38.060223 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:49:38.060225 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:49:38.060391 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:49:38.060437 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:38.060438 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:38.061080 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:38.061081 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:38.061558 (+ 477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:38.061560 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:38.061890 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:38.061891 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:38.061951 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:38.062366 (+ 415us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:49:38.062371 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:49:38.063575 (+ 1204us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:49:38.065554 (+ 1979us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:49:38.065554 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:49:38.065555 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:49:38.065756 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:49:38.065966 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:49:38.065967 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:49:38.065967 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:49:38.066030 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:49:38.066294 (+ 264us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:49:38.066295 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:49:38.066345 (+ 50us) client_negotiation.cc:769] Sending connection context
0805 22:49:38.066406 (+ 61us) client_negotiation.cc:240] Negotiation successful
0805 22:49:38.066522 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260805 22:49:38.068145 2810 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e24c28dca2ed47c3b9cda7af8a6b1ce1: Bootstrap starting.
I20260805 22:49:38.068807 2810 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e24c28dca2ed47c3b9cda7af8a6b1ce1: Neither blocks nor log segments found. Creating new log.
I20260805 22:49:38.069090 2810 log.cc:824] T 00000000000000000000000000000000 P e24c28dca2ed47c3b9cda7af8a6b1ce1: Log is configured to *not* fsync() on all Append() calls
I20260805 22:49:38.069855 2810 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e24c28dca2ed47c3b9cda7af8a6b1ce1: No bootstrap required, opened a new log
I20260805 22:49:38.071347 2810 raft_consensus.cc:348] T 00000000000000000000000000000000 P e24c28dca2ed47c3b9cda7af8a6b1ce1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e24c28dca2ed47c3b9cda7af8a6b1ce1" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 37589 } } peers { permanent_uuid: "79a77f8c40fc4c15abf7072221337a3d" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 43849 } } peers { permanent_uuid: "46cad7611cc540fc9d808c1e090978bf" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 33363 } }
I20260805 22:49:38.071471 2810 raft_consensus.cc:374] T 00000000000000000000000000000000 P e24c28dca2ed47c3b9cda7af8a6b1ce1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:49:38.071506 2810 raft_consensus.cc:729] T 00000000000000000000000000000000 P e24c28dca2ed47c3b9cda7af8a6b1ce1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e24c28dca2ed47c3b9cda7af8a6b1ce1, State: Initialized, Role: FOLLOWER
I20260805 22:49:38.071650 2810 consensus_queue.cc:260] T 00000000000000000000000000000000 P e24c28dca2ed47c3b9cda7af8a6b1ce1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e24c28dca2ed47c3b9cda7af8a6b1ce1" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 37589 } } peers { permanent_uuid: "79a77f8c40fc4c15abf7072221337a3d" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 43849 } } peers { permanent_uuid: "46cad7611cc540fc9d808c1e090978bf" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 33363 } }
I20260805 22:49:38.071933 3096 sys_catalog.cc:455] T 00000000000000000000000000000000 P e24c28dca2ed47c3b9cda7af8a6b1ce1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e24c28dca2ed47c3b9cda7af8a6b1ce1" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 37589 } } peers { permanent_uuid: "79a77f8c40fc4c15abf7072221337a3d" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 43849 } } peers { permanent_uuid: "46cad7611cc540fc9d808c1e090978bf" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 33363 } } }
I20260805 22:49:38.071992 2810 sys_catalog.cc:564] T 00000000000000000000000000000000 P e24c28dca2ed47c3b9cda7af8a6b1ce1 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:49:38.072073 3096 sys_catalog.cc:458] T 00000000000000000000000000000000 P e24c28dca2ed47c3b9cda7af8a6b1ce1 [sys.catalog]: This master's current role is: FOLLOWER
W20260805 22:49:38.073805 3113 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e24c28dca2ed47c3b9cda7af8a6b1ce1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260805 22:49:38.073915 3113 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260805 22:49:38.077253 2706 master_runner.cc:263] No leader master found from master e24c28dca2ed47c3b9cda7af8a6b1ce1
I20260805 22:49:38.077308 2706 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260805 22:49:38.108239 3078 raft_consensus.cc:482] T 00000000000000000000000000000000 P 79a77f8c40fc4c15abf7072221337a3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:49:38.108398 3078 raft_consensus.cc:504] T 00000000000000000000000000000000 P 79a77f8c40fc4c15abf7072221337a3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e24c28dca2ed47c3b9cda7af8a6b1ce1" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 37589 } } peers { permanent_uuid: "79a77f8c40fc4c15abf7072221337a3d" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 43849 } } peers { permanent_uuid: "46cad7611cc540fc9d808c1e090978bf" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 33363 } }
I20260805 22:49:38.108666 3078 leader_election.cc:288] T 00000000000000000000000000000000 P 79a77f8c40fc4c15abf7072221337a3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e24c28dca2ed47c3b9cda7af8a6b1ce1 (127.14.224.190:37589), 46cad7611cc540fc9d808c1e090978bf (127.14.224.188:33363)
I20260805 22:49:38.109261 2766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "79a77f8c40fc4c15abf7072221337a3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e24c28dca2ed47c3b9cda7af8a6b1ce1" is_pre_election: true
I20260805 22:49:38.109431 2766 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e24c28dca2ed47c3b9cda7af8a6b1ce1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79a77f8c40fc4c15abf7072221337a3d in term 0.
I20260805 22:49:38.109777 2845 leader_election.cc:302] T 00000000000000000000000000000000 P 79a77f8c40fc4c15abf7072221337a3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79a77f8c40fc4c15abf7072221337a3d, e24c28dca2ed47c3b9cda7af8a6b1ce1; no voters:
I20260805 22:49:38.110030 3078 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 79a77f8c40fc4c15abf7072221337a3d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:49:38.110088 3078 raft_consensus.cc:482] T 00000000000000000000000000000000 P 79a77f8c40fc4c15abf7072221337a3d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:49:38.110110 3078 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 79a77f8c40fc4c15abf7072221337a3d [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:49:38.111047 3078 raft_consensus.cc:504] T 00000000000000000000000000000000 P 79a77f8c40fc4c15abf7072221337a3d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e24c28dca2ed47c3b9cda7af8a6b1ce1" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 37589 } } peers { permanent_uuid: "79a77f8c40fc4c15abf7072221337a3d" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 43849 } } peers { permanent_uuid: "46cad7611cc540fc9d808c1e090978bf" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 33363 } }
I20260805 22:49:38.111183 3078 leader_election.cc:288] T 00000000000000000000000000000000 P 79a77f8c40fc4c15abf7072221337a3d [CANDIDATE]: Term 1 election: Requested vote from peers e24c28dca2ed47c3b9cda7af8a6b1ce1 (127.14.224.190:37589), 46cad7611cc540fc9d808c1e090978bf (127.14.224.188:33363)
I20260805 22:49:38.111557 2766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "79a77f8c40fc4c15abf7072221337a3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e24c28dca2ed47c3b9cda7af8a6b1ce1"
I20260805 22:49:38.111646 2766 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e24c28dca2ed47c3b9cda7af8a6b1ce1 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:49:38.112608 2766 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e24c28dca2ed47c3b9cda7af8a6b1ce1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79a77f8c40fc4c15abf7072221337a3d in term 1.
I20260805 22:49:38.112880 2845 leader_election.cc:302] T 00000000000000000000000000000000 P 79a77f8c40fc4c15abf7072221337a3d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79a77f8c40fc4c15abf7072221337a3d, e24c28dca2ed47c3b9cda7af8a6b1ce1; no voters:
I20260805 22:49:38.113304 2987 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "79a77f8c40fc4c15abf7072221337a3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46cad7611cc540fc9d808c1e090978bf"
I20260805 22:49:38.113464 2987 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 46cad7611cc540fc9d808c1e090978bf [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:49:38.114269 3078 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 79a77f8c40fc4c15abf7072221337a3d [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:49:38.114398 2987 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 46cad7611cc540fc9d808c1e090978bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79a77f8c40fc4c15abf7072221337a3d in term 1.
I20260805 22:49:38.114436 3078 raft_consensus.cc:686] T 00000000000000000000000000000000 P 79a77f8c40fc4c15abf7072221337a3d [term 1 LEADER]: Becoming Leader. State: Replica: 79a77f8c40fc4c15abf7072221337a3d, State: Running, Role: LEADER
I20260805 22:49:38.114537 3078 consensus_queue.cc:237] T 00000000000000000000000000000000 P 79a77f8c40fc4c15abf7072221337a3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e24c28dca2ed47c3b9cda7af8a6b1ce1" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 37589 } } peers { permanent_uuid: "79a77f8c40fc4c15abf7072221337a3d" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 43849 } } peers { permanent_uuid: "46cad7611cc540fc9d808c1e090978bf" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 33363 } }
W20260805 22:49:38.114620 2737 tablet.cc:2369] T 00000000000000000000000000000000 P e24c28dca2ed47c3b9cda7af8a6b1ce1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:49:38.113318 2989 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "79a77f8c40fc4c15abf7072221337a3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46cad7611cc540fc9d808c1e090978bf" is_pre_election: true
I20260805 22:49:38.114951 2989 raft_consensus.cc:2362] T 00000000000000000000000000000000 P 46cad7611cc540fc9d808c1e090978bf [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 79a77f8c40fc4c15abf7072221337a3d in term 1. Re-sending same reply.
I20260805 22:49:38.114939 3078 sys_catalog.cc:455] T 00000000000000000000000000000000 P 79a77f8c40fc4c15abf7072221337a3d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 79a77f8c40fc4c15abf7072221337a3d. Latest consensus state: current_term: 1 leader_uuid: "79a77f8c40fc4c15abf7072221337a3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e24c28dca2ed47c3b9cda7af8a6b1ce1" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 37589 } } peers { permanent_uuid: "79a77f8c40fc4c15abf7072221337a3d" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 43849 } } peers { permanent_uuid: "46cad7611cc540fc9d808c1e090978bf" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 33363 } } }
I20260805 22:49:38.115029 3078 sys_catalog.cc:458] T 00000000000000000000000000000000 P 79a77f8c40fc4c15abf7072221337a3d [sys.catalog]: This master's current role is: LEADER
I20260805 22:49:38.116039 3121 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:49:38.116266 3121 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:49:38.118337 2989 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 46cad7611cc540fc9d808c1e090978bf [term 1 FOLLOWER]: Refusing update from remote peer 79a77f8c40fc4c15abf7072221337a3d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:49:38.118497 2766 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e24c28dca2ed47c3b9cda7af8a6b1ce1 [term 1 FOLLOWER]: Refusing update from remote peer 79a77f8c40fc4c15abf7072221337a3d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:49:38.118793 3078 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 79a77f8c40fc4c15abf7072221337a3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "46cad7611cc540fc9d808c1e090978bf" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:49:38.119150 3078 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 79a77f8c40fc4c15abf7072221337a3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e24c28dca2ed47c3b9cda7af8a6b1ce1" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 37589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:49:38.120679 3096 sys_catalog.cc:455] T 00000000000000000000000000000000 P e24c28dca2ed47c3b9cda7af8a6b1ce1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 79a77f8c40fc4c15abf7072221337a3d. Latest consensus state: current_term: 1 leader_uuid: "79a77f8c40fc4c15abf7072221337a3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e24c28dca2ed47c3b9cda7af8a6b1ce1" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 37589 } } peers { permanent_uuid: "79a77f8c40fc4c15abf7072221337a3d" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 43849 } } peers { permanent_uuid: "46cad7611cc540fc9d808c1e090978bf" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 33363 } } }
I20260805 22:49:38.120779 3096 sys_catalog.cc:458] T 00000000000000000000000000000000 P e24c28dca2ed47c3b9cda7af8a6b1ce1 [sys.catalog]: This master's current role is: FOLLOWER
I20260805 22:49:38.122010 3048 sys_catalog.cc:455] T 00000000000000000000000000000000 P 46cad7611cc540fc9d808c1e090978bf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 79a77f8c40fc4c15abf7072221337a3d. Latest consensus state: current_term: 1 leader_uuid: "79a77f8c40fc4c15abf7072221337a3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e24c28dca2ed47c3b9cda7af8a6b1ce1" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 37589 } } peers { permanent_uuid: "79a77f8c40fc4c15abf7072221337a3d" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 43849 } } peers { permanent_uuid: "46cad7611cc540fc9d808c1e090978bf" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 33363 } } }
I20260805 22:49:38.122128 3048 sys_catalog.cc:458] T 00000000000000000000000000000000 P 46cad7611cc540fc9d808c1e090978bf [sys.catalog]: This master's current role is: FOLLOWER
I20260805 22:49:38.124128 3078 sys_catalog.cc:455] T 00000000000000000000000000000000 P 79a77f8c40fc4c15abf7072221337a3d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "79a77f8c40fc4c15abf7072221337a3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e24c28dca2ed47c3b9cda7af8a6b1ce1" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 37589 } } peers { permanent_uuid: "79a77f8c40fc4c15abf7072221337a3d" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 43849 } } peers { permanent_uuid: "46cad7611cc540fc9d808c1e090978bf" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 33363 } } }
I20260805 22:49:38.124230 3078 sys_catalog.cc:458] T 00000000000000000000000000000000 P 79a77f8c40fc4c15abf7072221337a3d [sys.catalog]: This master's current role is: LEADER
I20260805 22:49:38.124833 3048 sys_catalog.cc:455] T 00000000000000000000000000000000 P 46cad7611cc540fc9d808c1e090978bf [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "79a77f8c40fc4c15abf7072221337a3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e24c28dca2ed47c3b9cda7af8a6b1ce1" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 37589 } } peers { permanent_uuid: "79a77f8c40fc4c15abf7072221337a3d" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 43849 } } peers { permanent_uuid: "46cad7611cc540fc9d808c1e090978bf" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 33363 } } }
I20260805 22:49:38.124920 3048 sys_catalog.cc:458] T 00000000000000000000000000000000 P 46cad7611cc540fc9d808c1e090978bf [sys.catalog]: This master's current role is: FOLLOWER
I20260805 22:49:38.125146 3122 mvcc.cc:205] Tried to move back new op lower bound from 7315333849570164736 to 7315333849557635072. Current Snapshot: MvccSnapshot[applied={T|T < 7315333849570164736}]
I20260805 22:49:38.125365 3127 mvcc.cc:205] Tried to move back new op lower bound from 7315333849570164736 to 7315333849557635072. Current Snapshot: MvccSnapshot[applied={T|T < 7315333849570164736}]
I20260805 22:49:38.125761 3078 sys_catalog.cc:455] T 00000000000000000000000000000000 P 79a77f8c40fc4c15abf7072221337a3d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "79a77f8c40fc4c15abf7072221337a3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e24c28dca2ed47c3b9cda7af8a6b1ce1" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 37589 } } peers { permanent_uuid: "79a77f8c40fc4c15abf7072221337a3d" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 43849 } } peers { permanent_uuid: "46cad7611cc540fc9d808c1e090978bf" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 33363 } } }
I20260805 22:49:38.125839 3078 sys_catalog.cc:458] T 00000000000000000000000000000000 P 79a77f8c40fc4c15abf7072221337a3d [sys.catalog]: This master's current role is: LEADER
I20260805 22:49:38.126240 3096 sys_catalog.cc:455] T 00000000000000000000000000000000 P e24c28dca2ed47c3b9cda7af8a6b1ce1 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "79a77f8c40fc4c15abf7072221337a3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e24c28dca2ed47c3b9cda7af8a6b1ce1" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 37589 } } peers { permanent_uuid: "79a77f8c40fc4c15abf7072221337a3d" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 43849 } } peers { permanent_uuid: "46cad7611cc540fc9d808c1e090978bf" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 33363 } } }
I20260805 22:49:38.126330 3096 sys_catalog.cc:458] T 00000000000000000000000000000000 P e24c28dca2ed47c3b9cda7af8a6b1ce1 [sys.catalog]: This master's current role is: FOLLOWER
I20260805 22:49:38.127038 3123 mvcc.cc:205] Tried to move back new op lower bound from 7315333849570164736 to 7315333849557635072. Current Snapshot: MvccSnapshot[applied={T|T < 7315333849570164736}]
I20260805 22:49:38.128070 3121 catalog_manager.cc:1347] Generated new cluster ID: 8232e6190d9942bebb2af326b1792880
I20260805 22:49:38.128121 3121 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:49:38.161353 3121 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:49:38.162261 3121 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:49:38.170794 3121 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 79a77f8c40fc4c15abf7072221337a3d: Generated new TSK 0
I20260805 22:49:38.171144 3121 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:49:39.007038 3066 catalog_manager.cc:1259] Loaded cluster ID: 8232e6190d9942bebb2af326b1792880
I20260805 22:49:39.007131 3066 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 46cad7611cc540fc9d808c1e090978bf: loading cluster ID for follower catalog manager: success
I20260805 22:49:39.007990 3066 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 46cad7611cc540fc9d808c1e090978bf: acquiring CA information for follower catalog manager: success
I20260805 22:49:39.008313 3066 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 46cad7611cc540fc9d808c1e090978bf: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260805 22:49:39.074434 3113 catalog_manager.cc:1259] Loaded cluster ID: 8232e6190d9942bebb2af326b1792880
I20260805 22:49:39.074517 3113 catalog_manager.cc:1552] T 00000000000000000000000000000000 P e24c28dca2ed47c3b9cda7af8a6b1ce1: loading cluster ID for follower catalog manager: success
I20260805 22:49:39.075331 3113 catalog_manager.cc:1574] T 00000000000000000000000000000000 P e24c28dca2ed47c3b9cda7af8a6b1ce1: acquiring CA information for follower catalog manager: success
I20260805 22:49:39.075649 3113 catalog_manager.cc:1602] T 00000000000000000000000000000000 P e24c28dca2ed47c3b9cda7af8a6b1ce1: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260805 22:49:39.226042 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 2706
I20260805 22:49:39.237735 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 2819
I20260805 22:49:39.253944 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 2925
2026-08-05T22:49:39Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3058 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970021300824-15234-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:49:39 dist-test-slave-gjrz krb5kdc[3142](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:49:39 dist-test-slave-gjrz krb5kdc[3142](info): set up 2 sockets
Aug 05 22:49:39 dist-test-slave-gjrz krb5kdc[3142](info): commencing operation
krb5kdc: starting...
W20260805 22:49:40.392282 15234 mini_kdc.cc:121] Time spent starting KDC: real 1.113s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Aug 05 22:49:40 dist-test-slave-gjrz krb5kdc[3142](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970180, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:49:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:49:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.224.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab.
Entry for principal kudu/127.14.224.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab.
I20260805 22:49:40.519991 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970021300824-15234-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970021300824-15234-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970021300824-15234-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:36645
--webserver_interface=127.14.224.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:43307
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.224.190:36645
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:49:40.604378 3166 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:49:40.604604 3166 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:49:40.604627 3166 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:49:40.605824 3166 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:49:40.605865 3166 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:49:40.605880 3166 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:49:40.605890 3166 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:49:40.605901 3166 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:49:40.607398 3166 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:43307
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970021300824-15234-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970021300824-15234-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.224.190:36645
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:36645
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.224.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3166
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970021300824-15234-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:49:40.607605 3166 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:49:40.607788 3166 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:49:40.612669 3173 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:49:40.612715 3174 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:49:40.612697 3166 server_base.cc:1034] running on GCE node
W20260805 22:49:40.612810 3176 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:49:40.613215 3166 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:49:40.613531 3166 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:49:40.614704 3166 hybrid_clock.cc:648] HybridClock initialized: now 1785970180614687 us; error 32 us; skew 500 ppm
Aug 05 22:49:40 dist-test-slave-gjrz krb5kdc[3142](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970180, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:49:40.617383 3166 init.cc:377] Logged in from keytab as kudu/127.14.224.190@KRBTEST.COM (short username kudu)
I20260805 22:49:40.617870 3166 webserver.cc:460] Webserver started at http://127.14.224.190:43057/ using document root <none> and password file <none>
I20260805 22:49:40.618072 3166 fs_manager.cc:359] Metadata directory not provided
I20260805 22:49:40.618114 3166 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:49:40.618211 3166 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:49:40.619335 3166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970021300824-15234-0/minicluster-data/master-0/data/instance:
uuid: "b5b2d2f01f344894b8ff9e81e7db6ffd"
format_stamp: "Formatted at 2026-08-05 22:49:40 on dist-test-slave-gjrz"
server_key: "0f1614dff8c380a6abfa528458f2ace5"
server_key_iv: "e76d53758817c678e367d05b4571b260"
server_key_version: "encryptionkey@0"
I20260805 22:49:40.619660 3166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970021300824-15234-0/minicluster-data/master-0/wal/instance:
uuid: "b5b2d2f01f344894b8ff9e81e7db6ffd"
format_stamp: "Formatted at 2026-08-05 22:49:40 on dist-test-slave-gjrz"
server_key: "0f1614dff8c380a6abfa528458f2ace5"
server_key_iv: "e76d53758817c678e367d05b4571b260"
server_key_version: "encryptionkey@0"
I20260805 22:49:40.620929 3166 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:49:40.621742 3184 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:49:40.621932 3166 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:49:40.622040 3166 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970021300824-15234-0/minicluster-data/master-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970021300824-15234-0/minicluster-data/master-0/wal
uuid: "b5b2d2f01f344894b8ff9e81e7db6ffd"
format_stamp: "Formatted at 2026-08-05 22:49:40 on dist-test-slave-gjrz"
server_key: "0f1614dff8c380a6abfa528458f2ace5"
server_key_iv: "e76d53758817c678e367d05b4571b260"
server_key_version: "encryptionkey@0"
I20260805 22:49:40.622117 3166 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970021300824-15234-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970021300824-15234-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970021300824-15234-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:49:40.644187 3166 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:49:40.646209 3166 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:49:40.646330 3166 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:49:40.650321 3166 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.190:36645
I20260805 22:49:40.650380 3263 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.190:36645 every 8 connection(s)
I20260805 22:49:40.650734 3166 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
I20260805 22:49:40.651690 3264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:49:40.654098 3264 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b5b2d2f01f344894b8ff9e81e7db6ffd: Bootstrap starting.
I20260805 22:49:40.654695 3264 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b5b2d2f01f344894b8ff9e81e7db6ffd: Neither blocks nor log segments found. Creating new log.
I20260805 22:49:40.654965 3264 log.cc:824] T 00000000000000000000000000000000 P b5b2d2f01f344894b8ff9e81e7db6ffd: Log is configured to *not* fsync() on all Append() calls
I20260805 22:49:40.655717 3264 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b5b2d2f01f344894b8ff9e81e7db6ffd: No bootstrap required, opened a new log
I20260805 22:49:40.655907 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 3166
I20260805 22:49:40.656018 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970021300824-15234-0/minicluster-data/master-0/wal/instance
I20260805 22:49:40.656226 15234 external_mini_cluster.cc:1428] Setting key 253c3ef5d2e9aa8c81d078ae72d886cf
I20260805 22:49:40.657742 3264 raft_consensus.cc:348] T 00000000000000000000000000000000 P b5b2d2f01f344894b8ff9e81e7db6ffd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5b2d2f01f344894b8ff9e81e7db6ffd" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 36645 } }
I20260805 22:49:40.657899 3264 raft_consensus.cc:374] T 00000000000000000000000000000000 P b5b2d2f01f344894b8ff9e81e7db6ffd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:49:40.657935 3264 raft_consensus.cc:729] T 00000000000000000000000000000000 P b5b2d2f01f344894b8ff9e81e7db6ffd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5b2d2f01f344894b8ff9e81e7db6ffd, State: Initialized, Role: FOLLOWER
I20260805 22:49:40.658066 3264 consensus_queue.cc:260] T 00000000000000000000000000000000 P b5b2d2f01f344894b8ff9e81e7db6ffd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5b2d2f01f344894b8ff9e81e7db6ffd" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 36645 } }
I20260805 22:49:40.658156 3264 raft_consensus.cc:388] T 00000000000000000000000000000000 P b5b2d2f01f344894b8ff9e81e7db6ffd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:49:40.658188 3264 raft_consensus.cc:482] T 00000000000000000000000000000000 P b5b2d2f01f344894b8ff9e81e7db6ffd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:49:40.658228 3264 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b5b2d2f01f344894b8ff9e81e7db6ffd [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:49:40.659253 3264 raft_consensus.cc:504] T 00000000000000000000000000000000 P b5b2d2f01f344894b8ff9e81e7db6ffd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5b2d2f01f344894b8ff9e81e7db6ffd" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 36645 } }
I20260805 22:49:40.659389 3264 leader_election.cc:302] T 00000000000000000000000000000000 P b5b2d2f01f344894b8ff9e81e7db6ffd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b5b2d2f01f344894b8ff9e81e7db6ffd; no voters:
I20260805 22:49:40.659565 3264 leader_election.cc:288] T 00000000000000000000000000000000 P b5b2d2f01f344894b8ff9e81e7db6ffd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:49:40.659596 3272 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b5b2d2f01f344894b8ff9e81e7db6ffd [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:49:40.659746 3272 raft_consensus.cc:686] T 00000000000000000000000000000000 P b5b2d2f01f344894b8ff9e81e7db6ffd [term 1 LEADER]: Becoming Leader. State: Replica: b5b2d2f01f344894b8ff9e81e7db6ffd, State: Running, Role: LEADER
I20260805 22:49:40.659842 3264 sys_catalog.cc:564] T 00000000000000000000000000000000 P b5b2d2f01f344894b8ff9e81e7db6ffd [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:49:40.659912 3272 consensus_queue.cc:237] T 00000000000000000000000000000000 P b5b2d2f01f344894b8ff9e81e7db6ffd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5b2d2f01f344894b8ff9e81e7db6ffd" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 36645 } }
I20260805 22:49:40.660283 3272 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5b2d2f01f344894b8ff9e81e7db6ffd [sys.catalog]: SysCatalogTable state changed. Reason: New leader b5b2d2f01f344894b8ff9e81e7db6ffd. Latest consensus state: current_term: 1 leader_uuid: "b5b2d2f01f344894b8ff9e81e7db6ffd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5b2d2f01f344894b8ff9e81e7db6ffd" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 36645 } } }
I20260805 22:49:40.660420 3272 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5b2d2f01f344894b8ff9e81e7db6ffd [sys.catalog]: This master's current role is: LEADER
I20260805 22:49:40.660668 3284 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:49:40.661199 3284 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:49:40.662031 3274 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5b2d2f01f344894b8ff9e81e7db6ffd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b5b2d2f01f344894b8ff9e81e7db6ffd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5b2d2f01f344894b8ff9e81e7db6ffd" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 36645 } } }
I20260805 22:49:40.662122 3274 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5b2d2f01f344894b8ff9e81e7db6ffd [sys.catalog]: This master's current role is: LEADER
Aug 05 22:49:40 dist-test-slave-gjrz krb5kdc[3142](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970180, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:49:40.667201 3271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:40.656755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54926 (local address 127.14.224.190:36645)
0805 22:49:40.656937 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0805 22:49:40.656947 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:49:40.656974 (+ 27us) server_negotiation.cc:407] Connection header received
0805 22:49:40.657721 (+ 747us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:49:40.657730 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:49:40.657789 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:49:40.657924 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:49:40.658753 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:40.659885 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:40.660878 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:40.661426 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:40.661533 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:40.664123 (+ 2590us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:49:40.664127 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:49:40.664128 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:49:40.664142 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:49:40.665711 (+ 1569us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:40.666055 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:40.666058 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:40.666059 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:40.666166 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:40.666348 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:40.666349 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:40.666349 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:40.666610 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:49:40.666763 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0805 22:49:40.666878 (+ 115us) server_negotiation.cc:299] Negotiation successful
0805 22:49:40.667029 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":81,"threads_started":1}
I20260805 22:49:40.668416 15234 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:49:40.671777 3284 catalog_manager.cc:1347] Generated new cluster ID: 32e222db293b4fe68cdd3e4aae95ee40
I20260805 22:49:40.671852 3284 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:49:40.712198 3284 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:49:40.712746 3284 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:49:40.719169 3284 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b5b2d2f01f344894b8ff9e81e7db6ffd: Generated new TSK 0
I20260805 22:49:40.719403 3284 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:49:40.722076 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 3166
2026-08-05T22:49:40Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1472 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:49:40 dist-test-slave-gjrz krb5kdc[3301](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:49:40 dist-test-slave-gjrz krb5kdc[3301](info): set up 2 sockets
Aug 05 22:49:40 dist-test-slave-gjrz krb5kdc[3301](info): commencing operation
krb5kdc: starting...
W20260805 22:49:41.858335 15234 mini_kdc.cc:121] Time spent starting KDC: real 1.107s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Aug 05 22:49:41 dist-test-slave-gjrz krb5kdc[3301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970181, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:49:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:49:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.224.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab.
Entry for principal kudu/127.14.224.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab.
I20260805 22:49:41.985836 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:35779
--webserver_interface=127.14.224.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:38473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.224.190:35779
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:49:42.068980 3319 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:49:42.069216 3319 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:49:42.069249 3319 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:49:42.070451 3319 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:49:42.070501 3319 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:49:42.070519 3319 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:49:42.070536 3319 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:49:42.070551 3319 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:49:42.072172 3319 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:38473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.224.190:35779
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:35779
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.224.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3319
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:49:42.072461 3319 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:49:42.072685 3319 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:49:42.077785 3329 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:49:42.077754 3327 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:49:42.078156 3331 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:49:42.077785 3319 server_base.cc:1034] running on GCE node
I20260805 22:49:42.078464 3319 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:49:42.078801 3319 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:49:42.079974 3319 hybrid_clock.cc:648] HybridClock initialized: now 1785970182079952 us; error 39 us; skew 500 ppm
Aug 05 22:49:42 dist-test-slave-gjrz krb5kdc[3301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970182, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:49:42.082556 3319 init.cc:377] Logged in from keytab as kudu/127.14.224.190@KRBTEST.COM (short username kudu)
I20260805 22:49:42.083074 3319 webserver.cc:460] Webserver started at http://127.14.224.190:39189/ using document root <none> and password file <none>
I20260805 22:49:42.083330 3319 fs_manager.cc:359] Metadata directory not provided
I20260805 22:49:42.083379 3319 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:49:42.083513 3319 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:49:42.084623 3319 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/master-0/data/instance:
uuid: "52b0fdfef10048eb80deb2aaf54a2937"
format_stamp: "Formatted at 2026-08-05 22:49:42 on dist-test-slave-gjrz"
server_key: "1be9175a25229606d261ba6657401943"
server_key_iv: "263969b7ac6e3e1ddf031b2b509ba24a"
server_key_version: "encryptionkey@0"
I20260805 22:49:42.084985 3319 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/master-0/wal/instance:
uuid: "52b0fdfef10048eb80deb2aaf54a2937"
format_stamp: "Formatted at 2026-08-05 22:49:42 on dist-test-slave-gjrz"
server_key: "1be9175a25229606d261ba6657401943"
server_key_iv: "263969b7ac6e3e1ddf031b2b509ba24a"
server_key_version: "encryptionkey@0"
I20260805 22:49:42.086285 3319 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260805 22:49:42.087054 3339 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:49:42.087229 3319 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:49:42.087344 3319 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/master-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/master-0/wal
uuid: "52b0fdfef10048eb80deb2aaf54a2937"
format_stamp: "Formatted at 2026-08-05 22:49:42 on dist-test-slave-gjrz"
server_key: "1be9175a25229606d261ba6657401943"
server_key_iv: "263969b7ac6e3e1ddf031b2b509ba24a"
server_key_version: "encryptionkey@0"
I20260805 22:49:42.087410 3319 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:49:42.108729 3319 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:49:42.110913 3319 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:49:42.111033 3319 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:49:42.114979 3319 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.190:35779
I20260805 22:49:42.115056 3414 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.190:35779 every 8 connection(s)
I20260805 22:49:42.115393 3319 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
I20260805 22:49:42.116420 3417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:49:42.118848 3417 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 52b0fdfef10048eb80deb2aaf54a2937: Bootstrap starting.
I20260805 22:49:42.119691 3417 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 52b0fdfef10048eb80deb2aaf54a2937: Neither blocks nor log segments found. Creating new log.
I20260805 22:49:42.119992 3417 log.cc:824] T 00000000000000000000000000000000 P 52b0fdfef10048eb80deb2aaf54a2937: Log is configured to *not* fsync() on all Append() calls
I20260805 22:49:42.120800 3417 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 52b0fdfef10048eb80deb2aaf54a2937: No bootstrap required, opened a new log
I20260805 22:49:42.121685 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 3319
I20260805 22:49:42.121797 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/master-0/wal/instance
I20260805 22:49:42.121997 15234 external_mini_cluster.cc:1428] Setting key 31c33d700f08bc2cf84b904c7d6a3369
I20260805 22:49:42.122766 3417 raft_consensus.cc:348] T 00000000000000000000000000000000 P 52b0fdfef10048eb80deb2aaf54a2937 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52b0fdfef10048eb80deb2aaf54a2937" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 35779 } }
I20260805 22:49:42.122934 3417 raft_consensus.cc:374] T 00000000000000000000000000000000 P 52b0fdfef10048eb80deb2aaf54a2937 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:49:42.122969 3417 raft_consensus.cc:729] T 00000000000000000000000000000000 P 52b0fdfef10048eb80deb2aaf54a2937 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52b0fdfef10048eb80deb2aaf54a2937, State: Initialized, Role: FOLLOWER
I20260805 22:49:42.123104 3417 consensus_queue.cc:260] T 00000000000000000000000000000000 P 52b0fdfef10048eb80deb2aaf54a2937 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52b0fdfef10048eb80deb2aaf54a2937" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 35779 } }
I20260805 22:49:42.123185 3417 raft_consensus.cc:388] T 00000000000000000000000000000000 P 52b0fdfef10048eb80deb2aaf54a2937 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:49:42.123246 3417 raft_consensus.cc:482] T 00000000000000000000000000000000 P 52b0fdfef10048eb80deb2aaf54a2937 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:49:42.123344 3417 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 52b0fdfef10048eb80deb2aaf54a2937 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:49:42.123948 3417 raft_consensus.cc:504] T 00000000000000000000000000000000 P 52b0fdfef10048eb80deb2aaf54a2937 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52b0fdfef10048eb80deb2aaf54a2937" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 35779 } }
I20260805 22:49:42.124053 3417 leader_election.cc:302] T 00000000000000000000000000000000 P 52b0fdfef10048eb80deb2aaf54a2937 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 52b0fdfef10048eb80deb2aaf54a2937; no voters:
I20260805 22:49:42.124233 3417 leader_election.cc:288] T 00000000000000000000000000000000 P 52b0fdfef10048eb80deb2aaf54a2937 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:49:42.124285 3424 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 52b0fdfef10048eb80deb2aaf54a2937 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:49:42.124441 3424 raft_consensus.cc:686] T 00000000000000000000000000000000 P 52b0fdfef10048eb80deb2aaf54a2937 [term 1 LEADER]: Becoming Leader. State: Replica: 52b0fdfef10048eb80deb2aaf54a2937, State: Running, Role: LEADER
I20260805 22:49:42.124529 3424 consensus_queue.cc:237] T 00000000000000000000000000000000 P 52b0fdfef10048eb80deb2aaf54a2937 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52b0fdfef10048eb80deb2aaf54a2937" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 35779 } }
I20260805 22:49:42.124522 3417 sys_catalog.cc:564] T 00000000000000000000000000000000 P 52b0fdfef10048eb80deb2aaf54a2937 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:49:42.124917 3427 sys_catalog.cc:455] T 00000000000000000000000000000000 P 52b0fdfef10048eb80deb2aaf54a2937 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 52b0fdfef10048eb80deb2aaf54a2937. Latest consensus state: current_term: 1 leader_uuid: "52b0fdfef10048eb80deb2aaf54a2937" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52b0fdfef10048eb80deb2aaf54a2937" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 35779 } } }
I20260805 22:49:42.124924 3426 sys_catalog.cc:455] T 00000000000000000000000000000000 P 52b0fdfef10048eb80deb2aaf54a2937 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "52b0fdfef10048eb80deb2aaf54a2937" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52b0fdfef10048eb80deb2aaf54a2937" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 35779 } } }
I20260805 22:49:42.125036 3427 sys_catalog.cc:458] T 00000000000000000000000000000000 P 52b0fdfef10048eb80deb2aaf54a2937 [sys.catalog]: This master's current role is: LEADER
I20260805 22:49:42.125042 3426 sys_catalog.cc:458] T 00000000000000000000000000000000 P 52b0fdfef10048eb80deb2aaf54a2937 [sys.catalog]: This master's current role is: LEADER
I20260805 22:49:42.125332 3432 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:49:42.125901 3432 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:49:42.127676 3432 catalog_manager.cc:1347] Generated new cluster ID: ecf25561117c49b8abe675bcab2d7977
I20260805 22:49:42.127732 3432 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 05 22:49:42 dist-test-slave-gjrz krb5kdc[3301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970181, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:49:42.134039 3423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:42.122607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40786 (local address 127.14.224.190:35779)
0805 22:49:42.122785 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0805 22:49:42.122794 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:49:42.122821 (+ 27us) server_negotiation.cc:407] Connection header received
0805 22:49:42.122927 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:49:42.122933 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:49:42.122992 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:49:42.123142 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:49:42.123910 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:42.125096 (+ 1186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:42.126197 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:42.126791 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:42.126904 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:42.129859 (+ 2955us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:49:42.129865 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:49:42.129865 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:49:42.129880 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:49:42.131925 (+ 2045us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:42.132365 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:42.132369 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:42.132369 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:42.132503 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:42.132685 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:42.132685 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:42.132686 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:42.132996 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:49:42.133149 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0805 22:49:42.133659 (+ 510us) server_negotiation.cc:299] Negotiation successful
0805 22:49:42.133807 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":77,"threads_started":1}
I20260805 22:49:42.143906 3432 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:49:42.144706 3432 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:49:42.154966 3432 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 52b0fdfef10048eb80deb2aaf54a2937: Generated new TSK 0
I20260805 22:49:42.155202 3432 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.224.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab.
Entry for principal kudu/127.14.224.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab.
I20260805 22:49:42.190155 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.129:0
--local_ip_for_outbound_sockets=127.14.224.129
--webserver_interface=127.14.224.129
--webserver_port=0
--tserver_master_addrs=127.14.224.190:35779
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab
--principal=kudu/127.14.224.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:38473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:49:42.275303 3463 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:49:42.275516 3463 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:49:42.275539 3463 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:49:42.276739 3463 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:49:42.276788 3463 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:49:42.276815 3463 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.129
I20260805 22:49:42.278299 3463 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:38473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab
--principal=kudu/127.14.224.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.224.129
--webserver_port=0
--tserver_master_addrs=127.14.224.190:35779
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3463
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.129
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:49:42.278544 3463 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:49:42.278785 3463 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:49:42.284075 3468 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:49:42.284158 3463 server_base.cc:1034] running on GCE node
W20260805 22:49:42.284070 3473 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:49:42.284075 3469 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:49:42.284493 3463 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:49:42.284759 3463 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:49:42.285919 3463 hybrid_clock.cc:648] HybridClock initialized: now 1785970182285906 us; error 27 us; skew 500 ppm
Aug 05 22:49:42 dist-test-slave-gjrz krb5kdc[3301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970182, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:49:42.288568 3463 init.cc:377] Logged in from keytab as kudu/127.14.224.129@KRBTEST.COM (short username kudu)
I20260805 22:49:42.289043 3463 webserver.cc:460] Webserver started at http://127.14.224.129:43893/ using document root <none> and password file <none>
I20260805 22:49:42.289279 3463 fs_manager.cc:359] Metadata directory not provided
I20260805 22:49:42.289325 3463 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:49:42.289434 3463 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:49:42.290503 3463 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-0/data/instance:
uuid: "ad7b0e4ee79f423c8466b1746b3e08e3"
format_stamp: "Formatted at 2026-08-05 22:49:42 on dist-test-slave-gjrz"
server_key: "3cdf7cc4a506f496cabcc6e5863c9c86"
server_key_iv: "d7b20b397c2dc717707b2f1522c74bff"
server_key_version: "encryptionkey@0"
I20260805 22:49:42.290858 3463 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-0/wal/instance:
uuid: "ad7b0e4ee79f423c8466b1746b3e08e3"
format_stamp: "Formatted at 2026-08-05 22:49:42 on dist-test-slave-gjrz"
server_key: "3cdf7cc4a506f496cabcc6e5863c9c86"
server_key_iv: "d7b20b397c2dc717707b2f1522c74bff"
server_key_version: "encryptionkey@0"
I20260805 22:49:42.292354 3463 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260805 22:49:42.293154 3481 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:49:42.293331 3463 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:49:42.293421 3463 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-0/wal
uuid: "ad7b0e4ee79f423c8466b1746b3e08e3"
format_stamp: "Formatted at 2026-08-05 22:49:42 on dist-test-slave-gjrz"
server_key: "3cdf7cc4a506f496cabcc6e5863c9c86"
server_key_iv: "d7b20b397c2dc717707b2f1522c74bff"
server_key_version: "encryptionkey@0"
I20260805 22:49:42.293481 3463 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:49:42.313436 3463 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:49:42.315526 3463 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:49:42.315682 3463 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:49:42.315927 3463 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:49:42.316246 3463 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:49:42.316282 3463 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:49:42.316313 3463 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:49:42.316336 3463 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:49:42.322454 3463 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.129:35089
I20260805 22:49:42.322511 3670 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.129:35089 every 8 connection(s)
I20260805 22:49:42.322861 3463 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
I20260805 22:49:42.326493 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 3463
I20260805 22:49:42.326618 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-0/wal/instance
I20260805 22:49:42.326825 15234 external_mini_cluster.cc:1428] Setting key 16f556ee8f2cdebce096eccfac16b6ac
Aug 05 22:49:42 dist-test-slave-gjrz krb5kdc[3301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970182, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.129@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:49:42.332892 3423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:42.323623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.129:45511 (local address 127.14.224.190:35779)
0805 22:49:42.323688 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0805 22:49:42.323690 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:49:42.323878 (+ 188us) server_negotiation.cc:407] Connection header received
0805 22:49:42.324407 (+ 529us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:49:42.324408 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:49:42.324422 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:49:42.324468 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:49:42.325566 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:42.326156 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:42.327426 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:42.327714 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:42.327791 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:42.330017 (+ 2226us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:49:42.330018 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:49:42.330019 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:49:42.330026 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:49:42.331503 (+ 1477us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:42.331908 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:42.331909 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:42.331909 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:42.331979 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:42.332205 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:42.332206 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:42.332207 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:42.332366 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:49:42.332447 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0805 22:49:42.332694 (+ 247us) server_negotiation.cc:299] Negotiation successful
0805 22:49:42.332794 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260805 22:49:42.332999 3673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:42.323583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:35779 (local address 127.14.224.129:45511)
0805 22:49:42.323750 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:42.323796 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0805 22:49:42.324300 (+ 504us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:49:42.324525 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:49:42.324529 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:49:42.325183 (+ 654us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:49:42.325397 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:42.325404 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:42.326274 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:42.326275 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:42.327365 (+ 1090us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:42.327368 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:42.327796 (+ 428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:42.327797 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:42.327908 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:42.328412 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:49:42.328420 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:49:42.329895 (+ 1475us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:49:42.331585 (+ 1690us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:49:42.331596 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:49:42.331598 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:49:42.331831 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:49:42.332036 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:49:42.332037 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:49:42.332037 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:49:42.332150 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:49:42.332431 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:49:42.332434 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:49:42.332555 (+ 121us) client_negotiation.cc:769] Sending connection context
0805 22:49:42.332660 (+ 105us) client_negotiation.cc:240] Negotiation successful
0805 22:49:42.332812 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":92,"threads_started":1}
I20260805 22:49:42.333545 3671 heartbeater.cc:347] Connected to a master server at 127.14.224.190:35779
I20260805 22:49:42.333647 3671 heartbeater.cc:464] Registering TS with master...
I20260805 22:49:42.333828 3671 heartbeater.cc:511] Master 127.14.224.190:35779 requested a full tablet report, sending...
I20260805 22:49:42.334491 3366 ts_manager.cc:194] Registered new tserver with Master: ad7b0e4ee79f423c8466b1746b3e08e3 (127.14.224.129:35089)
I20260805 22:49:42.335441 3366 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.224.129@KRBTEST.COM'} at 127.14.224.129:45511
WARNING: no policy specified for kudu/127.14.224.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab.
Entry for principal kudu/127.14.224.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab.
I20260805 22:49:42.356621 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.130:0
--local_ip_for_outbound_sockets=127.14.224.130
--webserver_interface=127.14.224.130
--webserver_port=0
--tserver_master_addrs=127.14.224.190:35779
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab
--principal=kudu/127.14.224.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:38473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:49:42.441468 3679 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:49:42.441720 3679 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:49:42.441745 3679 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:49:42.443076 3679 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:49:42.443136 3679 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:49:42.443167 3679 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.130
I20260805 22:49:42.444852 3679 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:38473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab
--principal=kudu/127.14.224.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.224.130
--webserver_port=0
--tserver_master_addrs=127.14.224.190:35779
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3679
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.130
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:49:42.445106 3679 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:49:42.445353 3679 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:49:42.450991 3690 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:49:42.451073 3679 server_base.cc:1034] running on GCE node
W20260805 22:49:42.451035 3692 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:49:42.451159 3696 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:49:42.451433 3679 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:49:42.451685 3679 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:49:42.452853 3679 hybrid_clock.cc:648] HybridClock initialized: now 1785970182452841 us; error 28 us; skew 500 ppm
Aug 05 22:49:42 dist-test-slave-gjrz krb5kdc[3301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970182, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:49:42.455480 3679 init.cc:377] Logged in from keytab as kudu/127.14.224.130@KRBTEST.COM (short username kudu)
I20260805 22:49:42.455965 3679 webserver.cc:460] Webserver started at http://127.14.224.130:46865/ using document root <none> and password file <none>
I20260805 22:49:42.456187 3679 fs_manager.cc:359] Metadata directory not provided
I20260805 22:49:42.456239 3679 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:49:42.456370 3679 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:49:42.457448 3679 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-1/data/instance:
uuid: "cb27643ca3f74737aa87569105fcb0ad"
format_stamp: "Formatted at 2026-08-05 22:49:42 on dist-test-slave-gjrz"
server_key: "3e380f3145bbbe7d0dd475cc31b03612"
server_key_iv: "3bf1de543a29e901b1f15439300b7071"
server_key_version: "encryptionkey@0"
I20260805 22:49:42.457818 3679 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-1/wal/instance:
uuid: "cb27643ca3f74737aa87569105fcb0ad"
format_stamp: "Formatted at 2026-08-05 22:49:42 on dist-test-slave-gjrz"
server_key: "3e380f3145bbbe7d0dd475cc31b03612"
server_key_iv: "3bf1de543a29e901b1f15439300b7071"
server_key_version: "encryptionkey@0"
I20260805 22:49:42.459208 3679 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260805 22:49:42.460146 3703 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:49:42.460387 3679 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:49:42.460476 3679 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-1/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-1/wal
uuid: "cb27643ca3f74737aa87569105fcb0ad"
format_stamp: "Formatted at 2026-08-05 22:49:42 on dist-test-slave-gjrz"
server_key: "3e380f3145bbbe7d0dd475cc31b03612"
server_key_iv: "3bf1de543a29e901b1f15439300b7071"
server_key_version: "encryptionkey@0"
I20260805 22:49:42.460549 3679 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:49:42.476341 3679 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:49:42.478179 3679 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:49:42.478322 3679 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:49:42.478542 3679 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:49:42.478853 3679 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:49:42.478888 3679 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:49:42.478919 3679 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:49:42.478942 3679 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:49:42.484844 3679 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.130:43247
I20260805 22:49:42.484899 3875 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.130:43247 every 8 connection(s)
I20260805 22:49:42.485232 3679 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
Aug 05 22:49:42 dist-test-slave-gjrz krb5kdc[3301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970182, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.130@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:49:42.492780 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 3679
I20260805 22:49:42.492882 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-1/wal/instance
I20260805 22:49:42.493068 15234 external_mini_cluster.cc:1428] Setting key 1412251b6f91945727fe5fe61b9a1c38
I20260805 22:49:42.494519 3423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:42.485963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:49787 (local address 127.14.224.190:35779)
0805 22:49:42.486019 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0805 22:49:42.486021 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:49:42.486238 (+ 217us) server_negotiation.cc:407] Connection header received
0805 22:49:42.486740 (+ 502us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:49:42.486741 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:49:42.486751 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:49:42.486807 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:49:42.487836 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:42.488332 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:42.489265 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:42.489448 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:42.489489 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:42.491732 (+ 2243us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:49:42.491733 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:49:42.491733 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:49:42.491741 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:49:42.493023 (+ 1282us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:42.493499 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:42.493500 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:42.493500 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:42.493568 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:42.493837 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:42.493838 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:42.493838 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:42.493966 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:49:42.494026 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0805 22:49:42.494332 (+ 306us) server_negotiation.cc:299] Negotiation successful
0805 22:49:42.494429 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260805 22:49:42.494700 3881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:42.485920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:35779 (local address 127.14.224.130:49787)
0805 22:49:42.486110 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:42.486156 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0805 22:49:42.486659 (+ 503us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:49:42.486873 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:49:42.486876 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:49:42.487533 (+ 657us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:49:42.487743 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:42.487749 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:42.488400 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:42.488401 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:42.489200 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:42.489203 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:42.489506 (+ 303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:42.489507 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:42.489615 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:42.490173 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:49:42.490182 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:49:42.491629 (+ 1447us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:49:42.493123 (+ 1494us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:49:42.493132 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:49:42.493135 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:49:42.493412 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:49:42.493640 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:49:42.493641 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:49:42.493641 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:49:42.493776 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:49:42.494026 (+ 250us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:49:42.494033 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:49:42.494195 (+ 162us) client_negotiation.cc:769] Sending connection context
0805 22:49:42.494297 (+ 102us) client_negotiation.cc:240] Negotiation successful
0805 22:49:42.494469 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":93,"threads_started":1}
I20260805 22:49:42.495528 3876 heartbeater.cc:347] Connected to a master server at 127.14.224.190:35779
I20260805 22:49:42.495648 3876 heartbeater.cc:464] Registering TS with master...
I20260805 22:49:42.495858 3876 heartbeater.cc:511] Master 127.14.224.190:35779 requested a full tablet report, sending...
I20260805 22:49:42.496292 3366 ts_manager.cc:194] Registered new tserver with Master: cb27643ca3f74737aa87569105fcb0ad (127.14.224.130:43247)
I20260805 22:49:42.496699 3366 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.224.130@KRBTEST.COM'} at 127.14.224.130:49787
WARNING: no policy specified for kudu/127.14.224.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab.
Entry for principal kudu/127.14.224.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab.
I20260805 22:49:42.521611 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.131:0
--local_ip_for_outbound_sockets=127.14.224.131
--webserver_interface=127.14.224.131
--webserver_port=0
--tserver_master_addrs=127.14.224.190:35779
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab
--principal=kudu/127.14.224.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:38473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:49:42.603243 3885 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:49:42.603552 3885 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:49:42.603585 3885 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:49:42.604785 3885 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:49:42.604827 3885 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:49:42.604853 3885 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.131
I20260805 22:49:42.606487 3885 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:38473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab
--principal=kudu/127.14.224.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.224.131
--webserver_port=0
--tserver_master_addrs=127.14.224.190:35779
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3885
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.131
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:49:42.606715 3885 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:49:42.606937 3885 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:49:42.611900 3890 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:49:42.611979 3894 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:49:42.611907 3898 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:49:42.612249 3885 server_base.cc:1034] running on GCE node
I20260805 22:49:42.612454 3885 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:49:42.612710 3885 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:49:42.613878 3885 hybrid_clock.cc:648] HybridClock initialized: now 1785970182613834 us; error 56 us; skew 500 ppm
Aug 05 22:49:42 dist-test-slave-gjrz krb5kdc[3301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970182, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:49:42.619076 3885 init.cc:377] Logged in from keytab as kudu/127.14.224.131@KRBTEST.COM (short username kudu)
I20260805 22:49:42.619603 3885 webserver.cc:460] Webserver started at http://127.14.224.131:45917/ using document root <none> and password file <none>
I20260805 22:49:42.619817 3885 fs_manager.cc:359] Metadata directory not provided
I20260805 22:49:42.619871 3885 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:49:42.620033 3885 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:49:42.621124 3885 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-2/data/instance:
uuid: "0226d3f5892d454288b70c7be9b14fe4"
format_stamp: "Formatted at 2026-08-05 22:49:42 on dist-test-slave-gjrz"
server_key: "9f82dbd6e436516c49cf795a2eaeaf11"
server_key_iv: "00850de1db3af757f5257071c91179fd"
server_key_version: "encryptionkey@0"
I20260805 22:49:42.621470 3885 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-2/wal/instance:
uuid: "0226d3f5892d454288b70c7be9b14fe4"
format_stamp: "Formatted at 2026-08-05 22:49:42 on dist-test-slave-gjrz"
server_key: "9f82dbd6e436516c49cf795a2eaeaf11"
server_key_iv: "00850de1db3af757f5257071c91179fd"
server_key_version: "encryptionkey@0"
I20260805 22:49:42.622823 3885 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260805 22:49:42.623631 3907 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:49:42.623783 3885 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260805 22:49:42.623870 3885 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-2/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-2/wal
uuid: "0226d3f5892d454288b70c7be9b14fe4"
format_stamp: "Formatted at 2026-08-05 22:49:42 on dist-test-slave-gjrz"
server_key: "9f82dbd6e436516c49cf795a2eaeaf11"
server_key_iv: "00850de1db3af757f5257071c91179fd"
server_key_version: "encryptionkey@0"
I20260805 22:49:42.623929 3885 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:49:42.637425 3885 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:49:42.639403 3885 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:49:42.639544 3885 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:49:42.639763 3885 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:49:42.640084 3885 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:49:42.640120 3885 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:49:42.640148 3885 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:49:42.640172 3885 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:49:42.645987 3885 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.131:38245
I20260805 22:49:42.646045 4078 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.131:38245 every 8 connection(s)
I20260805 22:49:42.646361 3885 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
I20260805 22:49:42.647396 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 3885
I20260805 22:49:42.647500 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-2/wal/instance
I20260805 22:49:42.647666 15234 external_mini_cluster.cc:1428] Setting key b5a8f1fcce1c7b4663e553700484853b
Aug 05 22:49:42 dist-test-slave-gjrz krb5kdc[3301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970182, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.131@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:49:42.655897 3423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:42.647172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:40201 (local address 127.14.224.190:35779)
0805 22:49:42.647226 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0805 22:49:42.647228 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:49:42.647469 (+ 241us) server_negotiation.cc:407] Connection header received
0805 22:49:42.648068 (+ 599us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:49:42.648070 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:49:42.648081 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:49:42.648135 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:49:42.649267 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:42.649765 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:42.650748 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:42.650928 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:42.650979 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:42.653155 (+ 2176us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:49:42.653157 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:49:42.653157 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:49:42.653165 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:49:42.654462 (+ 1297us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:42.654902 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:42.654903 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:42.654904 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:42.654972 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:42.655240 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:42.655241 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:42.655241 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:42.655396 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:49:42.655465 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0805 22:49:42.655755 (+ 290us) server_negotiation.cc:299] Negotiation successful
0805 22:49:42.655829 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260805 22:49:42.656122 4081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:42.647150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:35779 (local address 127.14.224.131:40201)
0805 22:49:42.647338 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:42.647377 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0805 22:49:42.647928 (+ 551us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:49:42.648212 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:49:42.648216 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:49:42.648929 (+ 713us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:49:42.649170 (+ 241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:42.649175 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:42.649853 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:42.649854 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:42.650687 (+ 833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:42.650689 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:42.651031 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:42.651032 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:42.651143 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:42.651603 (+ 460us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:49:42.651611 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:49:42.653058 (+ 1447us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:49:42.654557 (+ 1499us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:49:42.654564 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:49:42.654566 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:49:42.654829 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:49:42.655060 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:49:42.655061 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:49:42.655062 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:49:42.655189 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:49:42.655450 (+ 261us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:49:42.655456 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:49:42.655629 (+ 173us) client_negotiation.cc:769] Sending connection context
0805 22:49:42.655730 (+ 101us) client_negotiation.cc:240] Negotiation successful
0805 22:49:42.655865 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":115,"threads_started":1}
I20260805 22:49:42.656584 4079 heartbeater.cc:347] Connected to a master server at 127.14.224.190:35779
I20260805 22:49:42.656674 4079 heartbeater.cc:464] Registering TS with master...
I20260805 22:49:42.656859 4079 heartbeater.cc:511] Master 127.14.224.190:35779 requested a full tablet report, sending...
I20260805 22:49:42.657228 3366 ts_manager.cc:194] Registered new tserver with Master: 0226d3f5892d454288b70c7be9b14fe4 (127.14.224.131:38245)
I20260805 22:49:42.657598 3366 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.224.131@KRBTEST.COM'} at 127.14.224.131:40201
I20260805 22:49:42.659420 15234 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 22:49:42.666290 3423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:42.660694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40796 (local address 127.14.224.190:35779)
0805 22:49:42.660748 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0805 22:49:42.660750 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:49:42.660858 (+ 108us) server_negotiation.cc:407] Connection header received
0805 22:49:42.660918 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:49:42.660918 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:49:42.660929 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:49:42.660975 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:49:42.661497 (+ 522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:42.661990 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:42.662695 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:42.662895 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:42.662950 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:42.664102 (+ 1152us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:49:42.664103 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:49:42.664104 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:49:42.664112 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:49:42.665221 (+ 1109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:42.665530 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:42.665531 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:42.665532 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:42.665589 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:42.665753 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:42.665754 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:42.665754 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:42.665914 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:49:42.666009 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0805 22:49:42.666122 (+ 113us) server_negotiation.cc:299] Negotiation successful
0805 22:49:42.666201 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260805 22:49:42.667834 3366 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40796:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:49:42.669498 3366 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:49:42.676137 4104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:42.672042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34588 (local address 127.14.224.130:43247)
0805 22:49:42.672328 (+ 286us) server_negotiation.cc:206] Beginning negotiation
0805 22:49:42.672331 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:49:42.672338 (+ 7us) server_negotiation.cc:407] Connection header received
0805 22:49:42.672375 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:49:42.672377 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:49:42.672537 (+ 160us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:49:42.672604 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:49:42.672861 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:42.673903 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:42.674987 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:42.675728 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:42.675809 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:42.675864 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0805 22:49:42.676020 (+ 156us) server_negotiation.cc:299] Negotiation successful
0805 22:49:42.676062 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":257,"thread_start_us":77,"threads_started":1}
I20260805 22:49:42.676129 4095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:42.671755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.131:38245 (local address 127.0.0.1:40276)
0805 22:49:42.672308 (+ 553us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:42.672316 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0805 22:49:42.672363 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:49:42.672634 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:49:42.672635 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:49:42.672637 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:49:42.672682 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:42.672683 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:42.673606 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:42.673607 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:42.674901 (+ 1294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:42.674905 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:42.675770 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:42.675771 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:42.675865 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:42.675880 (+ 15us) client_negotiation.cc:769] Sending connection context
0805 22:49:42.675950 (+ 70us) client_negotiation.cc:240] Negotiation successful
0805 22:49:42.676026 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":542,"mutex_wait_us":5,"spinlock_wait_cycles":768,"thread_start_us":99,"threads_started":1}
I20260805 22:49:42.676257 4099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:42.671755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.129:35089 (local address 127.0.0.1:42774)
0805 22:49:42.672162 (+ 407us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:42.672172 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0805 22:49:42.672239 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:49:42.672441 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:49:42.672444 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:49:42.672455 (+ 11us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:49:42.672531 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:42.672533 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:42.673857 (+ 1324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:42.673858 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:42.675046 (+ 1188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:42.675048 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:42.675928 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:42.675929 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:42.676003 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:42.676007 (+ 4us) client_negotiation.cc:769] Sending connection context
0805 22:49:42.676061 (+ 54us) client_negotiation.cc:240] Negotiation successful
0805 22:49:42.676108 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":384,"mutex_wait_us":3,"thread_start_us":101,"threads_started":1}
I20260805 22:49:42.676393 4102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:42.671987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42774 (local address 127.14.224.129:35089)
0805 22:49:42.672188 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0805 22:49:42.672193 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:49:42.672233 (+ 40us) server_negotiation.cc:407] Connection header received
0805 22:49:42.672317 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:49:42.672319 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:49:42.672337 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:49:42.672405 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:49:42.672608 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:42.673752 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:42.675127 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:42.675862 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:42.675926 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:42.675979 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0805 22:49:42.676077 (+ 98us) server_negotiation.cc:299] Negotiation successful
0805 22:49:42.676116 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":83,"threads_started":1}
I20260805 22:49:42.676472 4100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:42.671961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40276 (local address 127.14.224.131:38245)
0805 22:49:42.672256 (+ 295us) server_negotiation.cc:206] Beginning negotiation
0805 22:49:42.672259 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:49:42.672374 (+ 115us) server_negotiation.cc:407] Connection header received
0805 22:49:42.672419 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:49:42.672421 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:49:42.672436 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:49:42.672520 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:49:42.672785 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:42.673506 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:42.675004 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:42.675631 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:42.675676 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:42.675718 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0805 22:49:42.676273 (+ 555us) server_negotiation.cc:299] Negotiation successful
0805 22:49:42.676393 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":270,"thread_start_us":89,"threads_started":1}
I20260805 22:49:42.676793 4096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:42.671753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.130:43247 (local address 127.0.0.1:34588)
0805 22:49:42.671954 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:42.671996 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0805 22:49:42.672082 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:49:42.672691 (+ 609us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:49:42.672691 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:49:42.672694 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:49:42.672793 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:42.672795 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:42.674000 (+ 1205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:42.674001 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:42.674904 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:42.674907 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:42.675815 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:42.675816 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:42.675878 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:42.675881 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:49:42.675950 (+ 69us) client_negotiation.cc:240] Negotiation successful
0805 22:49:42.676728 (+ 778us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"mutex_wait_us":716,"thread_start_us":73,"threads_started":1}
I20260805 22:49:42.677160 3979 tablet_service.cc:1467] Processing CreateTablet for tablet aff5b695d25a49fd8574f75e1656467c (DEFAULT_TABLE table=test-table [id=5762fbfa971040eab95ba60a4b18570c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:49:42.677150 3558 tablet_service.cc:1467] Processing CreateTablet for tablet aff5b695d25a49fd8574f75e1656467c (DEFAULT_TABLE table=test-table [id=5762fbfa971040eab95ba60a4b18570c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:49:42.677492 3979 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aff5b695d25a49fd8574f75e1656467c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:49:42.677515 3558 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aff5b695d25a49fd8574f75e1656467c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:49:42.677524 3769 tablet_service.cc:1467] Processing CreateTablet for tablet aff5b695d25a49fd8574f75e1656467c (DEFAULT_TABLE table=test-table [id=5762fbfa971040eab95ba60a4b18570c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:49:42.677829 3769 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aff5b695d25a49fd8574f75e1656467c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:49:42.680087 4105 tablet_bootstrap.cc:492] T aff5b695d25a49fd8574f75e1656467c P 0226d3f5892d454288b70c7be9b14fe4: Bootstrap starting.
I20260805 22:49:42.680747 4105 tablet_bootstrap.cc:654] T aff5b695d25a49fd8574f75e1656467c P 0226d3f5892d454288b70c7be9b14fe4: Neither blocks nor log segments found. Creating new log.
I20260805 22:49:42.680866 4106 tablet_bootstrap.cc:492] T aff5b695d25a49fd8574f75e1656467c P ad7b0e4ee79f423c8466b1746b3e08e3: Bootstrap starting.
I20260805 22:49:42.681545 4106 tablet_bootstrap.cc:654] T aff5b695d25a49fd8574f75e1656467c P ad7b0e4ee79f423c8466b1746b3e08e3: Neither blocks nor log segments found. Creating new log.
I20260805 22:49:42.681545 4105 log.cc:824] T aff5b695d25a49fd8574f75e1656467c P 0226d3f5892d454288b70c7be9b14fe4: Log is configured to *not* fsync() on all Append() calls
I20260805 22:49:42.681950 4107 tablet_bootstrap.cc:492] T aff5b695d25a49fd8574f75e1656467c P cb27643ca3f74737aa87569105fcb0ad: Bootstrap starting.
I20260805 22:49:42.682202 4106 log.cc:824] T aff5b695d25a49fd8574f75e1656467c P ad7b0e4ee79f423c8466b1746b3e08e3: Log is configured to *not* fsync() on all Append() calls
I20260805 22:49:42.682379 4105 tablet_bootstrap.cc:492] T aff5b695d25a49fd8574f75e1656467c P 0226d3f5892d454288b70c7be9b14fe4: No bootstrap required, opened a new log
I20260805 22:49:42.682462 4105 ts_tablet_manager.cc:1397] T aff5b695d25a49fd8574f75e1656467c P 0226d3f5892d454288b70c7be9b14fe4: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260805 22:49:42.682600 4107 tablet_bootstrap.cc:654] T aff5b695d25a49fd8574f75e1656467c P cb27643ca3f74737aa87569105fcb0ad: Neither blocks nor log segments found. Creating new log.
I20260805 22:49:42.682993 4106 tablet_bootstrap.cc:492] T aff5b695d25a49fd8574f75e1656467c P ad7b0e4ee79f423c8466b1746b3e08e3: No bootstrap required, opened a new log
I20260805 22:49:42.683054 4106 ts_tablet_manager.cc:1397] T aff5b695d25a49fd8574f75e1656467c P ad7b0e4ee79f423c8466b1746b3e08e3: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260805 22:49:42.683063 4107 log.cc:824] T aff5b695d25a49fd8574f75e1656467c P cb27643ca3f74737aa87569105fcb0ad: Log is configured to *not* fsync() on all Append() calls
I20260805 22:49:42.683759 4107 tablet_bootstrap.cc:492] T aff5b695d25a49fd8574f75e1656467c P cb27643ca3f74737aa87569105fcb0ad: No bootstrap required, opened a new log
I20260805 22:49:42.683864 4107 ts_tablet_manager.cc:1397] T aff5b695d25a49fd8574f75e1656467c P cb27643ca3f74737aa87569105fcb0ad: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260805 22:49:42.684554 4105 raft_consensus.cc:348] T aff5b695d25a49fd8574f75e1656467c P 0226d3f5892d454288b70c7be9b14fe4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad7b0e4ee79f423c8466b1746b3e08e3" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 35089 } } peers { permanent_uuid: "0226d3f5892d454288b70c7be9b14fe4" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 38245 } } peers { permanent_uuid: "cb27643ca3f74737aa87569105fcb0ad" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 43247 } }
I20260805 22:49:42.684743 4105 raft_consensus.cc:374] T aff5b695d25a49fd8574f75e1656467c P 0226d3f5892d454288b70c7be9b14fe4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:49:42.684782 4105 raft_consensus.cc:729] T aff5b695d25a49fd8574f75e1656467c P 0226d3f5892d454288b70c7be9b14fe4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0226d3f5892d454288b70c7be9b14fe4, State: Initialized, Role: FOLLOWER
I20260805 22:49:42.684897 4105 consensus_queue.cc:260] T aff5b695d25a49fd8574f75e1656467c P 0226d3f5892d454288b70c7be9b14fe4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad7b0e4ee79f423c8466b1746b3e08e3" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 35089 } } peers { permanent_uuid: "0226d3f5892d454288b70c7be9b14fe4" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 38245 } } peers { permanent_uuid: "cb27643ca3f74737aa87569105fcb0ad" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 43247 } }
I20260805 22:49:42.685065 4106 raft_consensus.cc:348] T aff5b695d25a49fd8574f75e1656467c P ad7b0e4ee79f423c8466b1746b3e08e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad7b0e4ee79f423c8466b1746b3e08e3" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 35089 } } peers { permanent_uuid: "0226d3f5892d454288b70c7be9b14fe4" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 38245 } } peers { permanent_uuid: "cb27643ca3f74737aa87569105fcb0ad" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 43247 } }
I20260805 22:49:42.685195 4105 ts_tablet_manager.cc:1428] T aff5b695d25a49fd8574f75e1656467c P 0226d3f5892d454288b70c7be9b14fe4: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260805 22:49:42.685227 4106 raft_consensus.cc:374] T aff5b695d25a49fd8574f75e1656467c P ad7b0e4ee79f423c8466b1746b3e08e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:49:42.685267 4106 raft_consensus.cc:729] T aff5b695d25a49fd8574f75e1656467c P ad7b0e4ee79f423c8466b1746b3e08e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad7b0e4ee79f423c8466b1746b3e08e3, State: Initialized, Role: FOLLOWER
I20260805 22:49:42.685313 4079 heartbeater.cc:503] Master 127.14.224.190:35779 was elected leader, sending a full tablet report...
I20260805 22:49:42.685379 4106 consensus_queue.cc:260] T aff5b695d25a49fd8574f75e1656467c P ad7b0e4ee79f423c8466b1746b3e08e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad7b0e4ee79f423c8466b1746b3e08e3" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 35089 } } peers { permanent_uuid: "0226d3f5892d454288b70c7be9b14fe4" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 38245 } } peers { permanent_uuid: "cb27643ca3f74737aa87569105fcb0ad" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 43247 } }
I20260805 22:49:42.685667 4106 ts_tablet_manager.cc:1428] T aff5b695d25a49fd8574f75e1656467c P ad7b0e4ee79f423c8466b1746b3e08e3: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260805 22:49:42.685638 4107 raft_consensus.cc:348] T aff5b695d25a49fd8574f75e1656467c P cb27643ca3f74737aa87569105fcb0ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad7b0e4ee79f423c8466b1746b3e08e3" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 35089 } } peers { permanent_uuid: "0226d3f5892d454288b70c7be9b14fe4" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 38245 } } peers { permanent_uuid: "cb27643ca3f74737aa87569105fcb0ad" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 43247 } }
I20260805 22:49:42.685791 4107 raft_consensus.cc:374] T aff5b695d25a49fd8574f75e1656467c P cb27643ca3f74737aa87569105fcb0ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:49:42.685801 3671 heartbeater.cc:503] Master 127.14.224.190:35779 was elected leader, sending a full tablet report...
I20260805 22:49:42.685825 4107 raft_consensus.cc:729] T aff5b695d25a49fd8574f75e1656467c P cb27643ca3f74737aa87569105fcb0ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb27643ca3f74737aa87569105fcb0ad, State: Initialized, Role: FOLLOWER
I20260805 22:49:42.685932 4107 consensus_queue.cc:260] T aff5b695d25a49fd8574f75e1656467c P cb27643ca3f74737aa87569105fcb0ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad7b0e4ee79f423c8466b1746b3e08e3" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 35089 } } peers { permanent_uuid: "0226d3f5892d454288b70c7be9b14fe4" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 38245 } } peers { permanent_uuid: "cb27643ca3f74737aa87569105fcb0ad" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 43247 } }
I20260805 22:49:42.686213 4107 ts_tablet_manager.cc:1428] T aff5b695d25a49fd8574f75e1656467c P cb27643ca3f74737aa87569105fcb0ad: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260805 22:49:42.686370 3876 heartbeater.cc:503] Master 127.14.224.190:35779 was elected leader, sending a full tablet report...
W20260805 22:49:42.735791 3879 tablet.cc:2369] T aff5b695d25a49fd8574f75e1656467c P cb27643ca3f74737aa87569105fcb0ad: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:49:42.747393 4116 raft_consensus.cc:482] T aff5b695d25a49fd8574f75e1656467c P cb27643ca3f74737aa87569105fcb0ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:49:42.747535 4116 raft_consensus.cc:504] T aff5b695d25a49fd8574f75e1656467c P cb27643ca3f74737aa87569105fcb0ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad7b0e4ee79f423c8466b1746b3e08e3" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 35089 } } peers { permanent_uuid: "0226d3f5892d454288b70c7be9b14fe4" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 38245 } } peers { permanent_uuid: "cb27643ca3f74737aa87569105fcb0ad" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 43247 } }
I20260805 22:49:42.747937 4116 leader_election.cc:288] T aff5b695d25a49fd8574f75e1656467c P cb27643ca3f74737aa87569105fcb0ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad7b0e4ee79f423c8466b1746b3e08e3 (127.14.224.129:35089), 0226d3f5892d454288b70c7be9b14fe4 (127.14.224.131:38245)
I20260805 22:49:42.751149 4100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:42.748259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:52089 (local address 127.14.224.131:38245)
0805 22:49:42.748304 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0805 22:49:42.748307 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:49:42.748455 (+ 148us) server_negotiation.cc:407] Connection header received
0805 22:49:42.748484 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:49:42.748485 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:49:42.748493 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:49:42.748541 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:49:42.748675 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:42.749136 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:42.750400 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:42.750788 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:42.750845 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:42.750853 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0805 22:49:42.751030 (+ 177us) server_negotiation.cc:299] Negotiation successful
0805 22:49:42.751076 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260805 22:49:42.751157 4102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:42.748221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:41829 (local address 127.14.224.129:35089)
0805 22:49:42.748264 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0805 22:49:42.748266 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:49:42.748278 (+ 12us) server_negotiation.cc:407] Connection header received
0805 22:49:42.748317 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:49:42.748318 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:49:42.748330 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:49:42.748389 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:49:42.748542 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:42.749013 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:42.750422 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:42.750833 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:42.750907 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:42.750925 (+ 18us) server_negotiation.cc:1035] Waiting for connection context
0805 22:49:42.751059 (+ 134us) server_negotiation.cc:299] Negotiation successful
0805 22:49:42.751099 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260805 22:49:42.751157 4117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:42.748142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.131:38245 (local address 127.14.224.130:52089)
0805 22:49:42.748383 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:42.748389 (+ 6us) client_negotiation.cc:174] Beginning negotiation
0805 22:49:42.748432 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:49:42.748550 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:49:42.748551 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:49:42.748552 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:49:42.748620 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:42.748621 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:42.749213 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:42.749214 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:42.750305 (+ 1091us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:42.750306 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:42.750867 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:42.750868 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:42.750942 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:42.750947 (+ 5us) client_negotiation.cc:769] Sending connection context
0805 22:49:42.750994 (+ 47us) client_negotiation.cc:240] Negotiation successful
0805 22:49:42.751032 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":228,"mutex_wait_us":63,"thread_start_us":126,"threads_started":1}
I20260805 22:49:42.751158 3881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:42.748136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.129:35089 (local address 127.14.224.130:41829)
0805 22:49:42.748195 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:42.748208 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0805 22:49:42.748263 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:49:42.748408 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:49:42.748409 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:49:42.748411 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:49:42.748482 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:42.748483 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:42.749099 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:42.749101 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:42.750293 (+ 1192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:42.750296 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:42.750903 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:42.750904 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:42.750982 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:42.750985 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:49:42.751041 (+ 56us) client_negotiation.cc:240] Negotiation successful
0805 22:49:42.751081 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260805 22:49:42.751536 4008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aff5b695d25a49fd8574f75e1656467c" candidate_uuid: "cb27643ca3f74737aa87569105fcb0ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0226d3f5892d454288b70c7be9b14fe4" is_pre_election: true
I20260805 22:49:42.751608 3587 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aff5b695d25a49fd8574f75e1656467c" candidate_uuid: "cb27643ca3f74737aa87569105fcb0ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad7b0e4ee79f423c8466b1746b3e08e3" is_pre_election: true
I20260805 22:49:42.751694 4008 raft_consensus.cc:2454] T aff5b695d25a49fd8574f75e1656467c P 0226d3f5892d454288b70c7be9b14fe4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb27643ca3f74737aa87569105fcb0ad in term 0.
I20260805 22:49:42.751775 3587 raft_consensus.cc:2454] T aff5b695d25a49fd8574f75e1656467c P ad7b0e4ee79f423c8466b1746b3e08e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb27643ca3f74737aa87569105fcb0ad in term 0.
I20260805 22:49:42.751935 3705 leader_election.cc:302] T aff5b695d25a49fd8574f75e1656467c P cb27643ca3f74737aa87569105fcb0ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0226d3f5892d454288b70c7be9b14fe4, cb27643ca3f74737aa87569105fcb0ad; no voters:
I20260805 22:49:42.752090 4116 raft_consensus.cc:2781] T aff5b695d25a49fd8574f75e1656467c P cb27643ca3f74737aa87569105fcb0ad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:49:42.752158 4116 raft_consensus.cc:482] T aff5b695d25a49fd8574f75e1656467c P cb27643ca3f74737aa87569105fcb0ad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:49:42.752188 4116 raft_consensus.cc:3037] T aff5b695d25a49fd8574f75e1656467c P cb27643ca3f74737aa87569105fcb0ad [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:49:42.752947 4116 raft_consensus.cc:504] T aff5b695d25a49fd8574f75e1656467c P cb27643ca3f74737aa87569105fcb0ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad7b0e4ee79f423c8466b1746b3e08e3" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 35089 } } peers { permanent_uuid: "0226d3f5892d454288b70c7be9b14fe4" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 38245 } } peers { permanent_uuid: "cb27643ca3f74737aa87569105fcb0ad" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 43247 } }
I20260805 22:49:42.753082 4116 leader_election.cc:288] T aff5b695d25a49fd8574f75e1656467c P cb27643ca3f74737aa87569105fcb0ad [CANDIDATE]: Term 1 election: Requested vote from peers ad7b0e4ee79f423c8466b1746b3e08e3 (127.14.224.129:35089), 0226d3f5892d454288b70c7be9b14fe4 (127.14.224.131:38245)
I20260805 22:49:42.753314 4008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aff5b695d25a49fd8574f75e1656467c" candidate_uuid: "cb27643ca3f74737aa87569105fcb0ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0226d3f5892d454288b70c7be9b14fe4"
I20260805 22:49:42.753319 3587 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aff5b695d25a49fd8574f75e1656467c" candidate_uuid: "cb27643ca3f74737aa87569105fcb0ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad7b0e4ee79f423c8466b1746b3e08e3"
I20260805 22:49:42.753396 3587 raft_consensus.cc:3037] T aff5b695d25a49fd8574f75e1656467c P ad7b0e4ee79f423c8466b1746b3e08e3 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:49:42.753399 4008 raft_consensus.cc:3037] T aff5b695d25a49fd8574f75e1656467c P 0226d3f5892d454288b70c7be9b14fe4 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:49:42.754135 3587 raft_consensus.cc:2454] T aff5b695d25a49fd8574f75e1656467c P ad7b0e4ee79f423c8466b1746b3e08e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb27643ca3f74737aa87569105fcb0ad in term 1.
I20260805 22:49:42.754141 4008 raft_consensus.cc:2454] T aff5b695d25a49fd8574f75e1656467c P 0226d3f5892d454288b70c7be9b14fe4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb27643ca3f74737aa87569105fcb0ad in term 1.
I20260805 22:49:42.754323 3709 leader_election.cc:302] T aff5b695d25a49fd8574f75e1656467c P cb27643ca3f74737aa87569105fcb0ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad7b0e4ee79f423c8466b1746b3e08e3, cb27643ca3f74737aa87569105fcb0ad; no voters:
I20260805 22:49:42.754423 4116 raft_consensus.cc:2781] T aff5b695d25a49fd8574f75e1656467c P cb27643ca3f74737aa87569105fcb0ad [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:49:42.754592 4116 raft_consensus.cc:686] T aff5b695d25a49fd8574f75e1656467c P cb27643ca3f74737aa87569105fcb0ad [term 1 LEADER]: Becoming Leader. State: Replica: cb27643ca3f74737aa87569105fcb0ad, State: Running, Role: LEADER
I20260805 22:49:42.754694 4116 consensus_queue.cc:237] T aff5b695d25a49fd8574f75e1656467c P cb27643ca3f74737aa87569105fcb0ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad7b0e4ee79f423c8466b1746b3e08e3" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 35089 } } peers { permanent_uuid: "0226d3f5892d454288b70c7be9b14fe4" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 38245 } } peers { permanent_uuid: "cb27643ca3f74737aa87569105fcb0ad" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 43247 } }
I20260805 22:49:42.755643 3363 catalog_manager.cc:5495] T aff5b695d25a49fd8574f75e1656467c P cb27643ca3f74737aa87569105fcb0ad reported cstate change: term changed from 0 to 1, leader changed from <none> to cb27643ca3f74737aa87569105fcb0ad (127.14.224.130). New cstate: current_term: 1 leader_uuid: "cb27643ca3f74737aa87569105fcb0ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad7b0e4ee79f423c8466b1746b3e08e3" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 35089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0226d3f5892d454288b70c7be9b14fe4" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 38245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb27643ca3f74737aa87569105fcb0ad" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 43247 } health_report { overall_health: HEALTHY } } }
I20260805 22:49:42.772890 4104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:42.770358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34594 (local address 127.14.224.130:43247)
0805 22:49:42.770424 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0805 22:49:42.770426 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:49:42.770434 (+ 8us) server_negotiation.cc:407] Connection header received
0805 22:49:42.770472 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:49:42.770473 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:49:42.770492 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:49:42.770551 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:49:42.770679 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:42.771156 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:42.771979 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:42.772257 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:42.772319 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:42.772514 (+ 195us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:49:42.772672 (+ 158us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:49:42.772750 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0805 22:49:42.772767 (+ 17us) server_negotiation.cc:299] Negotiation successful
0805 22:49:42.772788 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260805 22:49:42.774705 4008 raft_consensus.cc:1261] T aff5b695d25a49fd8574f75e1656467c P 0226d3f5892d454288b70c7be9b14fe4 [term 1 FOLLOWER]: Refusing update from remote peer cb27643ca3f74737aa87569105fcb0ad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:49:42.774705 3587 raft_consensus.cc:1261] T aff5b695d25a49fd8574f75e1656467c P ad7b0e4ee79f423c8466b1746b3e08e3 [term 1 FOLLOWER]: Refusing update from remote peer cb27643ca3f74737aa87569105fcb0ad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:49:42.775110 4116 consensus_queue.cc:1035] T aff5b695d25a49fd8574f75e1656467c P cb27643ca3f74737aa87569105fcb0ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad7b0e4ee79f423c8466b1746b3e08e3" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 35089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:49:42.775254 4118 consensus_queue.cc:1035] T aff5b695d25a49fd8574f75e1656467c P cb27643ca3f74737aa87569105fcb0ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0226d3f5892d454288b70c7be9b14fe4" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 38245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:49:42.778184 4125 mvcc.cc:205] Tried to move back new op lower bound from 7315333868642435072 to 7315333868563955712. Current Snapshot: MvccSnapshot[applied={T|T < 7315333868642435072 or (T in {7315333868642435072})}]
I20260805 22:49:42.778569 4126 mvcc.cc:205] Tried to move back new op lower bound from 7315333868642435072 to 7315333868563955712. Current Snapshot: MvccSnapshot[applied={T|T < 7315333868642435072}]
I20260805 22:49:42.780568 3366 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40796:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:49:42.780670 3366 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40796:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:49:42.781374 3366 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 52b0fdfef10048eb80deb2aaf54a2937: Sending DeleteTablet for 3 replicas of tablet aff5b695d25a49fd8574f75e1656467c
I20260805 22:49:42.781724 3558 tablet_service.cc:1514] Processing DeleteTablet for tablet aff5b695d25a49fd8574f75e1656467c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:49:42 UTC) from {username='kudu', principal='kudu/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:42774
I20260805 22:49:42.781801 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 3463
I20260805 22:49:42.781780 3979 tablet_service.cc:1514] Processing DeleteTablet for tablet aff5b695d25a49fd8574f75e1656467c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:49:42 UTC) from {username='kudu', principal='kudu/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:40276
I20260805 22:49:42.782015 3769 tablet_service.cc:1514] Processing DeleteTablet for tablet aff5b695d25a49fd8574f75e1656467c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:49:42 UTC) from {username='kudu', principal='kudu/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:34588
I20260805 22:49:42.793504 4138 tablet_replica.cc:330] T aff5b695d25a49fd8574f75e1656467c P cb27643ca3f74737aa87569105fcb0ad: stopping tablet replica
I20260805 22:49:42.793681 4138 raft_consensus.cc:2229] T aff5b695d25a49fd8574f75e1656467c P cb27643ca3f74737aa87569105fcb0ad [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:49:42.793830 4138 raft_consensus.cc:2258] T aff5b695d25a49fd8574f75e1656467c P cb27643ca3f74737aa87569105fcb0ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:49:42.794373 4138 ts_tablet_manager.cc:1905] T aff5b695d25a49fd8574f75e1656467c P cb27643ca3f74737aa87569105fcb0ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:49:42.795645 4137 tablet_replica.cc:330] T aff5b695d25a49fd8574f75e1656467c P 0226d3f5892d454288b70c7be9b14fe4: stopping tablet replica
I20260805 22:49:42.795856 4137 raft_consensus.cc:2229] T aff5b695d25a49fd8574f75e1656467c P 0226d3f5892d454288b70c7be9b14fe4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:49:42.796054 4137 raft_consensus.cc:2258] T aff5b695d25a49fd8574f75e1656467c P 0226d3f5892d454288b70c7be9b14fe4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:49:42.796243 4138 ts_tablet_manager.cc:1918] T aff5b695d25a49fd8574f75e1656467c P cb27643ca3f74737aa87569105fcb0ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:49:42.796322 4138 log.cc:1196] T aff5b695d25a49fd8574f75e1656467c P cb27643ca3f74737aa87569105fcb0ad: Deleting WAL directory at /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-1/wal/wals/aff5b695d25a49fd8574f75e1656467c
I20260805 22:49:42.796564 4138 ts_tablet_manager.cc:1939] T aff5b695d25a49fd8574f75e1656467c P cb27643ca3f74737aa87569105fcb0ad: Deleting consensus metadata
I20260805 22:49:42.796772 4137 ts_tablet_manager.cc:1905] T aff5b695d25a49fd8574f75e1656467c P 0226d3f5892d454288b70c7be9b14fe4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:49:42.798367 4137 ts_tablet_manager.cc:1918] T aff5b695d25a49fd8574f75e1656467c P 0226d3f5892d454288b70c7be9b14fe4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:49:42.798523 4137 log.cc:1196] T aff5b695d25a49fd8574f75e1656467c P 0226d3f5892d454288b70c7be9b14fe4: Deleting WAL directory at /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-2/wal/wals/aff5b695d25a49fd8574f75e1656467c
I20260805 22:49:42.798852 4137 ts_tablet_manager.cc:1939] T aff5b695d25a49fd8574f75e1656467c P 0226d3f5892d454288b70c7be9b14fe4: Deleting consensus metadata
W20260805 22:49:42.799124 3345 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.224.129:35089 (error 108)
I20260805 22:49:42.799352 3341 catalog_manager.cc:4841] TS cb27643ca3f74737aa87569105fcb0ad (127.14.224.130:43247): tablet aff5b695d25a49fd8574f75e1656467c (table test-table [id=5762fbfa971040eab95ba60a4b18570c]) successfully deleted
I20260805 22:49:42.799475 3342 catalog_manager.cc:4841] TS 0226d3f5892d454288b70c7be9b14fe4 (127.14.224.131:38245): tablet aff5b695d25a49fd8574f75e1656467c (table test-table [id=5762fbfa971040eab95ba60a4b18570c]) successfully deleted
I20260805 22:49:42.799762 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 3679
I20260805 22:49:42.799911 4096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:42.799752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.129:35089 (local address 127.0.0.1:42782)
0805 22:49:42.799827 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:42.799876 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.129:35089: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260805 22:49:42.803423 3345 catalog_manager.cc:4584] TS ad7b0e4ee79f423c8466b1746b3e08e3 (127.14.224.129:35089): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet aff5b695d25a49fd8574f75e1656467c: Network error: Client connection negotiation failed: client connection to 127.14.224.129:35089: connect: Connection refused (error 111)
I20260805 22:49:42.817903 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 3885
I20260805 22:49:42.826987 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 3319
I20260805 22:49:42.835255 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:35779
--webserver_interface=127.14.224.190
--webserver_port=39189
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:38473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.224.190:35779
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:49:42.919700 4140 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:49:42.919924 4140 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:49:42.919956 4140 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:49:42.921180 4140 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:49:42.921228 4140 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:49:42.921247 4140 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:49:42.921262 4140 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:49:42.921277 4140 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:49:42.922821 4140 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:38473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.14.224.190:35779
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:35779
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.224.190
--webserver_port=39189
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4140
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:49:42.923084 4140 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:49:42.923333 4140 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:49:42.933095 4151 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:49:42.933100 4147 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:49:42.933100 4148 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:49:42.933220 4140 server_base.cc:1034] running on GCE node
I20260805 22:49:42.933564 4140 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:49:42.933893 4140 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:49:42.935030 4140 hybrid_clock.cc:648] HybridClock initialized: now 1785970182935021 us; error 27 us; skew 500 ppm
Aug 05 22:49:42 dist-test-slave-gjrz krb5kdc[3301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970182, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:49:42.937737 4140 init.cc:377] Logged in from keytab as kudu/127.14.224.190@KRBTEST.COM (short username kudu)
I20260805 22:49:42.938215 4140 webserver.cc:460] Webserver started at http://127.14.224.190:39189/ using document root <none> and password file <none>
I20260805 22:49:42.938469 4140 fs_manager.cc:359] Metadata directory not provided
I20260805 22:49:42.938530 4140 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:49:42.940125 4140 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.000s
I20260805 22:49:42.940867 4160 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:49:42.941069 4140 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:49:42.941160 4140 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/master-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/master-0/wal
uuid: "52b0fdfef10048eb80deb2aaf54a2937"
format_stamp: "Formatted at 2026-08-05 22:49:42 on dist-test-slave-gjrz"
server_key: "1be9175a25229606d261ba6657401943"
server_key_iv: "263969b7ac6e3e1ddf031b2b509ba24a"
server_key_version: "encryptionkey@0"
I20260805 22:49:42.941593 4140 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:49:42.956030 4140 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:49:42.958215 4140 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:49:42.958333 4140 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:49:42.962539 4140 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.190:35779
I20260805 22:49:42.962580 4242 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.190:35779 every 8 connection(s)
I20260805 22:49:42.962960 4140 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
I20260805 22:49:42.964769 4243 sys_catalog.cc:263] Verifying existing consensus state
I20260805 22:49:42.965504 4243 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 52b0fdfef10048eb80deb2aaf54a2937: Bootstrap starting.
I20260805 22:49:42.971052 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 4140
I20260805 22:49:42.971501 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.129:35089
--local_ip_for_outbound_sockets=127.14.224.129
--tserver_master_addrs=127.14.224.190:35779
--webserver_port=43893
--webserver_interface=127.14.224.129
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab
--principal=kudu/127.14.224.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:38473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 22:49:42.974514 4243 log.cc:824] T 00000000000000000000000000000000 P 52b0fdfef10048eb80deb2aaf54a2937: Log is configured to *not* fsync() on all Append() calls
I20260805 22:49:42.976620 4243 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 52b0fdfef10048eb80deb2aaf54a2937: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260805 22:49:42.976917 4243 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 52b0fdfef10048eb80deb2aaf54a2937: Bootstrap complete.
I20260805 22:49:42.979102 4243 raft_consensus.cc:348] T 00000000000000000000000000000000 P 52b0fdfef10048eb80deb2aaf54a2937 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52b0fdfef10048eb80deb2aaf54a2937" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 35779 } }
I20260805 22:49:42.979390 4243 raft_consensus.cc:729] T 00000000000000000000000000000000 P 52b0fdfef10048eb80deb2aaf54a2937 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52b0fdfef10048eb80deb2aaf54a2937, State: Initialized, Role: FOLLOWER
I20260805 22:49:42.979565 4243 consensus_queue.cc:260] T 00000000000000000000000000000000 P 52b0fdfef10048eb80deb2aaf54a2937 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52b0fdfef10048eb80deb2aaf54a2937" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 35779 } }
I20260805 22:49:42.979646 4243 raft_consensus.cc:388] T 00000000000000000000000000000000 P 52b0fdfef10048eb80deb2aaf54a2937 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:49:42.979702 4243 raft_consensus.cc:482] T 00000000000000000000000000000000 P 52b0fdfef10048eb80deb2aaf54a2937 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:49:42.979753 4243 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 52b0fdfef10048eb80deb2aaf54a2937 [term 1 FOLLOWER]: Advancing to term 2
I20260805 22:49:42.980826 4243 raft_consensus.cc:504] T 00000000000000000000000000000000 P 52b0fdfef10048eb80deb2aaf54a2937 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52b0fdfef10048eb80deb2aaf54a2937" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 35779 } }
I20260805 22:49:42.980935 4243 leader_election.cc:302] T 00000000000000000000000000000000 P 52b0fdfef10048eb80deb2aaf54a2937 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 52b0fdfef10048eb80deb2aaf54a2937; no voters:
I20260805 22:49:42.981125 4243 leader_election.cc:288] T 00000000000000000000000000000000 P 52b0fdfef10048eb80deb2aaf54a2937 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260805 22:49:42.981181 4247 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 52b0fdfef10048eb80deb2aaf54a2937 [term 2 FOLLOWER]: Leader election won for term 2
I20260805 22:49:42.981303 4247 raft_consensus.cc:686] T 00000000000000000000000000000000 P 52b0fdfef10048eb80deb2aaf54a2937 [term 2 LEADER]: Becoming Leader. State: Replica: 52b0fdfef10048eb80deb2aaf54a2937, State: Running, Role: LEADER
I20260805 22:49:42.981413 4243 sys_catalog.cc:564] T 00000000000000000000000000000000 P 52b0fdfef10048eb80deb2aaf54a2937 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:49:42.981392 4247 consensus_queue.cc:237] T 00000000000000000000000000000000 P 52b0fdfef10048eb80deb2aaf54a2937 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52b0fdfef10048eb80deb2aaf54a2937" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 35779 } }
I20260805 22:49:42.981943 4248 sys_catalog.cc:455] T 00000000000000000000000000000000 P 52b0fdfef10048eb80deb2aaf54a2937 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "52b0fdfef10048eb80deb2aaf54a2937" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52b0fdfef10048eb80deb2aaf54a2937" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 35779 } } }
I20260805 22:49:42.982054 4248 sys_catalog.cc:458] T 00000000000000000000000000000000 P 52b0fdfef10048eb80deb2aaf54a2937 [sys.catalog]: This master's current role is: LEADER
I20260805 22:49:42.982317 4251 sys_catalog.cc:455] T 00000000000000000000000000000000 P 52b0fdfef10048eb80deb2aaf54a2937 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 52b0fdfef10048eb80deb2aaf54a2937. Latest consensus state: current_term: 2 leader_uuid: "52b0fdfef10048eb80deb2aaf54a2937" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52b0fdfef10048eb80deb2aaf54a2937" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 35779 } } }
I20260805 22:49:42.982426 4251 sys_catalog.cc:458] T 00000000000000000000000000000000 P 52b0fdfef10048eb80deb2aaf54a2937 [sys.catalog]: This master's current role is: LEADER
I20260805 22:49:42.982550 4260 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:49:42.983438 4260 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:49:42.983541 4260 catalog_manager.cc:1259] Loaded cluster ID: ecf25561117c49b8abe675bcab2d7977
I20260805 22:49:42.983567 4260 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:49:42.983911 4260 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260805 22:49:42.988487 4260 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260805 22:49:42.991539 4260 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:49:42.991822 4260 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 52b0fdfef10048eb80deb2aaf54a2937: Loaded TSK: 0
I20260805 22:49:42.992076 4260 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260805 22:49:43.059576 4245 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:49:43.059782 4245 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:49:43.059805 4245 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:49:43.061043 4245 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:49:43.061086 4245 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:49:43.061112 4245 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.129
I20260805 22:49:43.062592 4245 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:38473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab
--principal=kudu/127.14.224.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.129:35089
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.224.129
--webserver_port=43893
--tserver_master_addrs=127.14.224.190:35779
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4245
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.129
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:49:43.062826 4245 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:49:43.063055 4245 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:49:43.069204 4283 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:49:43.069257 4286 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:49:43.069217 4284 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:49:43.069985 4245 server_base.cc:1034] running on GCE node
I20260805 22:49:43.070186 4245 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:49:43.070426 4245 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:49:43.071564 4245 hybrid_clock.cc:648] HybridClock initialized: now 1785970183071549 us; error 32 us; skew 500 ppm
Aug 05 22:49:43 dist-test-slave-gjrz krb5kdc[3301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970183, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:49:43.074138 4245 init.cc:377] Logged in from keytab as kudu/127.14.224.129@KRBTEST.COM (short username kudu)
I20260805 22:49:43.074636 4245 webserver.cc:460] Webserver started at http://127.14.224.129:43893/ using document root <none> and password file <none>
I20260805 22:49:43.074874 4245 fs_manager.cc:359] Metadata directory not provided
I20260805 22:49:43.074944 4245 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:49:43.076463 4245 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:49:43.077224 4296 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:49:43.077433 4245 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:49:43.077548 4245 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-0/wal
uuid: "ad7b0e4ee79f423c8466b1746b3e08e3"
format_stamp: "Formatted at 2026-08-05 22:49:42 on dist-test-slave-gjrz"
server_key: "3cdf7cc4a506f496cabcc6e5863c9c86"
server_key_iv: "d7b20b397c2dc717707b2f1522c74bff"
server_key_version: "encryptionkey@0"
I20260805 22:49:43.077922 4245 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:49:43.095991 4245 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:49:43.098337 4245 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:49:43.098474 4245 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:49:43.098724 4245 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:49:43.099210 4304 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260805 22:49:43.101253 4245 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260805 22:49:43.101325 4245 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260805 22:49:43.101364 4245 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260805 22:49:43.102082 4245 ts_tablet_manager.cc:610] Registered 1 tablets
I20260805 22:49:43.102118 4245 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260805 22:49:43.102216 4304 tablet_bootstrap.cc:492] T aff5b695d25a49fd8574f75e1656467c P ad7b0e4ee79f423c8466b1746b3e08e3: Bootstrap starting.
I20260805 22:49:43.109015 4245 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.129:35089
I20260805 22:49:43.109181 4458 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.129:35089 every 8 connection(s)
I20260805 22:49:43.109488 4245 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
I20260805 22:49:43.113607 4304 log.cc:824] T aff5b695d25a49fd8574f75e1656467c P ad7b0e4ee79f423c8466b1746b3e08e3: Log is configured to *not* fsync() on all Append() calls
I20260805 22:49:43.116595 4304 tablet_bootstrap.cc:492] T aff5b695d25a49fd8574f75e1656467c P ad7b0e4ee79f423c8466b1746b3e08e3: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
Aug 05 22:49:43 dist-test-slave-gjrz krb5kdc[3301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970183, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.129@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:49:43.116917 4304 tablet_bootstrap.cc:492] T aff5b695d25a49fd8574f75e1656467c P ad7b0e4ee79f423c8466b1746b3e08e3: Bootstrap complete.
I20260805 22:49:43.118043 4304 ts_tablet_manager.cc:1397] T aff5b695d25a49fd8574f75e1656467c P ad7b0e4ee79f423c8466b1746b3e08e3: Time spent bootstrapping tablet: real 0.016s user 0.009s sys 0.003s
I20260805 22:49:43.118428 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 4245
I20260805 22:49:43.118727 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.130:43247
--local_ip_for_outbound_sockets=127.14.224.130
--tserver_master_addrs=127.14.224.190:35779
--webserver_port=46865
--webserver_interface=127.14.224.130
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab
--principal=kudu/127.14.224.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:38473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 22:49:43.119310 4304 raft_consensus.cc:348] T aff5b695d25a49fd8574f75e1656467c P ad7b0e4ee79f423c8466b1746b3e08e3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad7b0e4ee79f423c8466b1746b3e08e3" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 35089 } } peers { permanent_uuid: "0226d3f5892d454288b70c7be9b14fe4" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 38245 } } peers { permanent_uuid: "cb27643ca3f74737aa87569105fcb0ad" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 43247 } }
I20260805 22:49:43.119634 4304 raft_consensus.cc:729] T aff5b695d25a49fd8574f75e1656467c P ad7b0e4ee79f423c8466b1746b3e08e3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad7b0e4ee79f423c8466b1746b3e08e3, State: Initialized, Role: FOLLOWER
I20260805 22:49:43.119791 4304 consensus_queue.cc:260] T aff5b695d25a49fd8574f75e1656467c P ad7b0e4ee79f423c8466b1746b3e08e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad7b0e4ee79f423c8466b1746b3e08e3" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 35089 } } peers { permanent_uuid: "0226d3f5892d454288b70c7be9b14fe4" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 38245 } } peers { permanent_uuid: "cb27643ca3f74737aa87569105fcb0ad" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 43247 } }
I20260805 22:49:43.120069 4304 ts_tablet_manager.cc:1428] T aff5b695d25a49fd8574f75e1656467c P ad7b0e4ee79f423c8466b1746b3e08e3: Time spent starting tablet: real 0.002s user 0.005s sys 0.000s
I20260805 22:49:43.122535 4465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:43.110242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:35779 (local address 127.14.224.129:55633)
0805 22:49:43.110456 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:43.110508 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0805 22:49:43.110994 (+ 486us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:49:43.111570 (+ 576us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:49:43.111574 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:49:43.111870 (+ 296us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:49:43.112061 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:43.112067 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:43.113202 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:43.113204 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:43.114188 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:43.114192 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:43.114795 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:43.114796 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:43.114926 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:43.115732 (+ 806us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:49:43.115741 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:49:43.117238 (+ 1497us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:49:43.120572 (+ 3334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:49:43.120580 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:49:43.120582 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:49:43.120876 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:49:43.121229 (+ 353us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:49:43.121230 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:49:43.121231 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:49:43.121366 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:49:43.121866 (+ 500us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:49:43.121884 (+ 18us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:49:43.122041 (+ 157us) client_negotiation.cc:769] Sending connection context
0805 22:49:43.122161 (+ 120us) client_negotiation.cc:240] Negotiation successful
0805 22:49:43.122342 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":104,"threads_started":1}
I20260805 22:49:43.122562 4468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:43.110334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.129:55633 (local address 127.14.224.190:35779)
0805 22:49:43.111172 (+ 838us) server_negotiation.cc:206] Beginning negotiation
0805 22:49:43.111180 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:49:43.111208 (+ 28us) server_negotiation.cc:407] Connection header received
0805 22:49:43.111352 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:49:43.111358 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:49:43.111406 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:49:43.111525 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:49:43.112196 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:43.113067 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:43.114283 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:43.114683 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:43.114796 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:43.117352 (+ 2556us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:49:43.117357 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:49:43.117357 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:49:43.117369 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:49:43.119222 (+ 1853us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:43.120975 (+ 1753us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:43.120979 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:43.120979 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:43.121139 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:43.121447 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:43.121448 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:43.121449 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:43.121771 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:49:43.121865 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0805 22:49:43.122230 (+ 365us) server_negotiation.cc:299] Negotiation successful
0805 22:49:43.122377 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":789,"thread_start_us":94,"threads_started":1}
I20260805 22:49:43.124066 4463 heartbeater.cc:347] Connected to a master server at 127.14.224.190:35779
I20260805 22:49:43.124171 4463 heartbeater.cc:464] Registering TS with master...
I20260805 22:49:43.124358 4463 heartbeater.cc:511] Master 127.14.224.190:35779 requested a full tablet report, sending...
I20260805 22:49:43.125227 4184 ts_manager.cc:194] Registered new tserver with Master: ad7b0e4ee79f423c8466b1746b3e08e3 (127.14.224.129:35089)
I20260805 22:49:43.126471 4184 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.224.129@KRBTEST.COM'} at 127.14.224.129:55633
I20260805 22:49:43.127576 4463 heartbeater.cc:503] Master 127.14.224.190:35779 was elected leader, sending a full tablet report...
Aug 05 22:49:43 dist-test-slave-gjrz krb5kdc[3301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970182, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.190@KRBTEST.COM for kudu/127.14.224.129@KRBTEST.COM
I20260805 22:49:43.135251 4473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:43.125915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.129:35089 (local address 127.0.0.1:42798)
0805 22:49:43.126113 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:43.126148 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0805 22:49:43.126207 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:49:43.127137 (+ 930us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:49:43.127145 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:49:43.127546 (+ 401us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:49:43.127615 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:43.127618 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:43.128844 (+ 1226us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:43.128844 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:43.129580 (+ 736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:43.129584 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:43.130239 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:43.130240 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:43.130296 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:43.130836 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:49:43.130840 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:49:43.132262 (+ 1422us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:49:43.134175 (+ 1913us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:49:43.134182 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:49:43.134184 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:49:43.134387 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:49:43.134598 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:49:43.134599 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:49:43.134599 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:49:43.134656 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:49:43.134954 (+ 298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:49:43.134960 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:49:43.135012 (+ 52us) client_negotiation.cc:769] Sending connection context
0805 22:49:43.135072 (+ 60us) client_negotiation.cc:240] Negotiation successful
0805 22:49:43.135176 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":122,"threads_started":1}
I20260805 22:49:43.135358 4474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:43.126801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42798 (local address 127.14.224.129:35089)
0805 22:49:43.126994 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0805 22:49:43.126998 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:49:43.127007 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:49:43.127037 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:49:43.127039 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:49:43.127053 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:49:43.127126 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:49:43.127720 (+ 594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:43.128758 (+ 1038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:43.129691 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:43.130155 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:43.130246 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:43.132353 (+ 2107us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:49:43.132363 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:49:43.132363 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:49:43.132371 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:49:43.134087 (+ 1716us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:43.134466 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:43.134470 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:43.134470 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:43.134536 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:43.134706 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:43.134707 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:43.134707 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:43.134895 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:49:43.134969 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0805 22:49:43.135117 (+ 148us) server_negotiation.cc:299] Negotiation successful
0805 22:49:43.135220 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":107,"threads_started":1}
I20260805 22:49:43.135722 4366 tablet_service.cc:1514] Processing DeleteTablet for tablet aff5b695d25a49fd8574f75e1656467c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:49:42 UTC) from {username='kudu', principal='kudu/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:42798
I20260805 22:49:43.136276 4475 tablet_replica.cc:330] stopping tablet replica
I20260805 22:49:43.136374 4475 raft_consensus.cc:2229] T aff5b695d25a49fd8574f75e1656467c P ad7b0e4ee79f423c8466b1746b3e08e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:49:43.136447 4475 raft_consensus.cc:2258] T aff5b695d25a49fd8574f75e1656467c P ad7b0e4ee79f423c8466b1746b3e08e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:49:43.136754 4475 ts_tablet_manager.cc:1905] T aff5b695d25a49fd8574f75e1656467c P ad7b0e4ee79f423c8466b1746b3e08e3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:49:43.138723 4475 ts_tablet_manager.cc:1918] T aff5b695d25a49fd8574f75e1656467c P ad7b0e4ee79f423c8466b1746b3e08e3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:49:43.138790 4475 log.cc:1196] T aff5b695d25a49fd8574f75e1656467c P ad7b0e4ee79f423c8466b1746b3e08e3: Deleting WAL directory at /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-0/wal/wals/aff5b695d25a49fd8574f75e1656467c
I20260805 22:49:43.138983 4475 ts_tablet_manager.cc:1939] T aff5b695d25a49fd8574f75e1656467c P ad7b0e4ee79f423c8466b1746b3e08e3: Deleting consensus metadata
I20260805 22:49:43.139461 4165 catalog_manager.cc:4841] TS ad7b0e4ee79f423c8466b1746b3e08e3 (127.14.224.129:35089): tablet aff5b695d25a49fd8574f75e1656467c (table test-table [id=5762fbfa971040eab95ba60a4b18570c]) successfully deleted
W20260805 22:49:43.207316 4472 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:49:43.207558 4472 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:49:43.207592 4472 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:49:43.208859 4472 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:49:43.208911 4472 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:49:43.208950 4472 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.130
I20260805 22:49:43.210547 4472 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:38473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab
--principal=kudu/127.14.224.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.130:43247
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.224.130
--webserver_port=46865
--tserver_master_addrs=127.14.224.190:35779
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4472
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.130
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:49:43.210816 4472 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:49:43.211062 4472 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:49:43.216521 4481 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:49:43.216535 4482 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:49:43.216539 4485 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:49:43.216674 4472 server_base.cc:1034] running on GCE node
I20260805 22:49:43.216881 4472 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:49:43.217187 4472 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:49:43.218338 4472 hybrid_clock.cc:648] HybridClock initialized: now 1785970183218325 us; error 37 us; skew 500 ppm
Aug 05 22:49:43 dist-test-slave-gjrz krb5kdc[3301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970183, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:49:43.221064 4472 init.cc:377] Logged in from keytab as kudu/127.14.224.130@KRBTEST.COM (short username kudu)
I20260805 22:49:43.221577 4472 webserver.cc:460] Webserver started at http://127.14.224.130:46865/ using document root <none> and password file <none>
I20260805 22:49:43.221807 4472 fs_manager.cc:359] Metadata directory not provided
I20260805 22:49:43.221890 4472 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:49:43.223389 4472 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260805 22:49:43.224020 4493 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:49:43.224186 4472 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260805 22:49:43.224272 4472 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-1/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-1/wal
uuid: "cb27643ca3f74737aa87569105fcb0ad"
format_stamp: "Formatted at 2026-08-05 22:49:42 on dist-test-slave-gjrz"
server_key: "3e380f3145bbbe7d0dd475cc31b03612"
server_key_iv: "3bf1de543a29e901b1f15439300b7071"
server_key_version: "encryptionkey@0"
I20260805 22:49:43.224632 4472 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:49:43.238283 4472 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:49:43.240204 4472 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:49:43.240355 4472 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:49:43.240581 4472 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:49:43.240904 4472 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:49:43.240955 4472 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:49:43.240985 4472 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:49:43.241008 4472 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:49:43.246945 4472 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.130:43247
I20260805 22:49:43.246999 4671 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.130:43247 every 8 connection(s)
I20260805 22:49:43.247390 4472 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
Aug 05 22:49:43 dist-test-slave-gjrz krb5kdc[3301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970183, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.130@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:49:43.255744 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 4472
I20260805 22:49:43.256050 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.131:38245
--local_ip_for_outbound_sockets=127.14.224.131
--tserver_master_addrs=127.14.224.190:35779
--webserver_port=45917
--webserver_interface=127.14.224.131
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab
--principal=kudu/127.14.224.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:38473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 22:49:43.256528 4468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:43.248110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:38371 (local address 127.14.224.190:35779)
0805 22:49:43.248168 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0805 22:49:43.248170 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:49:43.248366 (+ 196us) server_negotiation.cc:407] Connection header received
0805 22:49:43.248844 (+ 478us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:49:43.248845 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:49:43.248856 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:49:43.248906 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:49:43.249896 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:43.250397 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:43.251434 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:43.251636 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:43.251688 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:43.253778 (+ 2090us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:49:43.253780 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:49:43.253780 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:49:43.253788 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:49:43.254987 (+ 1199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:43.255409 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:43.255415 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:43.255416 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:43.255476 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:43.255760 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:43.255761 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:43.255761 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:43.255893 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:49:43.255957 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0805 22:49:43.256324 (+ 367us) server_negotiation.cc:299] Negotiation successful
0805 22:49:43.256431 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260805 22:49:43.256711 4677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:43.248107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:35779 (local address 127.14.224.130:38371)
0805 22:49:43.248245 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:43.248281 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0805 22:49:43.248760 (+ 479us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:49:43.248962 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:49:43.248965 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:49:43.249591 (+ 626us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:49:43.249798 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:43.249803 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:43.250483 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:43.250484 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:43.251354 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:43.251357 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:43.251697 (+ 340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:43.251698 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:43.251796 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:43.252286 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:49:43.252295 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:49:43.253662 (+ 1367us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:49:43.255060 (+ 1398us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:49:43.255067 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:49:43.255069 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:49:43.255337 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:49:43.255541 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:49:43.255541 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:49:43.255542 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:49:43.255696 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:49:43.255991 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:49:43.256001 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:49:43.256178 (+ 177us) client_negotiation.cc:769] Sending connection context
0805 22:49:43.256289 (+ 111us) client_negotiation.cc:240] Negotiation successful
0805 22:49:43.256481 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":71,"threads_started":1}
I20260805 22:49:43.257187 4673 heartbeater.cc:347] Connected to a master server at 127.14.224.190:35779
I20260805 22:49:43.257301 4673 heartbeater.cc:464] Registering TS with master...
I20260805 22:49:43.257505 4673 heartbeater.cc:511] Master 127.14.224.190:35779 requested a full tablet report, sending...
I20260805 22:49:43.257964 4184 ts_manager.cc:194] Registered new tserver with Master: cb27643ca3f74737aa87569105fcb0ad (127.14.224.130:43247)
I20260805 22:49:43.258455 4184 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.224.130@KRBTEST.COM'} at 127.14.224.130:38371
W20260805 22:49:43.339365 4678 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:49:43.339576 4678 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:49:43.339607 4678 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:49:43.340811 4678 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:49:43.340859 4678 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:49:43.340886 4678 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.131
I20260805 22:49:43.342439 4678 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:38473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab
--principal=kudu/127.14.224.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.131:38245
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.224.131
--webserver_port=45917
--tserver_master_addrs=127.14.224.190:35779
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4678
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.131
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:49:43.342689 4678 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:49:43.342916 4678 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260805 22:49:43.348249 4678 server_base.cc:1034] running on GCE node
W20260805 22:49:43.348222 4688 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:49:43.348338 4691 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:49:43.348253 4687 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:49:43.348647 4678 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:49:43.348917 4678 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:49:43.350055 4678 hybrid_clock.cc:648] HybridClock initialized: now 1785970183350037 us; error 34 us; skew 500 ppm
Aug 05 22:49:43 dist-test-slave-gjrz krb5kdc[3301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970183, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:49:43.352748 4678 init.cc:377] Logged in from keytab as kudu/127.14.224.131@KRBTEST.COM (short username kudu)
I20260805 22:49:43.353223 4678 webserver.cc:460] Webserver started at http://127.14.224.131:45917/ using document root <none> and password file <none>
I20260805 22:49:43.353436 4678 fs_manager.cc:359] Metadata directory not provided
I20260805 22:49:43.353505 4678 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:49:43.354950 4678 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:49:43.355628 4698 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:49:43.355787 4678 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:49:43.355883 4678 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-2/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-2/wal
uuid: "0226d3f5892d454288b70c7be9b14fe4"
format_stamp: "Formatted at 2026-08-05 22:49:42 on dist-test-slave-gjrz"
server_key: "9f82dbd6e436516c49cf795a2eaeaf11"
server_key_iv: "00850de1db3af757f5257071c91179fd"
server_key_version: "encryptionkey@0"
I20260805 22:49:43.356281 4678 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:49:43.380808 4678 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:49:43.383004 4678 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:49:43.383153 4678 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:49:43.383409 4678 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:49:43.383716 4678 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:49:43.383752 4678 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:49:43.383783 4678 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:49:43.383806 4678 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:49:43.389243 4678 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.131:38245
I20260805 22:49:43.389288 4875 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.131:38245 every 8 connection(s)
I20260805 22:49:43.389639 4678 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
I20260805 22:49:43.392791 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 4678
Aug 05 22:49:43 dist-test-slave-gjrz krb5kdc[3301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970183, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.131@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:49:43.398994 4468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:43.390326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:55873 (local address 127.14.224.190:35779)
0805 22:49:43.390391 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0805 22:49:43.390394 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:49:43.390600 (+ 206us) server_negotiation.cc:407] Connection header received
0805 22:49:43.391073 (+ 473us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:49:43.391074 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:49:43.391085 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:49:43.391132 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:49:43.392086 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:43.392615 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:43.393675 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:43.393975 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:43.394045 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:43.396201 (+ 2156us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:49:43.396203 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:49:43.396203 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:49:43.396211 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:49:43.397492 (+ 1281us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:43.397976 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:43.397977 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:43.397977 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:43.398042 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:43.398310 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:43.398311 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:43.398311 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:43.398422 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:49:43.398476 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0805 22:49:43.398816 (+ 340us) server_negotiation.cc:299] Negotiation successful
0805 22:49:43.398896 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260805 22:49:43.399389 4879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:43.390318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:35779 (local address 127.14.224.131:55873)
0805 22:49:43.390484 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:43.390520 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0805 22:49:43.390994 (+ 474us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:49:43.391193 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:49:43.391196 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:49:43.391793 (+ 597us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:49:43.391990 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:43.391996 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:43.392693 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:43.392693 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:43.393596 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:43.393599 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:43.394056 (+ 457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:43.394057 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:43.394210 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:43.394777 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:49:43.394786 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:49:43.396120 (+ 1334us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:49:43.397574 (+ 1454us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:49:43.397583 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:49:43.397585 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:49:43.397894 (+ 309us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:49:43.398100 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:49:43.398100 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:49:43.398101 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:49:43.398242 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:49:43.398483 (+ 241us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:49:43.398491 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:49:43.398667 (+ 176us) client_negotiation.cc:769] Sending connection context
0805 22:49:43.398782 (+ 115us) client_negotiation.cc:240] Negotiation successful
0805 22:49:43.398922 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":93,"threads_started":1}
I20260805 22:49:43.399884 4877 heartbeater.cc:347] Connected to a master server at 127.14.224.190:35779
I20260805 22:49:43.399963 4882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:43.393215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40808 (local address 127.14.224.190:35779)
0805 22:49:43.393332 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0805 22:49:43.393334 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:49:43.393342 (+ 8us) server_negotiation.cc:407] Connection header received
0805 22:49:43.393362 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:49:43.393363 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:49:43.393374 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:49:43.393430 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:49:43.394066 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:43.394670 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:43.395460 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:43.395667 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:43.395723 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:43.397219 (+ 1496us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:49:43.397220 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:49:43.397220 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:49:43.397227 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:49:43.398683 (+ 1456us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:43.399057 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:43.399058 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:43.399058 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:43.399120 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:43.399318 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:43.399319 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:43.399319 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:43.399447 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:49:43.399613 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0805 22:49:43.399796 (+ 183us) server_negotiation.cc:299] Negotiation successful
0805 22:49:43.399880 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99,"thread_start_us":66,"threads_started":1}
I20260805 22:49:43.399991 4877 heartbeater.cc:464] Registering TS with master...
I20260805 22:49:43.400194 4877 heartbeater.cc:511] Master 127.14.224.190:35779 requested a full tablet report, sending...
I20260805 22:49:43.400579 4183 ts_manager.cc:194] Registered new tserver with Master: 0226d3f5892d454288b70c7be9b14fe4 (127.14.224.131:38245)
I20260805 22:49:43.400955 4183 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.224.131@KRBTEST.COM'} at 127.14.224.131:55873
I20260805 22:49:43.411687 15234 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 22:49:43.414644 4882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:43.412077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40818 (local address 127.14.224.190:35779)
0805 22:49:43.412134 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0805 22:49:43.412136 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:49:43.412251 (+ 115us) server_negotiation.cc:407] Connection header received
0805 22:49:43.412337 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:49:43.412338 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:49:43.412377 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:49:43.412441 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:49:43.412595 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:43.413089 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:43.413849 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:43.414072 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:43.414131 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:43.414305 (+ 174us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:49:43.414420 (+ 115us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:49:43.414514 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0805 22:49:43.414533 (+ 19us) server_negotiation.cc:299] Negotiation successful
0805 22:49:43.414561 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260805 22:49:43.415055 4183 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:40818:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:49:43.416801 4183 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:49:43.418853 4366 tablet_service.cc:1467] Processing CreateTablet for tablet 79413224c1ad4b75aa4be39c3dd94f14 (DEFAULT_TABLE table=test-table [id=b76d0b32450f4a9eabb22a6b1eb89c8b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:49:43.419075 4366 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 79413224c1ad4b75aa4be39c3dd94f14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:49:43.421545 4304 tablet_bootstrap.cc:492] T 79413224c1ad4b75aa4be39c3dd94f14 P ad7b0e4ee79f423c8466b1746b3e08e3: Bootstrap starting.
I20260805 22:49:43.421916 4304 tablet_bootstrap.cc:654] T 79413224c1ad4b75aa4be39c3dd94f14 P ad7b0e4ee79f423c8466b1746b3e08e3: Neither blocks nor log segments found. Creating new log.
I20260805 22:49:43.422581 4473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:43.418603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.131:38245 (local address 127.0.0.1:40288)
0805 22:49:43.418656 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:43.418666 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0805 22:49:43.418705 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:49:43.419089 (+ 384us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:49:43.419091 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:49:43.419092 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:49:43.419161 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:43.419163 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:43.420292 (+ 1129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:43.420293 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:43.421390 (+ 1097us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:43.421393 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:43.422298 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:43.422299 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:43.422376 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:43.422401 (+ 25us) client_negotiation.cc:769] Sending connection context
0805 22:49:43.422452 (+ 51us) client_negotiation.cc:240] Negotiation successful
0805 22:49:43.422507 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260805 22:49:43.422822 4304 tablet_bootstrap.cc:492] T 79413224c1ad4b75aa4be39c3dd94f14 P ad7b0e4ee79f423c8466b1746b3e08e3: No bootstrap required, opened a new log
I20260805 22:49:43.422873 4304 ts_tablet_manager.cc:1397] T 79413224c1ad4b75aa4be39c3dd94f14 P ad7b0e4ee79f423c8466b1746b3e08e3: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260805 22:49:43.422963 4886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:43.418704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40288 (local address 127.14.224.131:38245)
0805 22:49:43.418931 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0805 22:49:43.418936 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:49:43.418945 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:49:43.418985 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:49:43.418987 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:49:43.419001 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:49:43.419073 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:49:43.419235 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:43.420198 (+ 963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:43.421487 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:43.422219 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:43.422295 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:43.422358 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0805 22:49:43.422833 (+ 475us) server_negotiation.cc:299] Negotiation successful
0805 22:49:43.422880 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":194,"thread_start_us":103,"threads_started":1}
I20260805 22:49:43.423014 4304 raft_consensus.cc:348] T 79413224c1ad4b75aa4be39c3dd94f14 P ad7b0e4ee79f423c8466b1746b3e08e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0226d3f5892d454288b70c7be9b14fe4" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 38245 } } peers { permanent_uuid: "cb27643ca3f74737aa87569105fcb0ad" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 43247 } } peers { permanent_uuid: "ad7b0e4ee79f423c8466b1746b3e08e3" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 35089 } }
I20260805 22:49:43.423095 4304 raft_consensus.cc:374] T 79413224c1ad4b75aa4be39c3dd94f14 P ad7b0e4ee79f423c8466b1746b3e08e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:49:43.423149 4304 raft_consensus.cc:729] T 79413224c1ad4b75aa4be39c3dd94f14 P ad7b0e4ee79f423c8466b1746b3e08e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad7b0e4ee79f423c8466b1746b3e08e3, State: Initialized, Role: FOLLOWER
I20260805 22:49:43.423204 4304 consensus_queue.cc:260] T 79413224c1ad4b75aa4be39c3dd94f14 P ad7b0e4ee79f423c8466b1746b3e08e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0226d3f5892d454288b70c7be9b14fe4" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 38245 } } peers { permanent_uuid: "cb27643ca3f74737aa87569105fcb0ad" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 43247 } } peers { permanent_uuid: "ad7b0e4ee79f423c8466b1746b3e08e3" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 35089 } }
I20260805 22:49:43.423317 4304 ts_tablet_manager.cc:1428] T 79413224c1ad4b75aa4be39c3dd94f14 P ad7b0e4ee79f423c8466b1746b3e08e3: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260805 22:49:43.423931 4885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:43.418657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.130:43247 (local address 127.0.0.1:34602)
0805 22:49:43.418826 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:43.418835 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0805 22:49:43.418875 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:49:43.419401 (+ 526us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:49:43.419402 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:49:43.419405 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:49:43.419443 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:43.419444 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:43.420648 (+ 1204us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:43.420649 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:43.421656 (+ 1007us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:43.421658 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:43.422620 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:43.422621 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:43.423640 (+ 1019us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:43.423646 (+ 6us) client_negotiation.cc:769] Sending connection context
0805 22:49:43.423798 (+ 152us) client_negotiation.cc:240] Negotiation successful
0805 22:49:43.423854 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":120,"threads_started":1}
I20260805 22:49:43.423949 4887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:43.418946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34602 (local address 127.14.224.130:43247)
0805 22:49:43.419200 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0805 22:49:43.419204 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:49:43.419216 (+ 12us) server_negotiation.cc:407] Connection header received
0805 22:49:43.419255 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:49:43.419257 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:49:43.419301 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:49:43.419387 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:49:43.419523 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:43.420533 (+ 1010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:43.421753 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:43.422534 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:43.422610 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:43.422665 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0805 22:49:43.423814 (+ 1149us) server_negotiation.cc:299] Negotiation successful
0805 22:49:43.423866 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":222,"thread_start_us":103,"threads_started":1}
I20260805 22:49:43.424129 4772 tablet_service.cc:1467] Processing CreateTablet for tablet 79413224c1ad4b75aa4be39c3dd94f14 (DEFAULT_TABLE table=test-table [id=b76d0b32450f4a9eabb22a6b1eb89c8b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:49:43.424515 4772 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 79413224c1ad4b75aa4be39c3dd94f14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:49:43.424639 4566 tablet_service.cc:1467] Processing CreateTablet for tablet 79413224c1ad4b75aa4be39c3dd94f14 (DEFAULT_TABLE table=test-table [id=b76d0b32450f4a9eabb22a6b1eb89c8b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:49:43.424904 4566 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 79413224c1ad4b75aa4be39c3dd94f14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:49:43.427318 4889 tablet_bootstrap.cc:492] T 79413224c1ad4b75aa4be39c3dd94f14 P 0226d3f5892d454288b70c7be9b14fe4: Bootstrap starting.
I20260805 22:49:43.427947 4891 tablet_bootstrap.cc:492] T 79413224c1ad4b75aa4be39c3dd94f14 P cb27643ca3f74737aa87569105fcb0ad: Bootstrap starting.
I20260805 22:49:43.427997 4889 tablet_bootstrap.cc:654] T 79413224c1ad4b75aa4be39c3dd94f14 P 0226d3f5892d454288b70c7be9b14fe4: Neither blocks nor log segments found. Creating new log.
I20260805 22:49:43.428508 4889 log.cc:824] T 79413224c1ad4b75aa4be39c3dd94f14 P 0226d3f5892d454288b70c7be9b14fe4: Log is configured to *not* fsync() on all Append() calls
I20260805 22:49:43.428647 4891 tablet_bootstrap.cc:654] T 79413224c1ad4b75aa4be39c3dd94f14 P cb27643ca3f74737aa87569105fcb0ad: Neither blocks nor log segments found. Creating new log.
I20260805 22:49:43.429196 4891 log.cc:824] T 79413224c1ad4b75aa4be39c3dd94f14 P cb27643ca3f74737aa87569105fcb0ad: Log is configured to *not* fsync() on all Append() calls
I20260805 22:49:43.429327 4889 tablet_bootstrap.cc:492] T 79413224c1ad4b75aa4be39c3dd94f14 P 0226d3f5892d454288b70c7be9b14fe4: No bootstrap required, opened a new log
I20260805 22:49:43.429399 4889 ts_tablet_manager.cc:1397] T 79413224c1ad4b75aa4be39c3dd94f14 P 0226d3f5892d454288b70c7be9b14fe4: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260805 22:49:43.430773 4889 raft_consensus.cc:348] T 79413224c1ad4b75aa4be39c3dd94f14 P 0226d3f5892d454288b70c7be9b14fe4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0226d3f5892d454288b70c7be9b14fe4" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 38245 } } peers { permanent_uuid: "cb27643ca3f74737aa87569105fcb0ad" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 43247 } } peers { permanent_uuid: "ad7b0e4ee79f423c8466b1746b3e08e3" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 35089 } }
I20260805 22:49:43.430974 4889 raft_consensus.cc:374] T 79413224c1ad4b75aa4be39c3dd94f14 P 0226d3f5892d454288b70c7be9b14fe4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:49:43.431020 4889 raft_consensus.cc:729] T 79413224c1ad4b75aa4be39c3dd94f14 P 0226d3f5892d454288b70c7be9b14fe4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0226d3f5892d454288b70c7be9b14fe4, State: Initialized, Role: FOLLOWER
I20260805 22:49:43.431150 4889 consensus_queue.cc:260] T 79413224c1ad4b75aa4be39c3dd94f14 P 0226d3f5892d454288b70c7be9b14fe4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0226d3f5892d454288b70c7be9b14fe4" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 38245 } } peers { permanent_uuid: "cb27643ca3f74737aa87569105fcb0ad" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 43247 } } peers { permanent_uuid: "ad7b0e4ee79f423c8466b1746b3e08e3" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 35089 } }
I20260805 22:49:43.431465 4889 ts_tablet_manager.cc:1428] T 79413224c1ad4b75aa4be39c3dd94f14 P 0226d3f5892d454288b70c7be9b14fe4: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260805 22:49:43.431478 4877 heartbeater.cc:503] Master 127.14.224.190:35779 was elected leader, sending a full tablet report...
I20260805 22:49:43.432181 4891 tablet_bootstrap.cc:492] T 79413224c1ad4b75aa4be39c3dd94f14 P cb27643ca3f74737aa87569105fcb0ad: No bootstrap required, opened a new log
I20260805 22:49:43.432260 4891 ts_tablet_manager.cc:1397] T 79413224c1ad4b75aa4be39c3dd94f14 P cb27643ca3f74737aa87569105fcb0ad: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260805 22:49:43.433743 4891 raft_consensus.cc:348] T 79413224c1ad4b75aa4be39c3dd94f14 P cb27643ca3f74737aa87569105fcb0ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0226d3f5892d454288b70c7be9b14fe4" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 38245 } } peers { permanent_uuid: "cb27643ca3f74737aa87569105fcb0ad" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 43247 } } peers { permanent_uuid: "ad7b0e4ee79f423c8466b1746b3e08e3" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 35089 } }
I20260805 22:49:43.433892 4891 raft_consensus.cc:374] T 79413224c1ad4b75aa4be39c3dd94f14 P cb27643ca3f74737aa87569105fcb0ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:49:43.433925 4891 raft_consensus.cc:729] T 79413224c1ad4b75aa4be39c3dd94f14 P cb27643ca3f74737aa87569105fcb0ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb27643ca3f74737aa87569105fcb0ad, State: Initialized, Role: FOLLOWER
I20260805 22:49:43.434051 4891 consensus_queue.cc:260] T 79413224c1ad4b75aa4be39c3dd94f14 P cb27643ca3f74737aa87569105fcb0ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0226d3f5892d454288b70c7be9b14fe4" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 38245 } } peers { permanent_uuid: "cb27643ca3f74737aa87569105fcb0ad" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 43247 } } peers { permanent_uuid: "ad7b0e4ee79f423c8466b1746b3e08e3" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 35089 } }
I20260805 22:49:43.434345 4891 ts_tablet_manager.cc:1428] T 79413224c1ad4b75aa4be39c3dd94f14 P cb27643ca3f74737aa87569105fcb0ad: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260805 22:49:43.434372 4673 heartbeater.cc:503] Master 127.14.224.190:35779 was elected leader, sending a full tablet report...
W20260805 22:49:43.497922 4675 tablet.cc:2369] T 79413224c1ad4b75aa4be39c3dd94f14 P cb27643ca3f74737aa87569105fcb0ad: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260805 22:49:43.610433 4464 tablet.cc:2369] T 79413224c1ad4b75aa4be39c3dd94f14 P ad7b0e4ee79f423c8466b1746b3e08e3: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260805 22:49:43.640201 4878 tablet.cc:2369] T 79413224c1ad4b75aa4be39c3dd94f14 P 0226d3f5892d454288b70c7be9b14fe4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:49:43.642850 4899 raft_consensus.cc:482] T 79413224c1ad4b75aa4be39c3dd94f14 P cb27643ca3f74737aa87569105fcb0ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:49:43.642982 4899 raft_consensus.cc:504] T 79413224c1ad4b75aa4be39c3dd94f14 P cb27643ca3f74737aa87569105fcb0ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0226d3f5892d454288b70c7be9b14fe4" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 38245 } } peers { permanent_uuid: "cb27643ca3f74737aa87569105fcb0ad" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 43247 } } peers { permanent_uuid: "ad7b0e4ee79f423c8466b1746b3e08e3" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 35089 } }
I20260805 22:49:43.643383 4899 leader_election.cc:288] T 79413224c1ad4b75aa4be39c3dd94f14 P cb27643ca3f74737aa87569105fcb0ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0226d3f5892d454288b70c7be9b14fe4 (127.14.224.131:38245), ad7b0e4ee79f423c8466b1746b3e08e3 (127.14.224.129:35089)
I20260805 22:49:43.647291 4886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:43.643666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:58381 (local address 127.14.224.131:38245)
0805 22:49:43.643721 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0805 22:49:43.643723 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:49:43.643941 (+ 218us) server_negotiation.cc:407] Connection header received
0805 22:49:43.644001 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:49:43.644002 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:49:43.644013 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:49:43.644078 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:49:43.644179 (+ 101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:43.644862 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:43.646349 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:43.646918 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:43.647000 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:43.647011 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0805 22:49:43.647152 (+ 141us) server_negotiation.cc:299] Negotiation successful
0805 22:49:43.647193 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260805 22:49:43.647294 4900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:43.643644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:48115 (local address 127.14.224.129:35089)
0805 22:49:43.643787 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0805 22:49:43.643789 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:49:43.643797 (+ 8us) server_negotiation.cc:407] Connection header received
0805 22:49:43.643824 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:49:43.643825 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:49:43.643846 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:49:43.643917 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:49:43.644097 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:43.644869 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:43.646349 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:43.646959 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:43.647018 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:43.647090 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0805 22:49:43.647160 (+ 70us) server_negotiation.cc:299] Negotiation successful
0805 22:49:43.647198 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":78,"threads_started":1}
I20260805 22:49:43.647310 4677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:43.643573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.129:35089 (local address 127.14.224.130:48115)
0805 22:49:43.643614 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:43.643627 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0805 22:49:43.643676 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:49:43.643938 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:49:43.643939 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:49:43.643940 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:49:43.644037 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:43.644040 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:43.644940 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:43.644941 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:43.646259 (+ 1318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:43.646262 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:43.647036 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:43.647037 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:43.647103 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:43.647105 (+ 2us) client_negotiation.cc:769] Sending connection context
0805 22:49:43.647152 (+ 47us) client_negotiation.cc:240] Negotiation successful
0805 22:49:43.647186 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19,"mutex_wait_us":44}
I20260805 22:49:43.647428 4902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:43.643579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.131:38245 (local address 127.14.224.130:58381)
0805 22:49:43.643871 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:43.643881 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0805 22:49:43.643938 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:49:43.644084 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:49:43.644085 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:49:43.644086 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:49:43.644138 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:43.644139 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:43.644940 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:43.644941 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:43.646259 (+ 1318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:43.646262 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:43.646999 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:43.647000 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:43.647079 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:43.647085 (+ 6us) client_negotiation.cc:769] Sending connection context
0805 22:49:43.647138 (+ 53us) client_negotiation.cc:240] Negotiation successful
0805 22:49:43.647186 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":275,"mutex_wait_us":207,"thread_start_us":86,"threads_started":1}
I20260805 22:49:43.647675 4394 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79413224c1ad4b75aa4be39c3dd94f14" candidate_uuid: "cb27643ca3f74737aa87569105fcb0ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad7b0e4ee79f423c8466b1746b3e08e3" is_pre_election: true
I20260805 22:49:43.647715 4800 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79413224c1ad4b75aa4be39c3dd94f14" candidate_uuid: "cb27643ca3f74737aa87569105fcb0ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0226d3f5892d454288b70c7be9b14fe4" is_pre_election: true
I20260805 22:49:43.647835 4394 raft_consensus.cc:2454] T 79413224c1ad4b75aa4be39c3dd94f14 P ad7b0e4ee79f423c8466b1746b3e08e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb27643ca3f74737aa87569105fcb0ad in term 0.
I20260805 22:49:43.647853 4800 raft_consensus.cc:2454] T 79413224c1ad4b75aa4be39c3dd94f14 P 0226d3f5892d454288b70c7be9b14fe4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb27643ca3f74737aa87569105fcb0ad in term 0.
I20260805 22:49:43.648068 4502 leader_election.cc:302] T 79413224c1ad4b75aa4be39c3dd94f14 P cb27643ca3f74737aa87569105fcb0ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad7b0e4ee79f423c8466b1746b3e08e3, cb27643ca3f74737aa87569105fcb0ad; no voters:
I20260805 22:49:43.648265 4899 raft_consensus.cc:2781] T 79413224c1ad4b75aa4be39c3dd94f14 P cb27643ca3f74737aa87569105fcb0ad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:49:43.648306 4899 raft_consensus.cc:482] T 79413224c1ad4b75aa4be39c3dd94f14 P cb27643ca3f74737aa87569105fcb0ad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:49:43.648327 4899 raft_consensus.cc:3037] T 79413224c1ad4b75aa4be39c3dd94f14 P cb27643ca3f74737aa87569105fcb0ad [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:49:43.649016 4899 raft_consensus.cc:504] T 79413224c1ad4b75aa4be39c3dd94f14 P cb27643ca3f74737aa87569105fcb0ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0226d3f5892d454288b70c7be9b14fe4" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 38245 } } peers { permanent_uuid: "cb27643ca3f74737aa87569105fcb0ad" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 43247 } } peers { permanent_uuid: "ad7b0e4ee79f423c8466b1746b3e08e3" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 35089 } }
I20260805 22:49:43.649152 4899 leader_election.cc:288] T 79413224c1ad4b75aa4be39c3dd94f14 P cb27643ca3f74737aa87569105fcb0ad [CANDIDATE]: Term 1 election: Requested vote from peers 0226d3f5892d454288b70c7be9b14fe4 (127.14.224.131:38245), ad7b0e4ee79f423c8466b1746b3e08e3 (127.14.224.129:35089)
I20260805 22:49:43.649292 4800 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79413224c1ad4b75aa4be39c3dd94f14" candidate_uuid: "cb27643ca3f74737aa87569105fcb0ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0226d3f5892d454288b70c7be9b14fe4"
I20260805 22:49:43.649376 4800 raft_consensus.cc:3037] T 79413224c1ad4b75aa4be39c3dd94f14 P 0226d3f5892d454288b70c7be9b14fe4 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:49:43.649371 4394 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79413224c1ad4b75aa4be39c3dd94f14" candidate_uuid: "cb27643ca3f74737aa87569105fcb0ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad7b0e4ee79f423c8466b1746b3e08e3"
I20260805 22:49:43.649451 4394 raft_consensus.cc:3037] T 79413224c1ad4b75aa4be39c3dd94f14 P ad7b0e4ee79f423c8466b1746b3e08e3 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:49:43.650050 4800 raft_consensus.cc:2454] T 79413224c1ad4b75aa4be39c3dd94f14 P 0226d3f5892d454288b70c7be9b14fe4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb27643ca3f74737aa87569105fcb0ad in term 1.
I20260805 22:49:43.650164 4394 raft_consensus.cc:2454] T 79413224c1ad4b75aa4be39c3dd94f14 P ad7b0e4ee79f423c8466b1746b3e08e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb27643ca3f74737aa87569105fcb0ad in term 1.
I20260805 22:49:43.650225 4498 leader_election.cc:302] T 79413224c1ad4b75aa4be39c3dd94f14 P cb27643ca3f74737aa87569105fcb0ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0226d3f5892d454288b70c7be9b14fe4, cb27643ca3f74737aa87569105fcb0ad; no voters:
I20260805 22:49:43.650310 4899 raft_consensus.cc:2781] T 79413224c1ad4b75aa4be39c3dd94f14 P cb27643ca3f74737aa87569105fcb0ad [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:49:43.650449 4899 raft_consensus.cc:686] T 79413224c1ad4b75aa4be39c3dd94f14 P cb27643ca3f74737aa87569105fcb0ad [term 1 LEADER]: Becoming Leader. State: Replica: cb27643ca3f74737aa87569105fcb0ad, State: Running, Role: LEADER
I20260805 22:49:43.650552 4899 consensus_queue.cc:237] T 79413224c1ad4b75aa4be39c3dd94f14 P cb27643ca3f74737aa87569105fcb0ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0226d3f5892d454288b70c7be9b14fe4" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 38245 } } peers { permanent_uuid: "cb27643ca3f74737aa87569105fcb0ad" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 43247 } } peers { permanent_uuid: "ad7b0e4ee79f423c8466b1746b3e08e3" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 35089 } }
I20260805 22:49:43.651342 4183 catalog_manager.cc:5495] T 79413224c1ad4b75aa4be39c3dd94f14 P cb27643ca3f74737aa87569105fcb0ad reported cstate change: term changed from 0 to 1, leader changed from <none> to cb27643ca3f74737aa87569105fcb0ad (127.14.224.130). New cstate: current_term: 1 leader_uuid: "cb27643ca3f74737aa87569105fcb0ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0226d3f5892d454288b70c7be9b14fe4" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 38245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb27643ca3f74737aa87569105fcb0ad" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 43247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad7b0e4ee79f423c8466b1746b3e08e3" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 35089 } health_report { overall_health: UNKNOWN } } }
I20260805 22:49:43.709903 4887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:43.707611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34608 (local address 127.14.224.130:43247)
0805 22:49:43.707664 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0805 22:49:43.707666 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:49:43.707674 (+ 8us) server_negotiation.cc:407] Connection header received
0805 22:49:43.707711 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:49:43.707712 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:49:43.707731 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:49:43.707792 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:49:43.707891 (+ 99us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:43.708358 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:43.709067 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:43.709267 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:43.709330 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:43.709536 (+ 206us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:49:43.709649 (+ 113us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:49:43.709716 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0805 22:49:43.709793 (+ 77us) server_negotiation.cc:299] Negotiation successful
0805 22:49:43.709814 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260805 22:49:43.711889 4800 raft_consensus.cc:1261] T 79413224c1ad4b75aa4be39c3dd94f14 P 0226d3f5892d454288b70c7be9b14fe4 [term 1 FOLLOWER]: Refusing update from remote peer cb27643ca3f74737aa87569105fcb0ad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:49:43.711889 4394 raft_consensus.cc:1261] T 79413224c1ad4b75aa4be39c3dd94f14 P ad7b0e4ee79f423c8466b1746b3e08e3 [term 1 FOLLOWER]: Refusing update from remote peer cb27643ca3f74737aa87569105fcb0ad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:49:43.712260 4899 consensus_queue.cc:1035] T 79413224c1ad4b75aa4be39c3dd94f14 P cb27643ca3f74737aa87569105fcb0ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad7b0e4ee79f423c8466b1746b3e08e3" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 35089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:49:43.712471 4903 consensus_queue.cc:1035] T 79413224c1ad4b75aa4be39c3dd94f14 P cb27643ca3f74737aa87569105fcb0ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0226d3f5892d454288b70c7be9b14fe4" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 38245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:49:43.715049 4906 mvcc.cc:205] Tried to move back new op lower bound from 7315333872480608256 to 7315333872233172992. Current Snapshot: MvccSnapshot[applied={T|T < 7315333872480608256}]
I20260805 22:49:43.717149 4184 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:40818:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:49:43.717252 4184 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:40818:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:49:43.718011 4184 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 52b0fdfef10048eb80deb2aaf54a2937: Sending DeleteTablet for 3 replicas of tablet 79413224c1ad4b75aa4be39c3dd94f14
I20260805 22:49:43.718289 4366 tablet_service.cc:1514] Processing DeleteTablet for tablet 79413224c1ad4b75aa4be39c3dd94f14 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:49:43 UTC) from {username='kudu', principal='kudu/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:42798
I20260805 22:49:43.718364 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 4245
I20260805 22:49:43.718338 4772 tablet_service.cc:1514] Processing DeleteTablet for tablet 79413224c1ad4b75aa4be39c3dd94f14 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:49:43 UTC) from {username='kudu', principal='kudu/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:40288
I20260805 22:49:43.719033 4566 tablet_service.cc:1514] Processing DeleteTablet for tablet 79413224c1ad4b75aa4be39c3dd94f14 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:49:43 UTC) from {username='kudu', principal='kudu/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:34602
I20260805 22:49:43.722373 4917 tablet_replica.cc:330] T 79413224c1ad4b75aa4be39c3dd94f14 P 0226d3f5892d454288b70c7be9b14fe4: stopping tablet replica
I20260805 22:49:43.722586 4917 raft_consensus.cc:2229] T 79413224c1ad4b75aa4be39c3dd94f14 P 0226d3f5892d454288b70c7be9b14fe4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:49:43.722819 4917 raft_consensus.cc:2258] T 79413224c1ad4b75aa4be39c3dd94f14 P 0226d3f5892d454288b70c7be9b14fe4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:49:43.723524 4917 ts_tablet_manager.cc:1905] T 79413224c1ad4b75aa4be39c3dd94f14 P 0226d3f5892d454288b70c7be9b14fe4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:49:43.726569 4917 ts_tablet_manager.cc:1918] T 79413224c1ad4b75aa4be39c3dd94f14 P 0226d3f5892d454288b70c7be9b14fe4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:49:43.726683 4917 log.cc:1196] T 79413224c1ad4b75aa4be39c3dd94f14 P 0226d3f5892d454288b70c7be9b14fe4: Deleting WAL directory at /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-2/wal/wals/79413224c1ad4b75aa4be39c3dd94f14
I20260805 22:49:43.727200 4917 ts_tablet_manager.cc:1939] T 79413224c1ad4b75aa4be39c3dd94f14 P 0226d3f5892d454288b70c7be9b14fe4: Deleting consensus metadata
I20260805 22:49:43.727875 4162 catalog_manager.cc:4841] TS 0226d3f5892d454288b70c7be9b14fe4 (127.14.224.131:38245): tablet 79413224c1ad4b75aa4be39c3dd94f14 (table test-table [id=b76d0b32450f4a9eabb22a6b1eb89c8b]) successfully deleted
I20260805 22:49:43.730185 4920 tablet_replica.cc:330] T 79413224c1ad4b75aa4be39c3dd94f14 P cb27643ca3f74737aa87569105fcb0ad: stopping tablet replica
I20260805 22:49:43.730341 4920 raft_consensus.cc:2229] T 79413224c1ad4b75aa4be39c3dd94f14 P cb27643ca3f74737aa87569105fcb0ad [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:49:43.730468 4920 raft_consensus.cc:2258] T 79413224c1ad4b75aa4be39c3dd94f14 P cb27643ca3f74737aa87569105fcb0ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:49:43.734360 4920 ts_tablet_manager.cc:1905] T 79413224c1ad4b75aa4be39c3dd94f14 P cb27643ca3f74737aa87569105fcb0ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:49:43.736326 4920 ts_tablet_manager.cc:1918] T 79413224c1ad4b75aa4be39c3dd94f14 P cb27643ca3f74737aa87569105fcb0ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:49:43.736428 4920 log.cc:1196] T 79413224c1ad4b75aa4be39c3dd94f14 P cb27643ca3f74737aa87569105fcb0ad: Deleting WAL directory at /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-1/wal/wals/79413224c1ad4b75aa4be39c3dd94f14
I20260805 22:49:43.736702 4920 ts_tablet_manager.cc:1939] T 79413224c1ad4b75aa4be39c3dd94f14 P cb27643ca3f74737aa87569105fcb0ad: Deleting consensus metadata
I20260805 22:49:43.737233 4161 catalog_manager.cc:4841] TS cb27643ca3f74737aa87569105fcb0ad (127.14.224.130:43247): tablet 79413224c1ad4b75aa4be39c3dd94f14 (table test-table [id=b76d0b32450f4a9eabb22a6b1eb89c8b]) successfully deleted
W20260805 22:49:43.739293 4165 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.224.129:35089 (error 108)
I20260805 22:49:43.739455 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 4472
I20260805 22:49:43.741983 4885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:43.741817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.129:35089 (local address 127.0.0.1:42812)
0805 22:49:43.741889 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:43.741943 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.129:35089: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260805 22:49:43.742110 4165 catalog_manager.cc:4584] TS ad7b0e4ee79f423c8466b1746b3e08e3 (127.14.224.129:35089): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 79413224c1ad4b75aa4be39c3dd94f14: Network error: Client connection negotiation failed: client connection to 127.14.224.129:35089: connect: Connection refused (error 111)
I20260805 22:49:43.749457 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 4678
I20260805 22:49:43.761857 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 4140
I20260805 22:49:43.773231 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:35779
--webserver_interface=127.14.224.190
--webserver_port=39189
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:38473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.224.190:35779
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:49:43.857298 4922 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:49:43.857509 4922 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:49:43.857532 4922 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:49:43.858681 4922 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:49:43.858722 4922 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:49:43.858736 4922 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:49:43.858747 4922 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:49:43.858757 4922 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:49:43.860425 4922 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:38473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.224.190:35779
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:35779
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.224.190
--webserver_port=39189
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4922
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:49:43.860642 4922 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:49:43.860841 4922 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:49:43.865787 4928 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:49:43.865787 4933 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:49:43.865792 4929 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:49:43.866101 4922 server_base.cc:1034] running on GCE node
I20260805 22:49:43.866359 4922 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:49:43.866664 4922 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:49:43.867807 4922 hybrid_clock.cc:648] HybridClock initialized: now 1785970183867784 us; error 34 us; skew 500 ppm
Aug 05 22:49:43 dist-test-slave-gjrz krb5kdc[3301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970183, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:49:43.870482 4922 init.cc:377] Logged in from keytab as kudu/127.14.224.190@KRBTEST.COM (short username kudu)
I20260805 22:49:43.870970 4922 webserver.cc:460] Webserver started at http://127.14.224.190:39189/ using document root <none> and password file <none>
I20260805 22:49:43.871214 4922 fs_manager.cc:359] Metadata directory not provided
I20260805 22:49:43.871285 4922 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:49:43.872705 4922 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:49:43.873394 4942 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:49:43.873567 4922 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260805 22:49:43.873656 4922 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/master-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/master-0/wal
uuid: "52b0fdfef10048eb80deb2aaf54a2937"
format_stamp: "Formatted at 2026-08-05 22:49:42 on dist-test-slave-gjrz"
server_key: "1be9175a25229606d261ba6657401943"
server_key_iv: "263969b7ac6e3e1ddf031b2b509ba24a"
server_key_version: "encryptionkey@0"
I20260805 22:49:43.874033 4922 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:49:43.898975 4922 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:49:43.901695 4922 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:49:43.901858 4922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:49:43.905767 4922 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.190:35779
I20260805 22:49:43.905812 5012 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.190:35779 every 8 connection(s)
I20260805 22:49:43.906188 4922 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
I20260805 22:49:43.907903 5013 sys_catalog.cc:263] Verifying existing consensus state
I20260805 22:49:43.908540 5013 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 52b0fdfef10048eb80deb2aaf54a2937: Bootstrap starting.
I20260805 22:49:43.909106 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 4922
I20260805 22:49:43.909353 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.129:35089
--local_ip_for_outbound_sockets=127.14.224.129
--tserver_master_addrs=127.14.224.190:35779
--webserver_port=43893
--webserver_interface=127.14.224.129
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab
--principal=kudu/127.14.224.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:38473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 22:49:43.917519 5013 log.cc:824] T 00000000000000000000000000000000 P 52b0fdfef10048eb80deb2aaf54a2937: Log is configured to *not* fsync() on all Append() calls
I20260805 22:49:43.920013 5013 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 52b0fdfef10048eb80deb2aaf54a2937: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260805 22:49:43.920311 5013 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 52b0fdfef10048eb80deb2aaf54a2937: Bootstrap complete.
I20260805 22:49:43.922446 5013 raft_consensus.cc:348] T 00000000000000000000000000000000 P 52b0fdfef10048eb80deb2aaf54a2937 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52b0fdfef10048eb80deb2aaf54a2937" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 35779 } }
I20260805 22:49:43.922673 5013 raft_consensus.cc:729] T 00000000000000000000000000000000 P 52b0fdfef10048eb80deb2aaf54a2937 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52b0fdfef10048eb80deb2aaf54a2937, State: Initialized, Role: FOLLOWER
I20260805 22:49:43.922830 5013 consensus_queue.cc:260] T 00000000000000000000000000000000 P 52b0fdfef10048eb80deb2aaf54a2937 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52b0fdfef10048eb80deb2aaf54a2937" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 35779 } }
I20260805 22:49:43.922896 5013 raft_consensus.cc:388] T 00000000000000000000000000000000 P 52b0fdfef10048eb80deb2aaf54a2937 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:49:43.922936 5013 raft_consensus.cc:482] T 00000000000000000000000000000000 P 52b0fdfef10048eb80deb2aaf54a2937 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:49:43.922983 5013 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 52b0fdfef10048eb80deb2aaf54a2937 [term 2 FOLLOWER]: Advancing to term 3
I20260805 22:49:43.924319 5013 raft_consensus.cc:504] T 00000000000000000000000000000000 P 52b0fdfef10048eb80deb2aaf54a2937 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52b0fdfef10048eb80deb2aaf54a2937" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 35779 } }
I20260805 22:49:43.924433 5013 leader_election.cc:302] T 00000000000000000000000000000000 P 52b0fdfef10048eb80deb2aaf54a2937 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 52b0fdfef10048eb80deb2aaf54a2937; no voters:
I20260805 22:49:43.924604 5013 leader_election.cc:288] T 00000000000000000000000000000000 P 52b0fdfef10048eb80deb2aaf54a2937 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260805 22:49:43.924642 5018 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 52b0fdfef10048eb80deb2aaf54a2937 [term 3 FOLLOWER]: Leader election won for term 3
I20260805 22:49:43.924753 5018 raft_consensus.cc:686] T 00000000000000000000000000000000 P 52b0fdfef10048eb80deb2aaf54a2937 [term 3 LEADER]: Becoming Leader. State: Replica: 52b0fdfef10048eb80deb2aaf54a2937, State: Running, Role: LEADER
I20260805 22:49:43.924842 5018 consensus_queue.cc:237] T 00000000000000000000000000000000 P 52b0fdfef10048eb80deb2aaf54a2937 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52b0fdfef10048eb80deb2aaf54a2937" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 35779 } }
I20260805 22:49:43.924877 5013 sys_catalog.cc:564] T 00000000000000000000000000000000 P 52b0fdfef10048eb80deb2aaf54a2937 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:49:43.925143 5019 sys_catalog.cc:455] T 00000000000000000000000000000000 P 52b0fdfef10048eb80deb2aaf54a2937 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "52b0fdfef10048eb80deb2aaf54a2937" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52b0fdfef10048eb80deb2aaf54a2937" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 35779 } } }
I20260805 22:49:43.925179 5018 sys_catalog.cc:455] T 00000000000000000000000000000000 P 52b0fdfef10048eb80deb2aaf54a2937 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 52b0fdfef10048eb80deb2aaf54a2937. Latest consensus state: current_term: 3 leader_uuid: "52b0fdfef10048eb80deb2aaf54a2937" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52b0fdfef10048eb80deb2aaf54a2937" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 35779 } } }
I20260805 22:49:43.925338 5018 sys_catalog.cc:458] T 00000000000000000000000000000000 P 52b0fdfef10048eb80deb2aaf54a2937 [sys.catalog]: This master's current role is: LEADER
I20260805 22:49:43.925554 5019 sys_catalog.cc:458] T 00000000000000000000000000000000 P 52b0fdfef10048eb80deb2aaf54a2937 [sys.catalog]: This master's current role is: LEADER
I20260805 22:49:43.925858 5030 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:49:43.926707 5030 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:49:43.926854 5030 catalog_manager.cc:1259] Loaded cluster ID: ecf25561117c49b8abe675bcab2d7977
I20260805 22:49:43.926882 5030 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260805 22:49:43.927352 5030 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7efc09b279ad google::LogMessage::Fail() at ??:0
@ 0x7efc09b2a88a google::LogMessage::SendToLog() at ??:0
@ 0x7efc09b274de google::LogMessage::Flush() at ??:0
@ 0x7efc09b28a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7efc11a480f1 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7efc11a518b9 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7efc0b9f50d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7efc0b9ea954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7efc0c84e6db start_thread at ??:0
@ 0x7efc0862561f clone at ??:0
W20260805 22:49:44.003001 5015 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:49:44.003229 5015 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:49:44.003283 5015 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:49:44.004501 5015 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:49:44.004550 5015 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:49:44.004587 5015 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.129
I20260805 22:49:44.006208 5015 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:38473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab
--principal=kudu/127.14.224.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.129:35089
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.224.129
--webserver_port=43893
--tserver_master_addrs=127.14.224.190:35779
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5015
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.129
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:49:44.006481 5015 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:49:44.006719 5015 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:49:44.012214 5066 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:49:44.012108 5064 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:49:44.012147 5015 server_base.cc:1034] running on GCE node
W20260805 22:49:44.012101 5069 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:49:44.012619 5015 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:49:44.012889 5015 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:49:44.014061 5015 hybrid_clock.cc:648] HybridClock initialized: now 1785970184014047 us; error 31 us; skew 500 ppm
Aug 05 22:49:44 dist-test-slave-gjrz krb5kdc[3301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970184, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:49:44.016937 5015 init.cc:377] Logged in from keytab as kudu/127.14.224.129@KRBTEST.COM (short username kudu)
I20260805 22:49:44.017454 5015 webserver.cc:460] Webserver started at http://127.14.224.129:43893/ using document root <none> and password file <none>
I20260805 22:49:44.017671 5015 fs_manager.cc:359] Metadata directory not provided
I20260805 22:49:44.017722 5015 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:49:44.019151 5015 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:49:44.019922 5080 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:49:44.020087 5015 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260805 22:49:44.020177 5015 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-0/wal
uuid: "ad7b0e4ee79f423c8466b1746b3e08e3"
format_stamp: "Formatted at 2026-08-05 22:49:42 on dist-test-slave-gjrz"
server_key: "3cdf7cc4a506f496cabcc6e5863c9c86"
server_key_iv: "d7b20b397c2dc717707b2f1522c74bff"
server_key_version: "encryptionkey@0"
I20260805 22:49:44.020555 5015 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:49:44.045020 5015 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:49:44.047289 5015 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:49:44.047438 5015 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:49:44.047669 5015 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:49:44.048156 5090 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260805 22:49:44.050232 5015 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260805 22:49:44.050299 5015 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260805 22:49:44.050335 5015 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260805 22:49:44.051071 5015 ts_tablet_manager.cc:610] Registered 1 tablets
I20260805 22:49:44.051108 5015 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260805 22:49:44.051218 5090 tablet_bootstrap.cc:492] T 79413224c1ad4b75aa4be39c3dd94f14 P ad7b0e4ee79f423c8466b1746b3e08e3: Bootstrap starting.
I20260805 22:49:44.058152 5015 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.129:35089
I20260805 22:49:44.058388 5239 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.129:35089 every 8 connection(s)
I20260805 22:49:44.058629 5015 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
I20260805 22:49:44.062412 5090 log.cc:824] T 79413224c1ad4b75aa4be39c3dd94f14 P ad7b0e4ee79f423c8466b1746b3e08e3: Log is configured to *not* fsync() on all Append() calls
I20260805 22:49:44.065478 5090 tablet_bootstrap.cc:492] T 79413224c1ad4b75aa4be39c3dd94f14 P ad7b0e4ee79f423c8466b1746b3e08e3: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260805 22:49:44.065828 5090 tablet_bootstrap.cc:492] T 79413224c1ad4b75aa4be39c3dd94f14 P ad7b0e4ee79f423c8466b1746b3e08e3: Bootstrap complete.
I20260805 22:49:44.066313 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 5015
I20260805 22:49:44.066592 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.130:43247
--local_ip_for_outbound_sockets=127.14.224.130
--tserver_master_addrs=127.14.224.190:35779
--webserver_port=46865
--webserver_interface=127.14.224.130
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab
--principal=kudu/127.14.224.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:38473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 22:49:44.067008 5090 ts_tablet_manager.cc:1397] T 79413224c1ad4b75aa4be39c3dd94f14 P ad7b0e4ee79f423c8466b1746b3e08e3: Time spent bootstrapping tablet: real 0.016s user 0.007s sys 0.005s
I20260805 22:49:44.068560 5090 raft_consensus.cc:348] T 79413224c1ad4b75aa4be39c3dd94f14 P ad7b0e4ee79f423c8466b1746b3e08e3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0226d3f5892d454288b70c7be9b14fe4" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 38245 } } peers { permanent_uuid: "cb27643ca3f74737aa87569105fcb0ad" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 43247 } } peers { permanent_uuid: "ad7b0e4ee79f423c8466b1746b3e08e3" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 35089 } }
I20260805 22:49:44.068924 5090 raft_consensus.cc:729] T 79413224c1ad4b75aa4be39c3dd94f14 P ad7b0e4ee79f423c8466b1746b3e08e3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad7b0e4ee79f423c8466b1746b3e08e3, State: Initialized, Role: FOLLOWER
I20260805 22:49:44.069080 5090 consensus_queue.cc:260] T 79413224c1ad4b75aa4be39c3dd94f14 P ad7b0e4ee79f423c8466b1746b3e08e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0226d3f5892d454288b70c7be9b14fe4" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 38245 } } peers { permanent_uuid: "cb27643ca3f74737aa87569105fcb0ad" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 43247 } } peers { permanent_uuid: "ad7b0e4ee79f423c8466b1746b3e08e3" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 35089 } }
I20260805 22:49:44.069389 5090 ts_tablet_manager.cc:1428] T 79413224c1ad4b75aa4be39c3dd94f14 P ad7b0e4ee79f423c8466b1746b3e08e3: Time spent starting tablet: real 0.002s user 0.006s sys 0.000s
W20260805 22:49:44.133726 5243 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:49:44.059353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:35779 (local address 127.14.224.129:34763)
0805 22:49:44.059564 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:44.059609 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0805 22:49:44.060089 (+ 480us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:49:44.133543 (+ 73454us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:35779: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":128,"threads_started":1}
W20260805 22:49:44.134008 5240 heartbeater.cc:644] Failed to heartbeat to 127.14.224.190:35779 (0 consecutive failures): Network error: Failed to ping master at 127.14.224.190:35779: Client connection negotiation failed: client connection to 127.14.224.190:35779: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260805 22:49:44.134411 5243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:44.134291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:35779 (local address 127.14.224.129:48947)
0805 22:49:44.134346 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:44.134386 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260805 22:49:44.134785 5243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:44.134701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:35779 (local address 127.14.224.129:51331)
0805 22:49:44.134743 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:44.134768 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260805 22:49:44.134895 5240 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260805 22:49:44.156198 5246 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:49:44.156417 5246 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:49:44.156443 5246 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:49:44.157681 5246 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:49:44.157737 5246 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:49:44.157766 5246 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.130
I20260805 22:49:44.159345 5246 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:38473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab
--principal=kudu/127.14.224.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.130:43247
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.224.130
--webserver_port=46865
--tserver_master_addrs=127.14.224.190:35779
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5246
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.130
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:49:44.159560 5246 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:49:44.159793 5246 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:49:44.164994 5254 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:49:44.165105 5246 server_base.cc:1034] running on GCE node
W20260805 22:49:44.164999 5258 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:49:44.164999 5255 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:49:44.165410 5246 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:49:44.165680 5246 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:49:44.166826 5246 hybrid_clock.cc:648] HybridClock initialized: now 1785970184166808 us; error 33 us; skew 500 ppm
Aug 05 22:49:44 dist-test-slave-gjrz krb5kdc[3301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970184, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:49:44.169687 5246 init.cc:377] Logged in from keytab as kudu/127.14.224.130@KRBTEST.COM (short username kudu)
I20260805 22:49:44.170221 5246 webserver.cc:460] Webserver started at http://127.14.224.130:46865/ using document root <none> and password file <none>
I20260805 22:49:44.170465 5246 fs_manager.cc:359] Metadata directory not provided
I20260805 22:49:44.170516 5246 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:49:44.171928 5246 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:49:44.172574 5272 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:49:44.172741 5246 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260805 22:49:44.172827 5246 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-1/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-1/wal
uuid: "cb27643ca3f74737aa87569105fcb0ad"
format_stamp: "Formatted at 2026-08-05 22:49:42 on dist-test-slave-gjrz"
server_key: "3e380f3145bbbe7d0dd475cc31b03612"
server_key_iv: "3bf1de543a29e901b1f15439300b7071"
server_key_version: "encryptionkey@0"
I20260805 22:49:44.173211 5246 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:49:44.201433 5246 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:49:44.203780 5246 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:49:44.203918 5246 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:49:44.204183 5246 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:49:44.204504 5246 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:49:44.204538 5246 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:49:44.204562 5246 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:49:44.204586 5246 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:49:44.210547 5246 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.130:43247
I20260805 22:49:44.210666 5430 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.130:43247 every 8 connection(s)
I20260805 22:49:44.210955 5246 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
I20260805 22:49:44.212045 5433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:44.211661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:35779 (local address 127.14.224.130:56235)
0805 22:49:44.211815 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:44.211901 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":81,"threads_started":1}
W20260805 22:49:44.212460 5431 heartbeater.cc:644] Failed to heartbeat to 127.14.224.190:35779 (0 consecutive failures): Network error: Failed to ping master at 127.14.224.190:35779: Client connection negotiation failed: client connection to 127.14.224.190:35779: connect: Connection refused (error 111)
I20260805 22:49:44.212724 5433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:44.212636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:35779 (local address 127.14.224.130:37567)
0805 22:49:44.212677 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:44.212706 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260805 22:49:44.212954 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 5246
I20260805 22:49:44.213033 5433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:44.212941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:35779 (local address 127.14.224.130:57669)
0805 22:49:44.212984 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:44.213013 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260805 22:49:44.213151 5431 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260805 22:49:44.213244 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.131:38245
--local_ip_for_outbound_sockets=127.14.224.131
--tserver_master_addrs=127.14.224.190:35779
--webserver_port=45917
--webserver_interface=127.14.224.131
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab
--principal=kudu/127.14.224.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:38473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:49:44.296746 5435 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:49:44.296981 5435 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:49:44.297145 5435 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:49:44.298477 5435 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:49:44.298530 5435 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:49:44.298559 5435 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.131
I20260805 22:49:44.300174 5435 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:38473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab
--principal=kudu/127.14.224.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.131:38245
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.224.131
--webserver_port=45917
--tserver_master_addrs=127.14.224.190:35779
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5435
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.131
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:49:44.300417 5435 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:49:44.300653 5435 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:49:44.305704 5442 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:49:44.305831 5435 server_base.cc:1034] running on GCE node
W20260805 22:49:44.305711 5447 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:49:44.305821 5441 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:49:44.306154 5435 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:49:44.306399 5435 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:49:44.307539 5435 hybrid_clock.cc:648] HybridClock initialized: now 1785970184307522 us; error 34 us; skew 500 ppm
Aug 05 22:49:44 dist-test-slave-gjrz krb5kdc[3301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970184, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:49:44.309919 5435 init.cc:377] Logged in from keytab as kudu/127.14.224.131@KRBTEST.COM (short username kudu)
I20260805 22:49:44.310377 5435 webserver.cc:460] Webserver started at http://127.14.224.131:45917/ using document root <none> and password file <none>
I20260805 22:49:44.310571 5435 fs_manager.cc:359] Metadata directory not provided
I20260805 22:49:44.310614 5435 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:49:44.311971 5435 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.000s
I20260805 22:49:44.312543 5459 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:49:44.312709 5435 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260805 22:49:44.312798 5435 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-2/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-2/wal
uuid: "0226d3f5892d454288b70c7be9b14fe4"
format_stamp: "Formatted at 2026-08-05 22:49:42 on dist-test-slave-gjrz"
server_key: "9f82dbd6e436516c49cf795a2eaeaf11"
server_key_iv: "00850de1db3af757f5257071c91179fd"
server_key_version: "encryptionkey@0"
I20260805 22:49:44.313200 5435 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:49:44.324846 5435 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:49:44.327010 5435 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:49:44.327126 5435 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:49:44.327375 5435 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:49:44.327664 5435 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:49:44.327695 5435 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:49:44.327723 5435 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:49:44.327739 5435 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:49:44.333266 5435 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.131:38245
I20260805 22:49:44.333312 5618 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.131:38245 every 8 connection(s)
I20260805 22:49:44.333643 5435 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
I20260805 22:49:44.334743 5623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:44.334307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:35779 (local address 127.14.224.131:55723)
0805 22:49:44.334506 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:44.334593 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":87,"threads_started":1}
W20260805 22:49:44.335201 5620 heartbeater.cc:644] Failed to heartbeat to 127.14.224.190:35779 (0 consecutive failures): Network error: Failed to ping master at 127.14.224.190:35779: Client connection negotiation failed: client connection to 127.14.224.190:35779: connect: Connection refused (error 111)
I20260805 22:49:44.335527 5623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:44.335423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:35779 (local address 127.14.224.131:59323)
0805 22:49:44.335478 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:44.335507 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260805 22:49:44.335834 5623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:44.335753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:35779 (local address 127.14.224.131:34001)
0805 22:49:44.335790 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:44.335813 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
W20260805 22:49:44.335932 5620 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260805 22:49:44.339389 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 5435
I20260805 22:49:45.135612 5625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:45.135333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:35779 (local address 127.14.224.129:38593)
0805 22:49:45.135497 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:45.135543 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":67,"threads_started":1}
I20260805 22:49:45.213771 5626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:45.213539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:35779 (local address 127.14.224.130:53201)
0805 22:49:45.213674 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:45.213716 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":67,"threads_started":1}
I20260805 22:49:45.264333 5627 raft_consensus.cc:482] T 79413224c1ad4b75aa4be39c3dd94f14 P ad7b0e4ee79f423c8466b1746b3e08e3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:49:45.264477 5627 raft_consensus.cc:504] T 79413224c1ad4b75aa4be39c3dd94f14 P ad7b0e4ee79f423c8466b1746b3e08e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0226d3f5892d454288b70c7be9b14fe4" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 38245 } } peers { permanent_uuid: "cb27643ca3f74737aa87569105fcb0ad" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 43247 } } peers { permanent_uuid: "ad7b0e4ee79f423c8466b1746b3e08e3" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 35089 } }
I20260805 22:49:45.264793 5627 leader_election.cc:288] T 79413224c1ad4b75aa4be39c3dd94f14 P ad7b0e4ee79f423c8466b1746b3e08e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0226d3f5892d454288b70c7be9b14fe4 (127.14.224.131:38245), cb27643ca3f74737aa87569105fcb0ad (127.14.224.130:43247)
Aug 05 22:49:45 dist-test-slave-gjrz krb5kdc[3301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970184, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.129@KRBTEST.COM for kudu/127.14.224.131@KRBTEST.COM
Aug 05 22:49:45 dist-test-slave-gjrz krb5kdc[3301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970184, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.129@KRBTEST.COM for kudu/127.14.224.130@KRBTEST.COM
I20260805 22:49:45.275527 5629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:45.265125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.129:54445 (local address 127.14.224.131:38245)
0805 22:49:45.265303 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0805 22:49:45.265311 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:49:45.265331 (+ 20us) server_negotiation.cc:407] Connection header received
0805 22:49:45.265845 (+ 514us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:49:45.265848 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:49:45.265924 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:49:45.266069 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:49:45.266866 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:45.267859 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:45.268973 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:45.269402 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:45.269509 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:45.272081 (+ 2572us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:49:45.272087 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:49:45.272087 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:49:45.272101 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:49:45.273793 (+ 1692us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:45.274312 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:45.274315 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:45.274315 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:45.274409 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:45.274646 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:45.274647 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:45.274648 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:45.274905 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:49:45.274972 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0805 22:49:45.275285 (+ 313us) server_negotiation.cc:299] Negotiation successful
0805 22:49:45.275424 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":56,"threads_started":1}
I20260805 22:49:45.275543 5630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:45.265129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.129:55913 (local address 127.14.224.130:43247)
0805 22:49:45.265243 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0805 22:49:45.265256 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0805 22:49:45.265292 (+ 36us) server_negotiation.cc:407] Connection header received
0805 22:49:45.265855 (+ 563us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:49:45.265857 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:49:45.265910 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:49:45.266070 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:49:45.266874 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:45.267851 (+ 977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:45.268976 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:49:45.269402 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:49:45.269515 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:45.272345 (+ 2830us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:49:45.272349 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:49:45.272349 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:49:45.272360 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:49:45.273937 (+ 1577us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:45.274305 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:45.274309 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:45.274309 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:45.274404 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:49:45.274645 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:49:45.274646 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:49:45.274646 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:49:45.274919 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:49:45.274999 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0805 22:49:45.275289 (+ 290us) server_negotiation.cc:299] Negotiation successful
0805 22:49:45.275415 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80,"thread_start_us":59,"threads_started":1}
I20260805 22:49:45.275528 5625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:45.264983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.131:38245 (local address 127.14.224.129:54445)
0805 22:49:45.265054 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:45.265065 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:49:45.265122 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:49:45.266120 (+ 998us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:49:45.266123 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:49:45.266524 (+ 401us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:49:45.266744 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:45.266750 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:45.268023 (+ 1273us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:45.268024 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:45.268860 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:45.268863 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:45.269498 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:45.269499 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:45.269611 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:45.270162 (+ 551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:49:45.270171 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:49:45.271923 (+ 1752us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:49:45.273896 (+ 1973us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:49:45.273905 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:49:45.273907 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:49:45.274225 (+ 318us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:49:45.274477 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:49:45.274478 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:49:45.274478 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:49:45.274583 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:49:45.274975 (+ 392us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:49:45.274982 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:49:45.275104 (+ 122us) client_negotiation.cc:769] Sending connection context
0805 22:49:45.275195 (+ 91us) client_negotiation.cc:240] Negotiation successful
0805 22:49:45.275427 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53,"mutex_wait_us":112}
I20260805 22:49:45.275622 5628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:45.264984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.130:43247 (local address 127.14.224.129:55913)
0805 22:49:45.265161 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:45.265173 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:49:45.265231 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:49:45.266196 (+ 965us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:49:45.266197 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:49:45.266514 (+ 317us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:49:45.266744 (+ 230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:45.266750 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:45.267970 (+ 1220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:45.267972 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:45.268863 (+ 891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:49:45.268867 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:49:45.269500 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:49:45.269501 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:49:45.269614 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:49:45.270203 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:49:45.270207 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:49:45.272238 (+ 2031us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:49:45.274025 (+ 1787us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:49:45.274026 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:49:45.274026 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:49:45.274226 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:49:45.274467 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:49:45.274468 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:49:45.274469 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:49:45.274583 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:49:45.274993 (+ 410us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:49:45.274994 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:49:45.275105 (+ 111us) client_negotiation.cc:769] Sending connection context
0805 22:49:45.275195 (+ 90us) client_negotiation.cc:240] Negotiation successful
0805 22:49:45.275502 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"mutex_wait_us":213,"thread_start_us":80,"threads_started":1}
W20260805 22:49:45.276441 5082 leader_election.cc:341] T 79413224c1ad4b75aa4be39c3dd94f14 P ad7b0e4ee79f423c8466b1746b3e08e3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cb27643ca3f74737aa87569105fcb0ad (127.14.224.130:43247): Not found: Tablet not found: 79413224c1ad4b75aa4be39c3dd94f14
W20260805 22:49:45.276876 5085 leader_election.cc:341] T 79413224c1ad4b75aa4be39c3dd94f14 P ad7b0e4ee79f423c8466b1746b3e08e3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0226d3f5892d454288b70c7be9b14fe4 (127.14.224.131:38245): Not found: Tablet not found: 79413224c1ad4b75aa4be39c3dd94f14
I20260805 22:49:45.276932 5085 leader_election.cc:302] T 79413224c1ad4b75aa4be39c3dd94f14 P ad7b0e4ee79f423c8466b1746b3e08e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad7b0e4ee79f423c8466b1746b3e08e3; no voters: 0226d3f5892d454288b70c7be9b14fe4, cb27643ca3f74737aa87569105fcb0ad
I20260805 22:49:45.277035 5627 raft_consensus.cc:2726] T 79413224c1ad4b75aa4be39c3dd94f14 P ad7b0e4ee79f423c8466b1746b3e08e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260805 22:49:45.336411 5631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:45.336221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:35779 (local address 127.14.224.131:33469)
0805 22:49:45.336328 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:45.336373 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91,"thread_start_us":54,"threads_started":1}
I20260805 22:49:46.136469 5632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:46.136217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:35779 (local address 127.14.224.129:35867)
0805 22:49:46.136357 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:46.136417 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":69,"threads_started":1}
I20260805 22:49:46.214450 5635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:46.214231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:35779 (local address 127.14.224.130:37183)
0805 22:49:46.214360 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:46.214407 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":62,"threads_started":1}
I20260805 22:49:46.337169 5638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:46.336890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:35779 (local address 127.14.224.131:39391)
0805 22:49:46.337071 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:46.337124 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":83,"threads_started":1}
I20260805 22:49:47.137230 5639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:47.136973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:35779 (local address 127.14.224.129:40537)
0805 22:49:47.137131 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:47.137182 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":73,"threads_started":1}
I20260805 22:49:47.215252 5640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:47.214986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:35779 (local address 127.14.224.130:46781)
0805 22:49:47.215155 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:47.215203 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":92,"threads_started":1}
I20260805 22:49:47.337993 5641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:47.337711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:35779 (local address 127.14.224.131:56859)
0805 22:49:47.337896 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:47.337946 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":95,"threads_started":1}
I20260805 22:49:47.518141 5643 raft_consensus.cc:482] T 79413224c1ad4b75aa4be39c3dd94f14 P ad7b0e4ee79f423c8466b1746b3e08e3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:49:47.518247 5643 raft_consensus.cc:504] T 79413224c1ad4b75aa4be39c3dd94f14 P ad7b0e4ee79f423c8466b1746b3e08e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0226d3f5892d454288b70c7be9b14fe4" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 38245 } } peers { permanent_uuid: "cb27643ca3f74737aa87569105fcb0ad" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 43247 } } peers { permanent_uuid: "ad7b0e4ee79f423c8466b1746b3e08e3" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 35089 } }
I20260805 22:49:47.518426 5643 leader_election.cc:288] T 79413224c1ad4b75aa4be39c3dd94f14 P ad7b0e4ee79f423c8466b1746b3e08e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0226d3f5892d454288b70c7be9b14fe4 (127.14.224.131:38245), cb27643ca3f74737aa87569105fcb0ad (127.14.224.130:43247)
W20260805 22:49:47.518836 5082 leader_election.cc:341] T 79413224c1ad4b75aa4be39c3dd94f14 P ad7b0e4ee79f423c8466b1746b3e08e3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cb27643ca3f74737aa87569105fcb0ad (127.14.224.130:43247): Not found: Tablet not found: 79413224c1ad4b75aa4be39c3dd94f14
W20260805 22:49:47.518904 5085 leader_election.cc:341] T 79413224c1ad4b75aa4be39c3dd94f14 P ad7b0e4ee79f423c8466b1746b3e08e3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0226d3f5892d454288b70c7be9b14fe4 (127.14.224.131:38245): Not found: Tablet not found: 79413224c1ad4b75aa4be39c3dd94f14
I20260805 22:49:47.518988 5085 leader_election.cc:302] T 79413224c1ad4b75aa4be39c3dd94f14 P ad7b0e4ee79f423c8466b1746b3e08e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad7b0e4ee79f423c8466b1746b3e08e3; no voters: 0226d3f5892d454288b70c7be9b14fe4, cb27643ca3f74737aa87569105fcb0ad
I20260805 22:49:47.519066 5643 raft_consensus.cc:2726] T 79413224c1ad4b75aa4be39c3dd94f14 P ad7b0e4ee79f423c8466b1746b3e08e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260805 22:49:48.137957 5644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:48.137746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:35779 (local address 127.14.224.129:34995)
0805 22:49:48.137877 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:48.137911 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":69,"threads_started":1}
I20260805 22:49:48.215955 5648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:48.215721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:35779 (local address 127.14.224.130:42719)
0805 22:49:48.215847 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:48.215895 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":63,"threads_started":1}
I20260805 22:49:48.338701 5650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:48.338484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:35779 (local address 127.14.224.131:53685)
0805 22:49:48.338611 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:48.338650 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":72,"threads_started":1}
I20260805 22:49:49.138739 5652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:49.138457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:35779 (local address 127.14.224.129:51295)
0805 22:49:49.138640 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:49.138689 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":90,"threads_started":1}
I20260805 22:49:49.216635 5653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:49.216382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:35779 (local address 127.14.224.130:34503)
0805 22:49:49.216520 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:49.216563 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":69,"threads_started":1}
I20260805 22:49:49.339538 5655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:49.339305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:35779 (local address 127.14.224.131:46199)
0805 22:49:49.339443 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:49.339492 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":66,"threads_started":1}
I20260805 22:49:50.139603 5657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:50.139315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:35779 (local address 127.14.224.129:52523)
0805 22:49:50.139501 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:50.139550 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":87,"threads_started":1}
I20260805 22:49:50.217330 5661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:50.217086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:35779 (local address 127.14.224.130:54079)
0805 22:49:50.217231 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:50.217282 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":73,"threads_started":1}
I20260805 22:49:50.340337 5663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:50.340096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:35779 (local address 127.14.224.131:44173)
0805 22:49:50.340238 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:50.340287 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":69,"threads_started":1}
I20260805 22:49:50.745957 5664 raft_consensus.cc:482] T 79413224c1ad4b75aa4be39c3dd94f14 P ad7b0e4ee79f423c8466b1746b3e08e3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:49:50.746080 5664 raft_consensus.cc:504] T 79413224c1ad4b75aa4be39c3dd94f14 P ad7b0e4ee79f423c8466b1746b3e08e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0226d3f5892d454288b70c7be9b14fe4" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 38245 } } peers { permanent_uuid: "cb27643ca3f74737aa87569105fcb0ad" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 43247 } } peers { permanent_uuid: "ad7b0e4ee79f423c8466b1746b3e08e3" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 35089 } }
I20260805 22:49:50.746258 5664 leader_election.cc:288] T 79413224c1ad4b75aa4be39c3dd94f14 P ad7b0e4ee79f423c8466b1746b3e08e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0226d3f5892d454288b70c7be9b14fe4 (127.14.224.131:38245), cb27643ca3f74737aa87569105fcb0ad (127.14.224.130:43247)
W20260805 22:49:50.746618 5082 leader_election.cc:341] T 79413224c1ad4b75aa4be39c3dd94f14 P ad7b0e4ee79f423c8466b1746b3e08e3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cb27643ca3f74737aa87569105fcb0ad (127.14.224.130:43247): Not found: Tablet not found: 79413224c1ad4b75aa4be39c3dd94f14
W20260805 22:49:50.746675 5085 leader_election.cc:341] T 79413224c1ad4b75aa4be39c3dd94f14 P ad7b0e4ee79f423c8466b1746b3e08e3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0226d3f5892d454288b70c7be9b14fe4 (127.14.224.131:38245): Not found: Tablet not found: 79413224c1ad4b75aa4be39c3dd94f14
I20260805 22:49:50.746757 5085 leader_election.cc:302] T 79413224c1ad4b75aa4be39c3dd94f14 P ad7b0e4ee79f423c8466b1746b3e08e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad7b0e4ee79f423c8466b1746b3e08e3; no voters: 0226d3f5892d454288b70c7be9b14fe4, cb27643ca3f74737aa87569105fcb0ad
I20260805 22:49:50.746837 5664 raft_consensus.cc:2726] T 79413224c1ad4b75aa4be39c3dd94f14 P ad7b0e4ee79f423c8466b1746b3e08e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260805 22:49:51.140343 5667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:51.140089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:35779 (local address 127.14.224.129:37831)
0805 22:49:51.140247 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:51.140292 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":73,"threads_started":1}
I20260805 22:49:51.218060 5668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:51.217835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:35779 (local address 127.14.224.130:36139)
0805 22:49:51.217963 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:51.218011 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":63,"threads_started":1}
I20260805 22:49:51.341080 5670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:51.340812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:35779 (local address 127.14.224.131:40439)
0805 22:49:51.340989 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:51.341032 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":83,"threads_started":1}
I20260805 22:49:52.141080 5671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:52.140828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:35779 (local address 127.14.224.129:58213)
0805 22:49:52.140988 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:52.141030 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":75,"threads_started":1}
I20260805 22:49:52.218739 5672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:52.218506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:35779 (local address 127.14.224.130:59245)
0805 22:49:52.218642 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:52.218690 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":67,"threads_started":1}
I20260805 22:49:52.341866 5673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:52.341626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:35779 (local address 127.14.224.131:36763)
0805 22:49:52.341767 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:52.341813 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":71,"threads_started":1}
I20260805 22:49:53.141970 5674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:53.141650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:35779 (local address 127.14.224.129:57481)
0805 22:49:53.141833 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:53.141897 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":90,"threads_started":1}
I20260805 22:49:53.219530 5675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:53.219251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:35779 (local address 127.14.224.130:52461)
0805 22:49:53.219432 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:53.219480 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":123,"threads_started":1}
I20260805 22:49:53.342555 5680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:53.342304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:35779 (local address 127.14.224.131:47161)
0805 22:49:53.342460 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:53.342506 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":69,"threads_started":1}
I20260805 22:49:54.142970 5681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:54.142646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:35779 (local address 127.14.224.129:48471)
0805 22:49:54.142869 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:54.142919 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":93,"threads_started":1}
I20260805 22:49:54.220180 5682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:54.219931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:35779 (local address 127.14.224.130:44495)
0805 22:49:54.220090 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:54.220133 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":87,"threads_started":1}
I20260805 22:49:54.343374 5683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:54.343102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:35779 (local address 127.14.224.131:50099)
0805 22:49:54.343246 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:54.343322 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":73,"threads_started":1}
I20260805 22:49:55.143899 5684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:55.143659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:35779 (local address 127.14.224.129:46147)
0805 22:49:55.143801 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:55.143851 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":70,"threads_started":1}
I20260805 22:49:55.220944 5685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:55.220686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:35779 (local address 127.14.224.130:42187)
0805 22:49:55.220844 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:55.220895 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":83,"threads_started":1}
I20260805 22:49:55.253026 5686 raft_consensus.cc:482] T 79413224c1ad4b75aa4be39c3dd94f14 P ad7b0e4ee79f423c8466b1746b3e08e3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:49:55.253130 5686 raft_consensus.cc:504] T 79413224c1ad4b75aa4be39c3dd94f14 P ad7b0e4ee79f423c8466b1746b3e08e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0226d3f5892d454288b70c7be9b14fe4" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 38245 } } peers { permanent_uuid: "cb27643ca3f74737aa87569105fcb0ad" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 43247 } } peers { permanent_uuid: "ad7b0e4ee79f423c8466b1746b3e08e3" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 35089 } }
I20260805 22:49:55.253306 5686 leader_election.cc:288] T 79413224c1ad4b75aa4be39c3dd94f14 P ad7b0e4ee79f423c8466b1746b3e08e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0226d3f5892d454288b70c7be9b14fe4 (127.14.224.131:38245), cb27643ca3f74737aa87569105fcb0ad (127.14.224.130:43247)
W20260805 22:49:55.253737 5082 leader_election.cc:341] T 79413224c1ad4b75aa4be39c3dd94f14 P ad7b0e4ee79f423c8466b1746b3e08e3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cb27643ca3f74737aa87569105fcb0ad (127.14.224.130:43247): Not found: Tablet not found: 79413224c1ad4b75aa4be39c3dd94f14
W20260805 22:49:55.253835 5085 leader_election.cc:341] T 79413224c1ad4b75aa4be39c3dd94f14 P ad7b0e4ee79f423c8466b1746b3e08e3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0226d3f5892d454288b70c7be9b14fe4 (127.14.224.131:38245): Not found: Tablet not found: 79413224c1ad4b75aa4be39c3dd94f14
I20260805 22:49:55.253873 5085 leader_election.cc:302] T 79413224c1ad4b75aa4be39c3dd94f14 P ad7b0e4ee79f423c8466b1746b3e08e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad7b0e4ee79f423c8466b1746b3e08e3; no voters: 0226d3f5892d454288b70c7be9b14fe4, cb27643ca3f74737aa87569105fcb0ad
I20260805 22:49:55.253981 5686 raft_consensus.cc:2726] T 79413224c1ad4b75aa4be39c3dd94f14 P ad7b0e4ee79f423c8466b1746b3e08e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260805 22:49:55.344194 5688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:55.343924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:35779 (local address 127.14.224.131:36961)
0805 22:49:55.344090 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:55.344142 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":73,"threads_started":1}
I20260805 22:49:56.144757 5689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:56.144479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:35779 (local address 127.14.224.129:58483)
0805 22:49:56.144653 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:56.144706 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":78,"threads_started":1}
I20260805 22:49:56.221688 5691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:56.221440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:35779 (local address 127.14.224.130:55147)
0805 22:49:56.221578 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:56.221628 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":65,"threads_started":1}
I20260805 22:49:56.344981 5692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:56.344764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:35779 (local address 127.14.224.131:39845)
0805 22:49:56.344896 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:56.344931 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":66,"threads_started":1}
I20260805 22:49:57.145602 5695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:57.145331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:35779 (local address 127.14.224.129:44237)
0805 22:49:57.145499 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:57.145551 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":86,"threads_started":1}
I20260805 22:49:57.222404 5696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:57.222157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:35779 (local address 127.14.224.130:35779)
0805 22:49:57.222314 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:57.222354 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":72,"threads_started":1}
I20260805 22:49:57.345801 5699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:57.345545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:35779 (local address 127.14.224.131:45721)
0805 22:49:57.345703 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:57.345751 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":92,"threads_started":1}
I20260805 22:49:58.146477 5702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:58.146199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:35779 (local address 127.14.224.129:43385)
0805 22:49:58.146371 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:58.146425 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":71,"threads_started":1}
I20260805 22:49:58.223204 5703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:58.222962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:35779 (local address 127.14.224.130:49351)
0805 22:49:58.223102 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:58.223155 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":69,"threads_started":1}
I20260805 22:49:58.346663 5704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:58.346400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:35779 (local address 127.14.224.131:60999)
0805 22:49:58.346566 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:58.346614 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":72,"threads_started":1}
I20260805 22:49:59.147526 5706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:59.147302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:35779 (local address 127.14.224.129:59247)
0805 22:49:59.147445 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:59.147478 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":77,"threads_started":1}
I20260805 22:49:59.223954 5707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:59.223730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:35779 (local address 127.14.224.130:44267)
0805 22:49:59.223848 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:59.223906 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":68,"threads_started":1}
I20260805 22:49:59.347621 5708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:49:59.347328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:35779 (local address 127.14.224.131:48839)
0805 22:49:59.347499 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0805 22:49:59.347546 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":90,"threads_started":1}
I20260805 22:49:59.347795 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 5015
I20260805 22:49:59.361515 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 5246
I20260805 22:49:59.372726 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 5435
2026-08-05T22:49:59Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (18650 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:49:59 dist-test-slave-gjrz krb5kdc[5712](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:49:59 dist-test-slave-gjrz krb5kdc[5712](info): set up 2 sockets
Aug 05 22:49:59 dist-test-slave-gjrz krb5kdc[5712](info): commencing operation
krb5kdc: starting...
W20260805 22:50:00.515779 15234 mini_kdc.cc:121] Time spent starting KDC: real 1.114s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Aug 05 22:50:00 dist-test-slave-gjrz krb5kdc[5712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970200, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:50:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:50:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.224.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab.
Entry for principal kudu/127.14.224.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab.
I20260805 22:50:00.650261 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:40037
--webserver_interface=127.14.224.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:39697
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.224.190:40037
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:50:00.736079 5728 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:50:00.736320 5728 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:50:00.736344 5728 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:50:00.737715 5728 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260805 22:50:00.737790 5728 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260805 22:50:00.737803 5728 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260805 22:50:00.737814 5728 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:50:00.737828 5728 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:50:00.737841 5728 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:50:00.737852 5728 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:50:00.737869 5728 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:50:00.739733 5728 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:39697
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.14.224.190:40037
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:40037
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.224.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5728
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:50:00.740026 5728 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:50:00.740283 5728 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:50:00.745391 5736 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:50:00.745401 5737 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:50:00.745424 5728 server_base.cc:1034] running on GCE node
W20260805 22:50:00.745405 5739 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:50:00.745920 5728 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:50:00.746274 5728 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:50:00.747416 5728 hybrid_clock.cc:648] HybridClock initialized: now 1785970200747400 us; error 32 us; skew 500 ppm
Aug 05 22:50:00 dist-test-slave-gjrz krb5kdc[5712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970200, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:50:00.753239 5728 init.cc:377] Logged in from keytab as kudu/127.14.224.190@KRBTEST.COM (short username kudu)
I20260805 22:50:00.753780 5728 webserver.cc:460] Webserver started at http://127.14.224.190:45089/ using document root <none> and password file <none>
I20260805 22:50:00.754029 5728 fs_manager.cc:359] Metadata directory not provided
I20260805 22:50:00.754077 5728 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:50:00.754227 5728 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:50:00.755457 5728 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/master-0/data/instance:
uuid: "be4af01bcd0b47378618c4f308318216"
format_stamp: "Formatted at 2026-08-05 22:50:00 on dist-test-slave-gjrz"
server_key: "61e9a70d01fb2b4ea7569418895b8e9d"
server_key_iv: "73211f41bce997d23940c1e4997f4fcd"
server_key_version: "encryptionkey@0"
I20260805 22:50:00.755831 5728 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/master-0/wal/instance:
uuid: "be4af01bcd0b47378618c4f308318216"
format_stamp: "Formatted at 2026-08-05 22:50:00 on dist-test-slave-gjrz"
server_key: "61e9a70d01fb2b4ea7569418895b8e9d"
server_key_iv: "73211f41bce997d23940c1e4997f4fcd"
server_key_version: "encryptionkey@0"
I20260805 22:50:00.757256 5728 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260805 22:50:00.758026 5749 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:50:00.758208 5728 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:50:00.758309 5728 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/master-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/master-0/wal
uuid: "be4af01bcd0b47378618c4f308318216"
format_stamp: "Formatted at 2026-08-05 22:50:00 on dist-test-slave-gjrz"
server_key: "61e9a70d01fb2b4ea7569418895b8e9d"
server_key_iv: "73211f41bce997d23940c1e4997f4fcd"
server_key_version: "encryptionkey@0"
I20260805 22:50:00.758375 5728 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:50:00.778155 5728 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:50:00.780354 5728 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:50:00.780505 5728 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:50:00.784687 5728 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.190:40037
I20260805 22:50:00.784729 5834 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.190:40037 every 8 connection(s)
I20260805 22:50:00.785087 5728 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
I20260805 22:50:00.785988 5835 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:50:00.786470 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 5728
I20260805 22:50:00.786576 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/master-0/wal/instance
I20260805 22:50:00.786772 15234 external_mini_cluster.cc:1428] Setting key 4bc38d272bd101648d7cbe32a371a4b7
I20260805 22:50:00.789021 5835 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216: Bootstrap starting.
I20260805 22:50:00.789670 5835 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216: Neither blocks nor log segments found. Creating new log.
I20260805 22:50:00.789947 5835 log.cc:824] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216: Log is configured to *not* fsync() on all Append() calls
I20260805 22:50:00.790637 5835 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216: No bootstrap required, opened a new log
I20260805 22:50:00.792724 5835 raft_consensus.cc:348] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be4af01bcd0b47378618c4f308318216" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 40037 } }
I20260805 22:50:00.792883 5835 raft_consensus.cc:374] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:50:00.792929 5835 raft_consensus.cc:729] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be4af01bcd0b47378618c4f308318216, State: Initialized, Role: FOLLOWER
I20260805 22:50:00.793068 5835 consensus_queue.cc:260] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be4af01bcd0b47378618c4f308318216" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 40037 } }
I20260805 22:50:00.793143 5835 raft_consensus.cc:388] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:50:00.793170 5835 raft_consensus.cc:482] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:50:00.793213 5835 raft_consensus.cc:3037] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216 [term 0 FOLLOWER]: Advancing to term 1
Aug 05 22:50:00 dist-test-slave-gjrz krb5kdc[5712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970200, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:50:00.793828 5835 raft_consensus.cc:504] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be4af01bcd0b47378618c4f308318216" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 40037 } }
I20260805 22:50:00.793936 5835 leader_election.cc:302] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: be4af01bcd0b47378618c4f308318216; no voters:
I20260805 22:50:00.794129 5835 leader_election.cc:288] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:50:00.794178 5841 raft_consensus.cc:2781] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:50:00.794361 5841 raft_consensus.cc:686] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216 [term 1 LEADER]: Becoming Leader. State: Replica: be4af01bcd0b47378618c4f308318216, State: Running, Role: LEADER
I20260805 22:50:00.794437 5835 sys_catalog.cc:564] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:50:00.794507 5841 consensus_queue.cc:237] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be4af01bcd0b47378618c4f308318216" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 40037 } }
I20260805 22:50:00.794937 5842 sys_catalog.cc:455] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "be4af01bcd0b47378618c4f308318216" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be4af01bcd0b47378618c4f308318216" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 40037 } } }
I20260805 22:50:00.795022 5842 sys_catalog.cc:458] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216 [sys.catalog]: This master's current role is: LEADER
I20260805 22:50:00.795285 5843 sys_catalog.cc:455] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216 [sys.catalog]: SysCatalogTable state changed. Reason: New leader be4af01bcd0b47378618c4f308318216. Latest consensus state: current_term: 1 leader_uuid: "be4af01bcd0b47378618c4f308318216" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be4af01bcd0b47378618c4f308318216" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 40037 } } }
I20260805 22:50:00.795610 5843 sys_catalog.cc:458] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216 [sys.catalog]: This master's current role is: LEADER
I20260805 22:50:00.795759 5852 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:50:00.796327 5852 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:50:00.797853 5839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:00.787370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51438 (local address 127.14.224.190:40037)
0805 22:50:00.787576 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0805 22:50:00.787585 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:50:00.787613 (+ 28us) server_negotiation.cc:407] Connection header received
0805 22:50:00.788070 (+ 457us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:50:00.788078 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:50:00.788128 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:50:00.788279 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:50:00.789085 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:50:00.790103 (+ 1018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:50:00.790955 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:50:00.791437 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:50:00.791542 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:50:00.793995 (+ 2453us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:50:00.794000 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:50:00.794000 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:50:00.794014 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:50:00.796220 (+ 2206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:50:00.796592 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:50:00.796596 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:50:00.796596 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:50:00.796690 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:50:00.796873 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:50:00.796874 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:50:00.796874 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:50:00.797161 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:50:00.797316 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0805 22:50:00.797483 (+ 167us) server_negotiation.cc:299] Negotiation successful
0805 22:50:00.797643 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":67,"threads_started":1}
I20260805 22:50:00.798156 5852 catalog_manager.cc:1347] Generated new cluster ID: 481573c600f04be69bf064863ce850e4
I20260805 22:50:00.798204 5852 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:50:00.808248 5852 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:50:00.809062 5852 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:50:00.825104 5852 catalog_manager.cc:5868] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216: Generated new TSK 0
I20260805 22:50:00.825387 5852 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.224.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab.
Entry for principal kudu/127.14.224.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab.
I20260805 22:50:00.860225 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.129:0
--local_ip_for_outbound_sockets=127.14.224.129
--webserver_interface=127.14.224.129
--webserver_port=0
--tserver_master_addrs=127.14.224.190:40037
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab
--principal=kudu/127.14.224.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:39697
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:50:00.947052 5870 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:50:00.947374 5870 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:50:00.947408 5870 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:50:00.948621 5870 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:50:00.948666 5870 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:50:00.948693 5870 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.129
I20260805 22:50:00.950199 5870 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:39697
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab
--principal=kudu/127.14.224.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.224.129
--webserver_port=0
--tserver_master_addrs=127.14.224.190:40037
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5870
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.129
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:50:00.950407 5870 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:50:00.950610 5870 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:50:00.955739 5876 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:50:00.955889 5870 server_base.cc:1034] running on GCE node
W20260805 22:50:00.955781 5879 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:50:00.955806 5881 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:50:00.956243 5870 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:50:00.956524 5870 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:50:00.957679 5870 hybrid_clock.cc:648] HybridClock initialized: now 1785970200957666 us; error 27 us; skew 500 ppm
Aug 05 22:50:00 dist-test-slave-gjrz krb5kdc[5712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970200, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:50:00.960357 5870 init.cc:377] Logged in from keytab as kudu/127.14.224.129@KRBTEST.COM (short username kudu)
I20260805 22:50:00.960884 5870 webserver.cc:460] Webserver started at http://127.14.224.129:45171/ using document root <none> and password file <none>
I20260805 22:50:00.961126 5870 fs_manager.cc:359] Metadata directory not provided
I20260805 22:50:00.961179 5870 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:50:00.961305 5870 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:50:00.962565 5870 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-0/data/instance:
uuid: "48daec8901ad4021b9fbb975adef74b2"
format_stamp: "Formatted at 2026-08-05 22:50:00 on dist-test-slave-gjrz"
server_key: "59520f1cd6920eb22c906e79980d66e4"
server_key_iv: "f34ae71d5e745e09cb873950c39bd533"
server_key_version: "encryptionkey@0"
I20260805 22:50:00.962996 5870 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-0/wal/instance:
uuid: "48daec8901ad4021b9fbb975adef74b2"
format_stamp: "Formatted at 2026-08-05 22:50:00 on dist-test-slave-gjrz"
server_key: "59520f1cd6920eb22c906e79980d66e4"
server_key_iv: "f34ae71d5e745e09cb873950c39bd533"
server_key_version: "encryptionkey@0"
I20260805 22:50:00.964389 5870 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260805 22:50:00.965128 5894 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:50:00.965284 5870 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260805 22:50:00.965375 5870 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-0/wal
uuid: "48daec8901ad4021b9fbb975adef74b2"
format_stamp: "Formatted at 2026-08-05 22:50:00 on dist-test-slave-gjrz"
server_key: "59520f1cd6920eb22c906e79980d66e4"
server_key_iv: "f34ae71d5e745e09cb873950c39bd533"
server_key_version: "encryptionkey@0"
I20260805 22:50:00.965446 5870 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:50:00.984066 5870 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:50:00.985913 5870 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:50:00.986076 5870 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:50:00.986316 5870 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:50:00.986645 5870 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:50:00.986682 5870 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:50:00.986712 5870 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:50:00.986737 5870 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:50:00.992761 5870 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.129:33539
I20260805 22:50:00.992808 6064 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.129:33539 every 8 connection(s)
I20260805 22:50:00.993158 5870 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
I20260805 22:50:00.996515 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 5870
I20260805 22:50:00.996644 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-0/wal/instance
I20260805 22:50:00.996840 15234 external_mini_cluster.cc:1428] Setting key 73782536fcb8249806ba4453b2274cce
Aug 05 22:50:00 dist-test-slave-gjrz krb5kdc[5712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970200, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.129@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:50:01.003065 5839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:00.993923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.129:34049 (local address 127.14.224.190:40037)
0805 22:50:00.993975 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0805 22:50:00.993977 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:50:00.994167 (+ 190us) server_negotiation.cc:407] Connection header received
0805 22:50:00.994687 (+ 520us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:50:00.994688 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:50:00.994698 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:50:00.994764 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:50:00.995812 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:50:00.996434 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:50:00.997572 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:50:00.997853 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:50:00.997925 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:50:01.000270 (+ 2345us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:50:01.000272 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:50:01.000272 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:50:01.000280 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:50:01.001522 (+ 1242us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:50:01.002060 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:50:01.002061 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:50:01.002061 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:50:01.002151 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:50:01.002432 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:50:01.002433 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:50:01.002433 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:50:01.002543 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:50:01.002591 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0805 22:50:01.002917 (+ 326us) server_negotiation.cc:299] Negotiation successful
0805 22:50:01.002995 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260805 22:50:01.003378 6069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:00.993873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:40037 (local address 127.14.224.129:34049)
0805 22:50:00.994038 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:00.994082 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0805 22:50:00.994602 (+ 520us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:50:00.994824 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:50:00.994827 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:50:00.995493 (+ 666us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:50:00.995723 (+ 230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:50:00.995729 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:50:00.996530 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:50:00.996531 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:50:00.997497 (+ 966us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:50:00.997501 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:50:00.997929 (+ 428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:50:00.997930 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:50:00.998055 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:50:00.998561 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:50:00.998570 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:50:01.000157 (+ 1587us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:50:01.001603 (+ 1446us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:50:01.001612 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:50:01.001614 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:50:01.001969 (+ 355us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:50:01.002219 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:50:01.002220 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:50:01.002220 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:50:01.002370 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:50:01.002599 (+ 229us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:50:01.002606 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:50:01.002782 (+ 176us) client_negotiation.cc:769] Sending connection context
0805 22:50:01.002900 (+ 118us) client_negotiation.cc:240] Negotiation successful
0805 22:50:01.003097 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":83,"threads_started":1}
I20260805 22:50:01.003885 6066 heartbeater.cc:347] Connected to a master server at 127.14.224.190:40037
I20260805 22:50:01.004004 6066 heartbeater.cc:464] Registering TS with master...
I20260805 22:50:01.004222 6066 heartbeater.cc:511] Master 127.14.224.190:40037 requested a full tablet report, sending...
I20260805 22:50:01.004755 5777 ts_manager.cc:194] Registered new tserver with Master: 48daec8901ad4021b9fbb975adef74b2 (127.14.224.129:33539)
I20260805 22:50:01.005370 5777 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.224.129@KRBTEST.COM'} at 127.14.224.129:34049
WARNING: no policy specified for kudu/127.14.224.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab.
Entry for principal kudu/127.14.224.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab.
I20260805 22:50:01.027115 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.130:0
--local_ip_for_outbound_sockets=127.14.224.130
--webserver_interface=127.14.224.130
--webserver_port=0
--tserver_master_addrs=127.14.224.190:40037
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab
--principal=kudu/127.14.224.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:39697
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:50:01.111793 6074 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:50:01.112021 6074 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:50:01.112052 6074 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:50:01.113255 6074 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:50:01.113302 6074 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:50:01.113330 6074 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.130
I20260805 22:50:01.114850 6074 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:39697
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab
--principal=kudu/127.14.224.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.224.130
--webserver_port=0
--tserver_master_addrs=127.14.224.190:40037
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6074
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.130
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:50:01.115118 6074 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:50:01.115384 6074 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:50:01.120821 6082 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:50:01.120834 6085 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:50:01.120889 6074 server_base.cc:1034] running on GCE node
W20260805 22:50:01.120834 6083 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:50:01.121253 6074 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:50:01.121496 6074 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:50:01.122656 6074 hybrid_clock.cc:648] HybridClock initialized: now 1785970201122640 us; error 30 us; skew 500 ppm
Aug 05 22:50:01 dist-test-slave-gjrz krb5kdc[5712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970201, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:50:01.125304 6074 init.cc:377] Logged in from keytab as kudu/127.14.224.130@KRBTEST.COM (short username kudu)
I20260805 22:50:01.125787 6074 webserver.cc:460] Webserver started at http://127.14.224.130:35895/ using document root <none> and password file <none>
I20260805 22:50:01.126008 6074 fs_manager.cc:359] Metadata directory not provided
I20260805 22:50:01.126057 6074 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:50:01.126179 6074 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:50:01.127338 6074 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-1/data/instance:
uuid: "281ac2be36c944359aabd1985199ca2e"
format_stamp: "Formatted at 2026-08-05 22:50:01 on dist-test-slave-gjrz"
server_key: "db6ac0c4e073e2d722ab6b80aa2f4f39"
server_key_iv: "41bcd99c79d1cd9ef53eaaf2a1117e93"
server_key_version: "encryptionkey@0"
I20260805 22:50:01.127705 6074 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-1/wal/instance:
uuid: "281ac2be36c944359aabd1985199ca2e"
format_stamp: "Formatted at 2026-08-05 22:50:01 on dist-test-slave-gjrz"
server_key: "db6ac0c4e073e2d722ab6b80aa2f4f39"
server_key_iv: "41bcd99c79d1cd9ef53eaaf2a1117e93"
server_key_version: "encryptionkey@0"
I20260805 22:50:01.129134 6074 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260805 22:50:01.129946 6097 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:50:01.130168 6074 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:50:01.130267 6074 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-1/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-1/wal
uuid: "281ac2be36c944359aabd1985199ca2e"
format_stamp: "Formatted at 2026-08-05 22:50:01 on dist-test-slave-gjrz"
server_key: "db6ac0c4e073e2d722ab6b80aa2f4f39"
server_key_iv: "41bcd99c79d1cd9ef53eaaf2a1117e93"
server_key_version: "encryptionkey@0"
I20260805 22:50:01.130334 6074 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:50:01.143713 6074 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:50:01.145758 6074 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:50:01.145902 6074 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:50:01.146152 6074 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:50:01.146484 6074 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:50:01.146520 6074 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:50:01.146550 6074 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:50:01.146574 6074 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:50:01.152508 6074 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.130:38039
I20260805 22:50:01.152554 6267 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.130:38039 every 8 connection(s)
I20260805 22:50:01.152889 6074 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
I20260805 22:50:01.153532 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 6074
I20260805 22:50:01.153630 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-1/wal/instance
I20260805 22:50:01.153832 15234 external_mini_cluster.cc:1428] Setting key f140eaeeca59c8fd088141aa80056513
Aug 05 22:50:01 dist-test-slave-gjrz krb5kdc[5712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970201, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.130@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:50:01.163519 5839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:01.153675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:58377 (local address 127.14.224.190:40037)
0805 22:50:01.153738 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0805 22:50:01.153740 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:50:01.153937 (+ 197us) server_negotiation.cc:407] Connection header received
0805 22:50:01.154457 (+ 520us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:50:01.154458 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:50:01.154468 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:50:01.154511 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:50:01.155557 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:50:01.156247 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:50:01.157736 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:50:01.157939 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:50:01.158005 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:50:01.160624 (+ 2619us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:50:01.160626 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:50:01.160626 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:50:01.160633 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:50:01.162051 (+ 1418us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:50:01.162515 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:50:01.162516 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:50:01.162516 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:50:01.162564 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:50:01.162837 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:50:01.162837 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:50:01.162837 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:50:01.162942 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:50:01.162990 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0805 22:50:01.163376 (+ 386us) server_negotiation.cc:299] Negotiation successful
0805 22:50:01.163447 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
WARNING: no policy specified for kudu/127.14.224.131@KRBTEST.COM; defaulting to no policy
I20260805 22:50:01.163808 6271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:01.153623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:40037 (local address 127.14.224.130:58377)
0805 22:50:01.153807 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:01.153852 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0805 22:50:01.154378 (+ 526us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:50:01.154607 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:50:01.154612 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:50:01.155202 (+ 590us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:50:01.155455 (+ 253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:50:01.155462 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:50:01.156355 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:50:01.156356 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:50:01.157611 (+ 1255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:50:01.157616 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:50:01.158033 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:50:01.158035 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:50:01.158191 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:50:01.158746 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:50:01.158757 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:50:01.160506 (+ 1749us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:50:01.162127 (+ 1621us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:50:01.162137 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:50:01.162140 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:50:01.162443 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:50:01.162633 (+ 190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:50:01.162633 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:50:01.162634 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:50:01.162776 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:50:01.162997 (+ 221us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:50:01.163003 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:50:01.163196 (+ 193us) client_negotiation.cc:769] Sending connection context
0805 22:50:01.163356 (+ 160us) client_negotiation.cc:240] Negotiation successful
0805 22:50:01.163556 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":93,"threads_started":1}
I20260805 22:50:01.164289 6268 heartbeater.cc:347] Connected to a master server at 127.14.224.190:40037
I20260805 22:50:01.164388 6268 heartbeater.cc:464] Registering TS with master...
I20260805 22:50:01.164559 6268 heartbeater.cc:511] Master 127.14.224.190:40037 requested a full tablet report, sending...
I20260805 22:50:01.164974 5777 ts_manager.cc:194] Registered new tserver with Master: 281ac2be36c944359aabd1985199ca2e (127.14.224.130:38039)
I20260805 22:50:01.165367 5777 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.224.130@KRBTEST.COM'} at 127.14.224.130:58377
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab.
Entry for principal kudu/127.14.224.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab.
I20260805 22:50:01.182842 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.131:0
--local_ip_for_outbound_sockets=127.14.224.131
--webserver_interface=127.14.224.131
--webserver_port=0
--tserver_master_addrs=127.14.224.190:40037
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab
--principal=kudu/127.14.224.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:39697
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:50:01.266794 6276 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:50:01.267024 6276 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:50:01.267058 6276 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:50:01.268364 6276 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:50:01.268417 6276 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:50:01.268507 6276 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.131
I20260805 22:50:01.270136 6276 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:39697
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab
--principal=kudu/127.14.224.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.224.131
--webserver_port=0
--tserver_master_addrs=127.14.224.190:40037
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6276
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.131
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:50:01.270395 6276 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:50:01.270635 6276 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:50:01.275959 6284 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:50:01.275959 6289 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:50:01.275990 6276 server_base.cc:1034] running on GCE node
W20260805 22:50:01.275980 6285 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:50:01.276415 6276 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:50:01.276674 6276 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:50:01.277832 6276 hybrid_clock.cc:648] HybridClock initialized: now 1785970201277819 us; error 29 us; skew 500 ppm
Aug 05 22:50:01 dist-test-slave-gjrz krb5kdc[5712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970201, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:50:01.280531 6276 init.cc:377] Logged in from keytab as kudu/127.14.224.131@KRBTEST.COM (short username kudu)
I20260805 22:50:01.281018 6276 webserver.cc:460] Webserver started at http://127.14.224.131:45873/ using document root <none> and password file <none>
I20260805 22:50:01.281268 6276 fs_manager.cc:359] Metadata directory not provided
I20260805 22:50:01.281323 6276 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:50:01.281458 6276 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:50:01.282598 6276 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-2/data/instance:
uuid: "50ecf08c1e7f4f258cf8785ffa073600"
format_stamp: "Formatted at 2026-08-05 22:50:01 on dist-test-slave-gjrz"
server_key: "f75948b64259e48ffc5c8540a371353c"
server_key_iv: "31ce7872f88542692ef43ed93ac795a9"
server_key_version: "encryptionkey@0"
I20260805 22:50:01.282999 6276 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-2/wal/instance:
uuid: "50ecf08c1e7f4f258cf8785ffa073600"
format_stamp: "Formatted at 2026-08-05 22:50:01 on dist-test-slave-gjrz"
server_key: "f75948b64259e48ffc5c8540a371353c"
server_key_iv: "31ce7872f88542692ef43ed93ac795a9"
server_key_version: "encryptionkey@0"
I20260805 22:50:01.284497 6276 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260805 22:50:01.285296 6298 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:50:01.285478 6276 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260805 22:50:01.285563 6276 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-2/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-2/wal
uuid: "50ecf08c1e7f4f258cf8785ffa073600"
format_stamp: "Formatted at 2026-08-05 22:50:01 on dist-test-slave-gjrz"
server_key: "f75948b64259e48ffc5c8540a371353c"
server_key_iv: "31ce7872f88542692ef43ed93ac795a9"
server_key_version: "encryptionkey@0"
I20260805 22:50:01.285643 6276 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:50:01.306922 6276 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:50:01.308911 6276 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:50:01.309077 6276 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:50:01.309326 6276 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:50:01.309644 6276 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:50:01.309682 6276 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:50:01.309713 6276 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:50:01.309737 6276 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:50:01.315421 6276 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.131:45969
I20260805 22:50:01.315490 6474 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.131:45969 every 8 connection(s)
I20260805 22:50:01.315815 6276 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
I20260805 22:50:01.319206 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 6276
I20260805 22:50:01.319343 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-2/wal/instance
I20260805 22:50:01.319542 15234 external_mini_cluster.cc:1428] Setting key dd73629c6873cea5d676af6a895b1f16
Aug 05 22:50:01 dist-test-slave-gjrz krb5kdc[5712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970201, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.131@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:50:01.326423 5839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:01.316582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:35295 (local address 127.14.224.190:40037)
0805 22:50:01.316635 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0805 22:50:01.316638 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:50:01.316897 (+ 259us) server_negotiation.cc:407] Connection header received
0805 22:50:01.317399 (+ 502us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:50:01.317400 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:50:01.317411 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:50:01.317465 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:50:01.318539 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:50:01.319051 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:50:01.320561 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:50:01.320870 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:50:01.320936 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:50:01.323350 (+ 2414us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:50:01.323351 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:50:01.323352 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:50:01.323359 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:50:01.324778 (+ 1419us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:50:01.325313 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:50:01.325315 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:50:01.325315 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:50:01.325376 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:50:01.325643 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:50:01.325644 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:50:01.325645 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:50:01.325835 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:50:01.325919 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0805 22:50:01.326221 (+ 302us) server_negotiation.cc:299] Negotiation successful
0805 22:50:01.326326 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260805 22:50:01.326614 6478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:01.316569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:40037 (local address 127.14.224.131:35295)
0805 22:50:01.316748 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:01.316790 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0805 22:50:01.317304 (+ 514us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:50:01.317559 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:50:01.317563 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:50:01.318179 (+ 616us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:50:01.318409 (+ 230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:50:01.318416 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:50:01.319216 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:50:01.319217 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:50:01.320472 (+ 1255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:50:01.320475 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:50:01.321057 (+ 582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:50:01.321058 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:50:01.321181 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:50:01.321735 (+ 554us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:50:01.321745 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:50:01.323227 (+ 1482us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:50:01.324900 (+ 1673us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:50:01.324910 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:50:01.324912 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:50:01.325247 (+ 335us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:50:01.325434 (+ 187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:50:01.325435 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:50:01.325435 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:50:01.325571 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:50:01.325927 (+ 356us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:50:01.325936 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:50:01.326087 (+ 151us) client_negotiation.cc:769] Sending connection context
0805 22:50:01.326187 (+ 100us) client_negotiation.cc:240] Negotiation successful
0805 22:50:01.326368 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":99,"threads_started":1}
I20260805 22:50:01.327116 6475 heartbeater.cc:347] Connected to a master server at 127.14.224.190:40037
I20260805 22:50:01.327221 6475 heartbeater.cc:464] Registering TS with master...
I20260805 22:50:01.327433 6475 heartbeater.cc:511] Master 127.14.224.190:40037 requested a full tablet report, sending...
I20260805 22:50:01.327839 5777 ts_manager.cc:194] Registered new tserver with Master: 50ecf08c1e7f4f258cf8785ffa073600 (127.14.224.131:45969)
I20260805 22:50:01.328222 5777 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.224.131@KRBTEST.COM'} at 127.14.224.131:35295
I20260805 22:50:01.331820 15234 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 22:50:01.339140 5839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:01.333138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51454 (local address 127.14.224.190:40037)
0805 22:50:01.333189 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0805 22:50:01.333191 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:50:01.333337 (+ 146us) server_negotiation.cc:407] Connection header received
0805 22:50:01.333380 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:50:01.333381 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:50:01.333391 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:50:01.333439 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:50:01.334004 (+ 565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:50:01.334574 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:50:01.335362 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:50:01.335560 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:50:01.335611 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:50:01.336702 (+ 1091us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:50:01.336704 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:50:01.336704 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:50:01.336711 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:50:01.338005 (+ 1294us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:50:01.338436 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:50:01.338437 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:50:01.338437 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:50:01.338503 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:50:01.338664 (+ 161us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:50:01.338664 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:50:01.338664 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:50:01.338815 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:50:01.338889 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0805 22:50:01.338972 (+ 83us) server_negotiation.cc:299] Negotiation successful
0805 22:50:01.339071 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260805 22:50:01.340757 5777 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51454:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:50:01.342437 5777 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:50:01.349357 6495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:01.344899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.130:38039 (local address 127.0.0.1:59956)
0805 22:50:01.345073 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:01.345116 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0805 22:50:01.345181 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:50:01.345592 (+ 411us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:50:01.345596 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:50:01.345598 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:50:01.345682 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:50:01.345684 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:50:01.347132 (+ 1448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:50:01.347133 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:50:01.348230 (+ 1097us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:50:01.348232 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:50:01.349071 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:50:01.349072 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:50:01.349141 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:50:01.349144 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:50:01.349192 (+ 48us) client_negotiation.cc:240] Negotiation successful
0805 22:50:01.349268 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"mutex_wait_us":24,"spinlock_wait_cycles":1408,"thread_start_us":86,"threads_started":1}
I20260805 22:50:01.349357 6501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:01.345368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58538 (local address 127.14.224.131:45969)
0805 22:50:01.345567 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0805 22:50:01.345571 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:50:01.345590 (+ 19us) server_negotiation.cc:407] Connection header received
0805 22:50:01.345631 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:50:01.345634 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:50:01.345649 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:50:01.345725 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:50:01.345937 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:50:01.346684 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:50:01.348231 (+ 1547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:50:01.348882 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:50:01.348953 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:50:01.349020 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0805 22:50:01.349207 (+ 187us) server_negotiation.cc:299] Negotiation successful
0805 22:50:01.349259 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":89,"threads_started":1}
I20260805 22:50:01.349371 6498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:01.345025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59956 (local address 127.14.224.130:38039)
0805 22:50:01.345410 (+ 385us) server_negotiation.cc:206] Beginning negotiation
0805 22:50:01.345413 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:50:01.345423 (+ 10us) server_negotiation.cc:407] Connection header received
0805 22:50:01.345490 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:50:01.345492 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:50:01.345504 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:50:01.345578 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:50:01.345858 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:50:01.347019 (+ 1161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:50:01.348297 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:50:01.348958 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:50:01.349067 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:50:01.349131 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0805 22:50:01.349248 (+ 117us) server_negotiation.cc:299] Negotiation successful
0805 22:50:01.349293 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":349,"thread_start_us":102,"threads_started":1}
I20260805 22:50:01.349671 6500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:01.345143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.131:45969 (local address 127.0.0.1:58538)
0805 22:50:01.345331 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:01.345342 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:50:01.345409 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:50:01.345808 (+ 399us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:50:01.345809 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:50:01.345811 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:50:01.345861 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:50:01.345862 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:50:01.346791 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:50:01.346792 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:50:01.348135 (+ 1343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:50:01.348138 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:50:01.348967 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:50:01.348968 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:50:01.349072 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:50:01.349093 (+ 21us) client_negotiation.cc:769] Sending connection context
0805 22:50:01.349183 (+ 90us) client_negotiation.cc:240] Negotiation successful
0805 22:50:01.349608 (+ 425us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":87,"threads_started":1}
I20260805 22:50:01.350072 6496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:01.344899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.129:33539 (local address 127.0.0.1:47712)
0805 22:50:01.345279 (+ 380us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:01.345287 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0805 22:50:01.345376 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:50:01.345665 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:50:01.345666 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:50:01.345668 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:50:01.345720 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:50:01.345722 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:50:01.347389 (+ 1667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:50:01.347390 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:50:01.348407 (+ 1017us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:50:01.348411 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:50:01.349402 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:50:01.349403 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:50:01.349896 (+ 493us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:50:01.349901 (+ 5us) client_negotiation.cc:769] Sending connection context
0805 22:50:01.349964 (+ 63us) client_negotiation.cc:240] Negotiation successful
0805 22:50:01.350005 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":363,"thread_start_us":67,"threads_started":1}
I20260805 22:50:01.350267 6166 tablet_service.cc:1467] Processing CreateTablet for tablet 43879c03538f4696af48118f1ff9ba5d (DEFAULT_TABLE table=test-table [id=e3b86c9ece5a4c4c9fa26138a2bb866d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:50:01.350510 6499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:01.345099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47712 (local address 127.14.224.129:33539)
0805 22:50:01.345263 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0805 22:50:01.345268 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:50:01.345348 (+ 80us) server_negotiation.cc:407] Connection header received
0805 22:50:01.345467 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:50:01.345470 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:50:01.345487 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:50:01.345543 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:50:01.345788 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:50:01.347019 (+ 1231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:50:01.348508 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:50:01.349246 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:50:01.349315 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:50:01.349363 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0805 22:50:01.349991 (+ 628us) server_negotiation.cc:299] Negotiation successful
0805 22:50:01.350406 (+ 415us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":90,"threads_started":1}
I20260805 22:50:01.350481 6374 tablet_service.cc:1467] Processing CreateTablet for tablet 43879c03538f4696af48118f1ff9ba5d (DEFAULT_TABLE table=test-table [id=e3b86c9ece5a4c4c9fa26138a2bb866d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:50:01.350661 6166 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 43879c03538f4696af48118f1ff9ba5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:50:01.350841 6374 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 43879c03538f4696af48118f1ff9ba5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:50:01.351189 5973 tablet_service.cc:1467] Processing CreateTablet for tablet 43879c03538f4696af48118f1ff9ba5d (DEFAULT_TABLE table=test-table [id=e3b86c9ece5a4c4c9fa26138a2bb866d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:50:01.351550 5973 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 43879c03538f4696af48118f1ff9ba5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:50:01.353951 6502 tablet_bootstrap.cc:492] T 43879c03538f4696af48118f1ff9ba5d P 50ecf08c1e7f4f258cf8785ffa073600: Bootstrap starting.
I20260805 22:50:01.354430 6506 tablet_bootstrap.cc:492] T 43879c03538f4696af48118f1ff9ba5d P 281ac2be36c944359aabd1985199ca2e: Bootstrap starting.
I20260805 22:50:01.354635 6502 tablet_bootstrap.cc:654] T 43879c03538f4696af48118f1ff9ba5d P 50ecf08c1e7f4f258cf8785ffa073600: Neither blocks nor log segments found. Creating new log.
I20260805 22:50:01.355091 6506 tablet_bootstrap.cc:654] T 43879c03538f4696af48118f1ff9ba5d P 281ac2be36c944359aabd1985199ca2e: Neither blocks nor log segments found. Creating new log.
I20260805 22:50:01.355233 6502 log.cc:824] T 43879c03538f4696af48118f1ff9ba5d P 50ecf08c1e7f4f258cf8785ffa073600: Log is configured to *not* fsync() on all Append() calls
I20260805 22:50:01.355415 6507 tablet_bootstrap.cc:492] T 43879c03538f4696af48118f1ff9ba5d P 48daec8901ad4021b9fbb975adef74b2: Bootstrap starting.
I20260805 22:50:01.355639 6506 log.cc:824] T 43879c03538f4696af48118f1ff9ba5d P 281ac2be36c944359aabd1985199ca2e: Log is configured to *not* fsync() on all Append() calls
I20260805 22:50:01.356036 6502 tablet_bootstrap.cc:492] T 43879c03538f4696af48118f1ff9ba5d P 50ecf08c1e7f4f258cf8785ffa073600: No bootstrap required, opened a new log
I20260805 22:50:01.356045 6507 tablet_bootstrap.cc:654] T 43879c03538f4696af48118f1ff9ba5d P 48daec8901ad4021b9fbb975adef74b2: Neither blocks nor log segments found. Creating new log.
I20260805 22:50:01.356114 6502 ts_tablet_manager.cc:1397] T 43879c03538f4696af48118f1ff9ba5d P 50ecf08c1e7f4f258cf8785ffa073600: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260805 22:50:01.356547 6506 tablet_bootstrap.cc:492] T 43879c03538f4696af48118f1ff9ba5d P 281ac2be36c944359aabd1985199ca2e: No bootstrap required, opened a new log
I20260805 22:50:01.356623 6506 ts_tablet_manager.cc:1397] T 43879c03538f4696af48118f1ff9ba5d P 281ac2be36c944359aabd1985199ca2e: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260805 22:50:01.356631 6507 log.cc:824] T 43879c03538f4696af48118f1ff9ba5d P 48daec8901ad4021b9fbb975adef74b2: Log is configured to *not* fsync() on all Append() calls
I20260805 22:50:01.357365 6507 tablet_bootstrap.cc:492] T 43879c03538f4696af48118f1ff9ba5d P 48daec8901ad4021b9fbb975adef74b2: No bootstrap required, opened a new log
I20260805 22:50:01.357476 6507 ts_tablet_manager.cc:1397] T 43879c03538f4696af48118f1ff9ba5d P 48daec8901ad4021b9fbb975adef74b2: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260805 22:50:01.358027 6502 raft_consensus.cc:348] T 43879c03538f4696af48118f1ff9ba5d P 50ecf08c1e7f4f258cf8785ffa073600 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "281ac2be36c944359aabd1985199ca2e" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 38039 } } peers { permanent_uuid: "50ecf08c1e7f4f258cf8785ffa073600" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 45969 } } peers { permanent_uuid: "48daec8901ad4021b9fbb975adef74b2" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 33539 } }
I20260805 22:50:01.358192 6502 raft_consensus.cc:374] T 43879c03538f4696af48118f1ff9ba5d P 50ecf08c1e7f4f258cf8785ffa073600 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:50:01.358229 6502 raft_consensus.cc:729] T 43879c03538f4696af48118f1ff9ba5d P 50ecf08c1e7f4f258cf8785ffa073600 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50ecf08c1e7f4f258cf8785ffa073600, State: Initialized, Role: FOLLOWER
I20260805 22:50:01.358389 6502 consensus_queue.cc:260] T 43879c03538f4696af48118f1ff9ba5d P 50ecf08c1e7f4f258cf8785ffa073600 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "281ac2be36c944359aabd1985199ca2e" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 38039 } } peers { permanent_uuid: "50ecf08c1e7f4f258cf8785ffa073600" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 45969 } } peers { permanent_uuid: "48daec8901ad4021b9fbb975adef74b2" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 33539 } }
I20260805 22:50:01.358682 6502 ts_tablet_manager.cc:1428] T 43879c03538f4696af48118f1ff9ba5d P 50ecf08c1e7f4f258cf8785ffa073600: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260805 22:50:01.358636 6506 raft_consensus.cc:348] T 43879c03538f4696af48118f1ff9ba5d P 281ac2be36c944359aabd1985199ca2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "281ac2be36c944359aabd1985199ca2e" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 38039 } } peers { permanent_uuid: "50ecf08c1e7f4f258cf8785ffa073600" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 45969 } } peers { permanent_uuid: "48daec8901ad4021b9fbb975adef74b2" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 33539 } }
I20260805 22:50:01.358815 6475 heartbeater.cc:503] Master 127.14.224.190:40037 was elected leader, sending a full tablet report...
I20260805 22:50:01.358873 6506 raft_consensus.cc:374] T 43879c03538f4696af48118f1ff9ba5d P 281ac2be36c944359aabd1985199ca2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:50:01.358934 6506 raft_consensus.cc:729] T 43879c03538f4696af48118f1ff9ba5d P 281ac2be36c944359aabd1985199ca2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 281ac2be36c944359aabd1985199ca2e, State: Initialized, Role: FOLLOWER
I20260805 22:50:01.359107 6506 consensus_queue.cc:260] T 43879c03538f4696af48118f1ff9ba5d P 281ac2be36c944359aabd1985199ca2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "281ac2be36c944359aabd1985199ca2e" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 38039 } } peers { permanent_uuid: "50ecf08c1e7f4f258cf8785ffa073600" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 45969 } } peers { permanent_uuid: "48daec8901ad4021b9fbb975adef74b2" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 33539 } }
I20260805 22:50:01.359467 6506 ts_tablet_manager.cc:1428] T 43879c03538f4696af48118f1ff9ba5d P 281ac2be36c944359aabd1985199ca2e: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260805 22:50:01.359491 6268 heartbeater.cc:503] Master 127.14.224.190:40037 was elected leader, sending a full tablet report...
I20260805 22:50:01.359547 6507 raft_consensus.cc:348] T 43879c03538f4696af48118f1ff9ba5d P 48daec8901ad4021b9fbb975adef74b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "281ac2be36c944359aabd1985199ca2e" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 38039 } } peers { permanent_uuid: "50ecf08c1e7f4f258cf8785ffa073600" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 45969 } } peers { permanent_uuid: "48daec8901ad4021b9fbb975adef74b2" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 33539 } }
I20260805 22:50:01.359717 6507 raft_consensus.cc:374] T 43879c03538f4696af48118f1ff9ba5d P 48daec8901ad4021b9fbb975adef74b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:50:01.359753 6507 raft_consensus.cc:729] T 43879c03538f4696af48118f1ff9ba5d P 48daec8901ad4021b9fbb975adef74b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48daec8901ad4021b9fbb975adef74b2, State: Initialized, Role: FOLLOWER
I20260805 22:50:01.359879 6507 consensus_queue.cc:260] T 43879c03538f4696af48118f1ff9ba5d P 48daec8901ad4021b9fbb975adef74b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "281ac2be36c944359aabd1985199ca2e" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 38039 } } peers { permanent_uuid: "50ecf08c1e7f4f258cf8785ffa073600" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 45969 } } peers { permanent_uuid: "48daec8901ad4021b9fbb975adef74b2" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 33539 } }
I20260805 22:50:01.360169 6507 ts_tablet_manager.cc:1428] T 43879c03538f4696af48118f1ff9ba5d P 48daec8901ad4021b9fbb975adef74b2: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260805 22:50:01.360204 6066 heartbeater.cc:503] Master 127.14.224.190:40037 was elected leader, sending a full tablet report...
W20260805 22:50:01.403513 6269 tablet.cc:2369] T 43879c03538f4696af48118f1ff9ba5d P 281ac2be36c944359aabd1985199ca2e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260805 22:50:01.493920 6068 tablet.cc:2369] T 43879c03538f4696af48118f1ff9ba5d P 48daec8901ad4021b9fbb975adef74b2: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260805 22:50:01.566448 6476 tablet.cc:2369] T 43879c03538f4696af48118f1ff9ba5d P 50ecf08c1e7f4f258cf8785ffa073600: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:50:01.675688 6513 raft_consensus.cc:482] T 43879c03538f4696af48118f1ff9ba5d P 281ac2be36c944359aabd1985199ca2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:50:01.675829 6513 raft_consensus.cc:504] T 43879c03538f4696af48118f1ff9ba5d P 281ac2be36c944359aabd1985199ca2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "281ac2be36c944359aabd1985199ca2e" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 38039 } } peers { permanent_uuid: "50ecf08c1e7f4f258cf8785ffa073600" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 45969 } } peers { permanent_uuid: "48daec8901ad4021b9fbb975adef74b2" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 33539 } }
I20260805 22:50:01.676180 6513 leader_election.cc:288] T 43879c03538f4696af48118f1ff9ba5d P 281ac2be36c944359aabd1985199ca2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50ecf08c1e7f4f258cf8785ffa073600 (127.14.224.131:45969), 48daec8901ad4021b9fbb975adef74b2 (127.14.224.129:33539)
I20260805 22:50:01.679104 6501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:01.676532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:41651 (local address 127.14.224.131:45969)
0805 22:50:01.676584 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0805 22:50:01.676586 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:50:01.676623 (+ 37us) server_negotiation.cc:407] Connection header received
0805 22:50:01.676690 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:50:01.676691 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:50:01.676698 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:50:01.676750 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:50:01.676901 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:50:01.677378 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:50:01.678399 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:50:01.678785 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:50:01.678854 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:50:01.678863 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0805 22:50:01.679001 (+ 138us) server_negotiation.cc:299] Negotiation successful
0805 22:50:01.679040 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260805 22:50:01.679100 6499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:01.676565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:47777 (local address 127.14.224.129:33539)
0805 22:50:01.676611 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0805 22:50:01.676613 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:50:01.676623 (+ 10us) server_negotiation.cc:407] Connection header received
0805 22:50:01.676675 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:50:01.676676 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:50:01.676688 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:50:01.676737 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:50:01.676899 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:50:01.677388 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:50:01.678397 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:50:01.678757 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:50:01.678814 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:50:01.678822 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0805 22:50:01.678977 (+ 155us) server_negotiation.cc:299] Negotiation successful
0805 22:50:01.679020 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260805 22:50:01.679116 6522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:01.676395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.129:33539 (local address 127.14.224.130:47777)
0805 22:50:01.676541 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:01.676553 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:50:01.676615 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:50:01.676751 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:50:01.676752 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:50:01.676753 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:50:01.676830 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:50:01.676832 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:50:01.677472 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:50:01.677473 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:50:01.678295 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:50:01.678297 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:50:01.678834 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:50:01.678835 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:50:01.678907 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:50:01.678911 (+ 4us) client_negotiation.cc:769] Sending connection context
0805 22:50:01.678953 (+ 42us) client_negotiation.cc:240] Negotiation successful
0805 22:50:01.679009 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":72,"threads_started":1}
I20260805 22:50:01.679118 6519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:01.676401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.131:45969 (local address 127.14.224.130:41651)
0805 22:50:01.676552 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:01.676564 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:50:01.676635 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:50:01.676764 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:50:01.676765 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:50:01.676766 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:50:01.676835 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:50:01.676837 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:50:01.677469 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:50:01.677471 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:50:01.678296 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:50:01.678299 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:50:01.678870 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:50:01.678871 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:50:01.678928 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:50:01.678932 (+ 4us) client_negotiation.cc:769] Sending connection context
0805 22:50:01.678986 (+ 54us) client_negotiation.cc:240] Negotiation successful
0805 22:50:01.679027 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"mutex_wait_us":2,"thread_start_us":72,"threads_started":1}
I20260805 22:50:01.679481 5996 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43879c03538f4696af48118f1ff9ba5d" candidate_uuid: "281ac2be36c944359aabd1985199ca2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48daec8901ad4021b9fbb975adef74b2" is_pre_election: true
I20260805 22:50:01.679654 5996 raft_consensus.cc:2454] T 43879c03538f4696af48118f1ff9ba5d P 48daec8901ad4021b9fbb975adef74b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 281ac2be36c944359aabd1985199ca2e in term 0.
I20260805 22:50:01.679935 6102 leader_election.cc:302] T 43879c03538f4696af48118f1ff9ba5d P 281ac2be36c944359aabd1985199ca2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 281ac2be36c944359aabd1985199ca2e, 48daec8901ad4021b9fbb975adef74b2; no voters:
I20260805 22:50:01.680084 6513 raft_consensus.cc:2781] T 43879c03538f4696af48118f1ff9ba5d P 281ac2be36c944359aabd1985199ca2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:50:01.680097 6412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43879c03538f4696af48118f1ff9ba5d" candidate_uuid: "281ac2be36c944359aabd1985199ca2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50ecf08c1e7f4f258cf8785ffa073600" is_pre_election: true
I20260805 22:50:01.680166 6513 raft_consensus.cc:482] T 43879c03538f4696af48118f1ff9ba5d P 281ac2be36c944359aabd1985199ca2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:50:01.680194 6513 raft_consensus.cc:3037] T 43879c03538f4696af48118f1ff9ba5d P 281ac2be36c944359aabd1985199ca2e [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:50:01.680225 6412 raft_consensus.cc:2454] T 43879c03538f4696af48118f1ff9ba5d P 50ecf08c1e7f4f258cf8785ffa073600 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 281ac2be36c944359aabd1985199ca2e in term 0.
I20260805 22:50:01.680980 6513 raft_consensus.cc:504] T 43879c03538f4696af48118f1ff9ba5d P 281ac2be36c944359aabd1985199ca2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "281ac2be36c944359aabd1985199ca2e" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 38039 } } peers { permanent_uuid: "50ecf08c1e7f4f258cf8785ffa073600" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 45969 } } peers { permanent_uuid: "48daec8901ad4021b9fbb975adef74b2" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 33539 } }
I20260805 22:50:01.681123 6513 leader_election.cc:288] T 43879c03538f4696af48118f1ff9ba5d P 281ac2be36c944359aabd1985199ca2e [CANDIDATE]: Term 1 election: Requested vote from peers 50ecf08c1e7f4f258cf8785ffa073600 (127.14.224.131:45969), 48daec8901ad4021b9fbb975adef74b2 (127.14.224.129:33539)
I20260805 22:50:01.681310 5996 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43879c03538f4696af48118f1ff9ba5d" candidate_uuid: "281ac2be36c944359aabd1985199ca2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48daec8901ad4021b9fbb975adef74b2"
I20260805 22:50:01.681332 6412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43879c03538f4696af48118f1ff9ba5d" candidate_uuid: "281ac2be36c944359aabd1985199ca2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50ecf08c1e7f4f258cf8785ffa073600"
I20260805 22:50:01.681402 5996 raft_consensus.cc:3037] T 43879c03538f4696af48118f1ff9ba5d P 48daec8901ad4021b9fbb975adef74b2 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:50:01.681402 6412 raft_consensus.cc:3037] T 43879c03538f4696af48118f1ff9ba5d P 50ecf08c1e7f4f258cf8785ffa073600 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:50:01.682149 6412 raft_consensus.cc:2454] T 43879c03538f4696af48118f1ff9ba5d P 50ecf08c1e7f4f258cf8785ffa073600 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 281ac2be36c944359aabd1985199ca2e in term 1.
I20260805 22:50:01.682183 5996 raft_consensus.cc:2454] T 43879c03538f4696af48118f1ff9ba5d P 48daec8901ad4021b9fbb975adef74b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 281ac2be36c944359aabd1985199ca2e in term 1.
I20260805 22:50:01.682332 6102 leader_election.cc:302] T 43879c03538f4696af48118f1ff9ba5d P 281ac2be36c944359aabd1985199ca2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 281ac2be36c944359aabd1985199ca2e, 48daec8901ad4021b9fbb975adef74b2; no voters:
I20260805 22:50:01.682443 6513 raft_consensus.cc:2781] T 43879c03538f4696af48118f1ff9ba5d P 281ac2be36c944359aabd1985199ca2e [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:50:01.682596 6513 raft_consensus.cc:686] T 43879c03538f4696af48118f1ff9ba5d P 281ac2be36c944359aabd1985199ca2e [term 1 LEADER]: Becoming Leader. State: Replica: 281ac2be36c944359aabd1985199ca2e, State: Running, Role: LEADER
I20260805 22:50:01.682683 6513 consensus_queue.cc:237] T 43879c03538f4696af48118f1ff9ba5d P 281ac2be36c944359aabd1985199ca2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "281ac2be36c944359aabd1985199ca2e" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 38039 } } peers { permanent_uuid: "50ecf08c1e7f4f258cf8785ffa073600" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 45969 } } peers { permanent_uuid: "48daec8901ad4021b9fbb975adef74b2" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 33539 } }
I20260805 22:50:01.683553 5777 catalog_manager.cc:5495] T 43879c03538f4696af48118f1ff9ba5d P 281ac2be36c944359aabd1985199ca2e reported cstate change: term changed from 0 to 1, leader changed from <none> to 281ac2be36c944359aabd1985199ca2e (127.14.224.130). New cstate: current_term: 1 leader_uuid: "281ac2be36c944359aabd1985199ca2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "281ac2be36c944359aabd1985199ca2e" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50ecf08c1e7f4f258cf8785ffa073600" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 45969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48daec8901ad4021b9fbb975adef74b2" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 33539 } health_report { overall_health: UNKNOWN } } }
I20260805 22:50:01.702351 6498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:01.700145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59968 (local address 127.14.224.130:38039)
0805 22:50:01.700198 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0805 22:50:01.700200 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:50:01.700227 (+ 27us) server_negotiation.cc:407] Connection header received
0805 22:50:01.700265 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:50:01.700265 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:50:01.700286 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:50:01.700338 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:50:01.700438 (+ 100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:50:01.700901 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:50:01.701688 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:50:01.701896 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:50:01.701954 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:50:01.702052 (+ 98us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:50:01.702182 (+ 130us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:50:01.702243 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0805 22:50:01.702255 (+ 12us) server_negotiation.cc:299] Negotiation successful
0805 22:50:01.702274 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260805 22:50:01.704293 6412 raft_consensus.cc:1261] T 43879c03538f4696af48118f1ff9ba5d P 50ecf08c1e7f4f258cf8785ffa073600 [term 1 FOLLOWER]: Refusing update from remote peer 281ac2be36c944359aabd1985199ca2e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:50:01.704293 5996 raft_consensus.cc:1261] T 43879c03538f4696af48118f1ff9ba5d P 48daec8901ad4021b9fbb975adef74b2 [term 1 FOLLOWER]: Refusing update from remote peer 281ac2be36c944359aabd1985199ca2e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:50:01.704643 6513 consensus_queue.cc:1035] T 43879c03538f4696af48118f1ff9ba5d P 281ac2be36c944359aabd1985199ca2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "48daec8901ad4021b9fbb975adef74b2" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 33539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:50:01.704768 6523 consensus_queue.cc:1035] T 43879c03538f4696af48118f1ff9ba5d P 281ac2be36c944359aabd1985199ca2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "50ecf08c1e7f4f258cf8785ffa073600" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 45969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:50:01.707532 6532 mvcc.cc:205] Tried to move back new op lower bound from 7315333946178031616 to 7315333946092945408. Current Snapshot: MvccSnapshot[applied={T|T < 7315333946178031616}]
I20260805 22:50:01.707661 6531 mvcc.cc:205] Tried to move back new op lower bound from 7315333946178031616 to 7315333946092945408. Current Snapshot: MvccSnapshot[applied={T|T < 7315333946178031616}]
I20260805 22:50:01.709501 5777 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51454:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:50:01.709599 5777 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51454:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:50:01.710312 5777 catalog_manager.cc:5782] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216: Sending DeleteTablet for 3 replicas of tablet 43879c03538f4696af48118f1ff9ba5d
I20260805 22:50:01.710693 5973 tablet_service.cc:1514] Processing DeleteTablet for tablet 43879c03538f4696af48118f1ff9ba5d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:50:01 UTC) from {username='kudu', principal='kudu/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:47712
I20260805 22:50:01.710713 6374 tablet_service.cc:1514] Processing DeleteTablet for tablet 43879c03538f4696af48118f1ff9ba5d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:50:01 UTC) from {username='kudu', principal='kudu/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:58538
I20260805 22:50:01.710707 6166 tablet_service.cc:1514] Processing DeleteTablet for tablet 43879c03538f4696af48118f1ff9ba5d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:50:01 UTC) from {username='kudu', principal='kudu/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:59956
I20260805 22:50:01.710970 6540 tablet_replica.cc:330] T 43879c03538f4696af48118f1ff9ba5d P 48daec8901ad4021b9fbb975adef74b2: stopping tablet replica
I20260805 22:50:01.711027 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 5870
I20260805 22:50:01.722472 6541 tablet_replica.cc:330] T 43879c03538f4696af48118f1ff9ba5d P 50ecf08c1e7f4f258cf8785ffa073600: stopping tablet replica
I20260805 22:50:01.722653 6541 raft_consensus.cc:2229] T 43879c03538f4696af48118f1ff9ba5d P 50ecf08c1e7f4f258cf8785ffa073600 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:50:01.722774 6541 raft_consensus.cc:2258] T 43879c03538f4696af48118f1ff9ba5d P 50ecf08c1e7f4f258cf8785ffa073600 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:50:01.727680 6541 ts_tablet_manager.cc:1905] T 43879c03538f4696af48118f1ff9ba5d P 50ecf08c1e7f4f258cf8785ffa073600: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:50:01.729714 6541 ts_tablet_manager.cc:1918] T 43879c03538f4696af48118f1ff9ba5d P 50ecf08c1e7f4f258cf8785ffa073600: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:50:01.729817 6541 log.cc:1196] T 43879c03538f4696af48118f1ff9ba5d P 50ecf08c1e7f4f258cf8785ffa073600: Deleting WAL directory at /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-2/wal/wals/43879c03538f4696af48118f1ff9ba5d
I20260805 22:50:01.730098 6541 ts_tablet_manager.cc:1939] T 43879c03538f4696af48118f1ff9ba5d P 50ecf08c1e7f4f258cf8785ffa073600: Deleting consensus metadata
I20260805 22:50:01.730849 5753 catalog_manager.cc:4841] TS 50ecf08c1e7f4f258cf8785ffa073600 (127.14.224.131:45969): tablet 43879c03538f4696af48118f1ff9ba5d (table test-table [id=e3b86c9ece5a4c4c9fa26138a2bb866d]) successfully deleted
I20260805 22:50:01.741031 6542 tablet_replica.cc:330] T 43879c03538f4696af48118f1ff9ba5d P 281ac2be36c944359aabd1985199ca2e: stopping tablet replica
I20260805 22:50:01.741204 6542 raft_consensus.cc:2229] T 43879c03538f4696af48118f1ff9ba5d P 281ac2be36c944359aabd1985199ca2e [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:50:01.741426 6542 raft_consensus.cc:2258] T 43879c03538f4696af48118f1ff9ba5d P 281ac2be36c944359aabd1985199ca2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:50:01.742017 6542 ts_tablet_manager.cc:1905] T 43879c03538f4696af48118f1ff9ba5d P 281ac2be36c944359aabd1985199ca2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:50:01.743892 6542 ts_tablet_manager.cc:1918] T 43879c03538f4696af48118f1ff9ba5d P 281ac2be36c944359aabd1985199ca2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:50:01.744000 6542 log.cc:1196] T 43879c03538f4696af48118f1ff9ba5d P 281ac2be36c944359aabd1985199ca2e: Deleting WAL directory at /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-1/wal/wals/43879c03538f4696af48118f1ff9ba5d
I20260805 22:50:01.744302 6542 ts_tablet_manager.cc:1939] T 43879c03538f4696af48118f1ff9ba5d P 281ac2be36c944359aabd1985199ca2e: Deleting consensus metadata
I20260805 22:50:01.744796 5753 catalog_manager.cc:4841] TS 281ac2be36c944359aabd1985199ca2e (127.14.224.130:38039): tablet 43879c03538f4696af48118f1ff9ba5d (table test-table [id=e3b86c9ece5a4c4c9fa26138a2bb866d]) successfully deleted
W20260805 22:50:01.744825 5755 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.224.129:33539 (error 108)
I20260805 22:50:01.744925 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 6074
I20260805 22:50:01.747735 6496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:01.745308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.129:33539 (local address 127.0.0.1:47728)
0805 22:50:01.747619 (+ 2311us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:01.747689 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.129:33539: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2281}
W20260805 22:50:01.749127 5755 catalog_manager.cc:4584] TS 48daec8901ad4021b9fbb975adef74b2 (127.14.224.129:33539): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 43879c03538f4696af48118f1ff9ba5d: Network error: Client connection negotiation failed: client connection to 127.14.224.129:33539: connect: Connection refused (error 111)
I20260805 22:50:01.758177 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 6276
I20260805 22:50:01.773890 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 5728
I20260805 22:50:21.784271 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:40037
--webserver_interface=127.14.224.190
--webserver_port=45089
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:39697
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.224.190:40037
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:50:21.870203 6545 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:50:21.870434 6545 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:50:21.870460 6545 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:50:21.871675 6545 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260805 22:50:21.871716 6545 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260805 22:50:21.871727 6545 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260805 22:50:21.871738 6545 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:50:21.871750 6545 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:50:21.871765 6545 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:50:21.871779 6545 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:50:21.871794 6545 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:50:21.873358 6545 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:39697
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.14.224.190:40037
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:40037
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.224.190
--webserver_port=45089
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6545
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:50:21.873576 6545 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:50:21.873776 6545 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260805 22:50:21.883651 6545 server_base.cc:1034] running on GCE node
W20260805 22:50:21.883766 6558 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:50:21.883747 6560 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:50:21.883747 6557 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:50:21.884227 6545 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:50:21.884578 6545 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:50:21.885740 6545 hybrid_clock.cc:648] HybridClock initialized: now 1785970221885718 us; error 33 us; skew 500 ppm
Aug 05 22:50:21 dist-test-slave-gjrz krb5kdc[5712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970221, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:50:21.891649 6545 init.cc:377] Logged in from keytab as kudu/127.14.224.190@KRBTEST.COM (short username kudu)
I20260805 22:50:21.892136 6545 webserver.cc:460] Webserver started at http://127.14.224.190:45089/ using document root <none> and password file <none>
I20260805 22:50:21.892342 6545 fs_manager.cc:359] Metadata directory not provided
I20260805 22:50:21.892397 6545 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:50:21.893741 6545 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:50:21.894466 6567 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:50:21.894637 6545 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260805 22:50:21.894735 6545 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/master-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/master-0/wal
uuid: "be4af01bcd0b47378618c4f308318216"
format_stamp: "Formatted at 2026-08-05 22:50:00 on dist-test-slave-gjrz"
server_key: "61e9a70d01fb2b4ea7569418895b8e9d"
server_key_iv: "73211f41bce997d23940c1e4997f4fcd"
server_key_version: "encryptionkey@0"
I20260805 22:50:21.895182 6545 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:50:21.913764 6545 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:50:21.916007 6545 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:50:21.916153 6545 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:50:21.920246 6545 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.190:40037
I20260805 22:50:21.920288 6653 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.190:40037 every 8 connection(s)
I20260805 22:50:21.920720 6545 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
I20260805 22:50:21.922281 6657 sys_catalog.cc:263] Verifying existing consensus state
I20260805 22:50:21.922973 6657 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216: Bootstrap starting.
I20260805 22:50:21.932999 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 6545
I20260805 22:50:21.933290 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.129:33539
--local_ip_for_outbound_sockets=127.14.224.129
--tserver_master_addrs=127.14.224.190:40037
--webserver_port=45171
--webserver_interface=127.14.224.129
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab
--principal=kudu/127.14.224.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:39697
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 22:50:21.934286 6657 log.cc:824] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216: Log is configured to *not* fsync() on all Append() calls
I20260805 22:50:21.937269 6657 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260805 22:50:21.937563 6657 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216: Bootstrap complete.
I20260805 22:50:21.939875 6657 raft_consensus.cc:348] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be4af01bcd0b47378618c4f308318216" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 40037 } }
I20260805 22:50:21.940129 6657 raft_consensus.cc:729] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: be4af01bcd0b47378618c4f308318216, State: Initialized, Role: FOLLOWER
I20260805 22:50:21.940281 6657 consensus_queue.cc:260] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be4af01bcd0b47378618c4f308318216" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 40037 } }
I20260805 22:50:21.940343 6657 raft_consensus.cc:388] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:50:21.940388 6657 raft_consensus.cc:482] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:50:21.940435 6657 raft_consensus.cc:3037] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216 [term 1 FOLLOWER]: Advancing to term 2
I20260805 22:50:21.941479 6657 raft_consensus.cc:504] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be4af01bcd0b47378618c4f308318216" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 40037 } }
I20260805 22:50:21.941579 6657 leader_election.cc:302] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: be4af01bcd0b47378618c4f308318216; no voters:
I20260805 22:50:21.941751 6657 leader_election.cc:288] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260805 22:50:21.941804 6662 raft_consensus.cc:2781] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216 [term 2 FOLLOWER]: Leader election won for term 2
I20260805 22:50:21.941941 6662 raft_consensus.cc:686] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216 [term 2 LEADER]: Becoming Leader. State: Replica: be4af01bcd0b47378618c4f308318216, State: Running, Role: LEADER
I20260805 22:50:21.942054 6657 sys_catalog.cc:564] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:50:21.942101 6662 consensus_queue.cc:237] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be4af01bcd0b47378618c4f308318216" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 40037 } }
I20260805 22:50:21.942505 6662 sys_catalog.cc:455] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216 [sys.catalog]: SysCatalogTable state changed. Reason: New leader be4af01bcd0b47378618c4f308318216. Latest consensus state: current_term: 2 leader_uuid: "be4af01bcd0b47378618c4f308318216" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be4af01bcd0b47378618c4f308318216" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 40037 } } }
I20260805 22:50:21.942706 6662 sys_catalog.cc:458] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216 [sys.catalog]: This master's current role is: LEADER
I20260805 22:50:21.942781 6664 sys_catalog.cc:455] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "be4af01bcd0b47378618c4f308318216" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be4af01bcd0b47378618c4f308318216" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 40037 } } }
I20260805 22:50:21.942881 6664 sys_catalog.cc:458] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216 [sys.catalog]: This master's current role is: LEADER
I20260805 22:50:21.943192 6675 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:50:21.944093 6675 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:50:21.944223 6675 catalog_manager.cc:1259] Loaded cluster ID: 481573c600f04be69bf064863ce850e4
I20260805 22:50:21.944450 6675 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:50:21.945254 6675 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:50:21.945426 6675 catalog_manager.cc:5879] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216: Loaded TSK: 0
I20260805 22:50:21.951743 6675 catalog_manager.cc:5868] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216: Generated new TSK 1
I20260805 22:50:21.951834 6675 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260805 22:50:22.033003 6661 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:50:22.033233 6661 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:50:22.033259 6661 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:50:22.034459 6661 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:50:22.034504 6661 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:50:22.034531 6661 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.129
I20260805 22:50:22.036062 6661 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:39697
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab
--principal=kudu/127.14.224.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.129:33539
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.224.129
--webserver_port=45171
--tserver_master_addrs=127.14.224.190:40037
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6661
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.129
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:50:22.036289 6661 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:50:22.036525 6661 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:50:22.042593 6699 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:50:22.042716 6701 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:50:22.042614 6661 server_base.cc:1034] running on GCE node
W20260805 22:50:22.042595 6697 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:50:22.043035 6661 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:50:22.043319 6661 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:50:22.044483 6661 hybrid_clock.cc:648] HybridClock initialized: now 1785970222044469 us; error 33 us; skew 500 ppm
Aug 05 22:50:22 dist-test-slave-gjrz krb5kdc[5712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970222, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:50:22.047019 6661 init.cc:377] Logged in from keytab as kudu/127.14.224.129@KRBTEST.COM (short username kudu)
I20260805 22:50:22.047511 6661 webserver.cc:460] Webserver started at http://127.14.224.129:45171/ using document root <none> and password file <none>
I20260805 22:50:22.047714 6661 fs_manager.cc:359] Metadata directory not provided
I20260805 22:50:22.047781 6661 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:50:22.049261 6661 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:50:22.049981 6715 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:50:22.050148 6661 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:50:22.050246 6661 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-0/wal
uuid: "48daec8901ad4021b9fbb975adef74b2"
format_stamp: "Formatted at 2026-08-05 22:50:00 on dist-test-slave-gjrz"
server_key: "59520f1cd6920eb22c906e79980d66e4"
server_key_iv: "f34ae71d5e745e09cb873950c39bd533"
server_key_version: "encryptionkey@0"
I20260805 22:50:22.050590 6661 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:50:22.071228 6661 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:50:22.073446 6661 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:50:22.073601 6661 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:50:22.073832 6661 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:50:22.074311 6724 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260805 22:50:22.075989 6661 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260805 22:50:22.076046 6661 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260805 22:50:22.076072 6661 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260805 22:50:22.076730 6661 ts_tablet_manager.cc:610] Registered 1 tablets
I20260805 22:50:22.076776 6661 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260805 22:50:22.076844 6724 tablet_bootstrap.cc:492] T 43879c03538f4696af48118f1ff9ba5d P 48daec8901ad4021b9fbb975adef74b2: Bootstrap starting.
I20260805 22:50:22.084782 6661 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.129:33539
I20260805 22:50:22.085346 6661 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
I20260805 22:50:22.087489 6875 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.129:33539 every 8 connection(s)
I20260805 22:50:22.087978 6724 log.cc:824] T 43879c03538f4696af48118f1ff9ba5d P 48daec8901ad4021b9fbb975adef74b2: Log is configured to *not* fsync() on all Append() calls
I20260805 22:50:22.090134 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 6661
I20260805 22:50:22.090410 6724 tablet_bootstrap.cc:492] T 43879c03538f4696af48118f1ff9ba5d P 48daec8901ad4021b9fbb975adef74b2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260805 22:50:22.090433 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.130:38039
--local_ip_for_outbound_sockets=127.14.224.130
--tserver_master_addrs=127.14.224.190:40037
--webserver_port=35895
--webserver_interface=127.14.224.130
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab
--principal=kudu/127.14.224.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:39697
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 22:50:22.090715 6724 tablet_bootstrap.cc:492] T 43879c03538f4696af48118f1ff9ba5d P 48daec8901ad4021b9fbb975adef74b2: Bootstrap complete.
I20260805 22:50:22.091784 6724 ts_tablet_manager.cc:1397] T 43879c03538f4696af48118f1ff9ba5d P 48daec8901ad4021b9fbb975adef74b2: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.013s
I20260805 22:50:22.093144 6724 raft_consensus.cc:348] T 43879c03538f4696af48118f1ff9ba5d P 48daec8901ad4021b9fbb975adef74b2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "281ac2be36c944359aabd1985199ca2e" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 38039 } } peers { permanent_uuid: "50ecf08c1e7f4f258cf8785ffa073600" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 45969 } } peers { permanent_uuid: "48daec8901ad4021b9fbb975adef74b2" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 33539 } }
I20260805 22:50:22.093474 6724 raft_consensus.cc:729] T 43879c03538f4696af48118f1ff9ba5d P 48daec8901ad4021b9fbb975adef74b2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48daec8901ad4021b9fbb975adef74b2, State: Initialized, Role: FOLLOWER
I20260805 22:50:22.093617 6724 consensus_queue.cc:260] T 43879c03538f4696af48118f1ff9ba5d P 48daec8901ad4021b9fbb975adef74b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "281ac2be36c944359aabd1985199ca2e" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 38039 } } peers { permanent_uuid: "50ecf08c1e7f4f258cf8785ffa073600" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 45969 } } peers { permanent_uuid: "48daec8901ad4021b9fbb975adef74b2" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 33539 } }
Aug 05 22:50:22 dist-test-slave-gjrz krb5kdc[5712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970222, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.129@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:50:22.093892 6724 ts_tablet_manager.cc:1428] T 43879c03538f4696af48118f1ff9ba5d P 48daec8901ad4021b9fbb975adef74b2: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260805 22:50:22.099123 6881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:22.086276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.129:46053 (local address 127.14.224.190:40037)
0805 22:50:22.086456 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0805 22:50:22.086475 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0805 22:50:22.087962 (+ 1487us) server_negotiation.cc:407] Connection header received
0805 22:50:22.088631 (+ 669us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:50:22.088637 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:50:22.088680 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:50:22.088783 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:50:22.089603 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:50:22.090805 (+ 1202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:50:22.092361 (+ 1556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:50:22.092941 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:50:22.093023 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:50:22.095663 (+ 2640us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:50:22.095668 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:50:22.095669 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:50:22.095682 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:50:22.097256 (+ 1574us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:50:22.097798 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:50:22.097801 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:50:22.097801 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:50:22.097898 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:50:22.098180 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:50:22.098181 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:50:22.098181 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:50:22.098400 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:50:22.098458 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0805 22:50:22.098846 (+ 388us) server_negotiation.cc:299] Negotiation successful
0805 22:50:22.098961 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":77,"threads_started":1}
I20260805 22:50:22.099164 6878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:22.086203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:40037 (local address 127.14.224.129:46053)
0805 22:50:22.087772 (+ 1569us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:22.087817 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0805 22:50:22.088404 (+ 587us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:50:22.088845 (+ 441us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:50:22.088850 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:50:22.089221 (+ 371us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:50:22.089473 (+ 252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:50:22.089480 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:50:22.090950 (+ 1470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:50:22.090951 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:50:22.092254 (+ 1303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:50:22.092257 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:50:22.093161 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:50:22.093162 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:50:22.093294 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:50:22.093871 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:50:22.093880 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:50:22.095553 (+ 1673us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:50:22.097346 (+ 1793us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:50:22.097356 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:50:22.097358 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:50:22.097717 (+ 359us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:50:22.097959 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:50:22.097960 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:50:22.097960 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:50:22.098118 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:50:22.098461 (+ 343us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:50:22.098468 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:50:22.098635 (+ 167us) client_negotiation.cc:769] Sending connection context
0805 22:50:22.098747 (+ 112us) client_negotiation.cc:240] Negotiation successful
0805 22:50:22.098933 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1520,"thread_start_us":111,"threads_started":1}
I20260805 22:50:22.099871 6876 heartbeater.cc:347] Connected to a master server at 127.14.224.190:40037
I20260805 22:50:22.099965 6876 heartbeater.cc:464] Registering TS with master...
I20260805 22:50:22.100137 6876 heartbeater.cc:511] Master 127.14.224.190:40037 requested a full tablet report, sending...
I20260805 22:50:22.100788 6596 ts_manager.cc:194] Registered new tserver with Master: 48daec8901ad4021b9fbb975adef74b2 (127.14.224.129:33539)
I20260805 22:50:22.101758 6596 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.224.129@KRBTEST.COM'} at 127.14.224.129:46053
I20260805 22:50:22.102623 6876 heartbeater.cc:503] Master 127.14.224.190:40037 was elected leader, sending a full tablet report...
I20260805 22:50:22.108891 6890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:22.101418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50086 (local address 127.14.224.129:33539)
0805 22:50:22.105993 (+ 4575us) server_negotiation.cc:206] Beginning negotiation
0805 22:50:22.105998 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:50:22.106009 (+ 11us) server_negotiation.cc:407] Connection header received
0805 22:50:22.106042 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:50:22.106044 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:50:22.106057 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:50:22.106144 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:50:22.106334 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:50:22.106998 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:50:22.108027 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:50:22.108498 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:50:22.108566 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:50:22.108625 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0805 22:50:22.108767 (+ 142us) server_negotiation.cc:299] Negotiation successful
0805 22:50:22.108809 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4538,"thread_start_us":94,"threads_started":1}
I20260805 22:50:22.108891 6887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:22.101337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.129:33539 (local address 127.0.0.1:50086)
0805 22:50:22.102066 (+ 729us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:22.102102 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0805 22:50:22.102156 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:50:22.106185 (+ 4029us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:50:22.106190 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:50:22.106193 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:50:22.106268 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:50:22.106270 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:50:22.107088 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:50:22.107089 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:50:22.107939 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:50:22.107942 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:50:22.108578 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:50:22.108579 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:50:22.108673 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:50:22.108684 (+ 11us) client_negotiation.cc:769] Sending connection context
0805 22:50:22.108744 (+ 60us) client_negotiation.cc:240] Negotiation successful
0805 22:50:22.108810 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":700,"thread_start_us":94,"threads_started":1}
I20260805 22:50:22.109402 6771 tablet_service.cc:1514] Processing DeleteTablet for tablet 43879c03538f4696af48118f1ff9ba5d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:50:01 UTC) from {username='kudu', principal='kudu/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:50086
I20260805 22:50:22.109922 6893 tablet_replica.cc:330] stopping tablet replica
I20260805 22:50:22.110046 6893 raft_consensus.cc:2229] T 43879c03538f4696af48118f1ff9ba5d P 48daec8901ad4021b9fbb975adef74b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:50:22.110124 6893 raft_consensus.cc:2258] T 43879c03538f4696af48118f1ff9ba5d P 48daec8901ad4021b9fbb975adef74b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:50:22.110453 6893 ts_tablet_manager.cc:1905] T 43879c03538f4696af48118f1ff9ba5d P 48daec8901ad4021b9fbb975adef74b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:50:22.113045 6893 ts_tablet_manager.cc:1918] T 43879c03538f4696af48118f1ff9ba5d P 48daec8901ad4021b9fbb975adef74b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:50:22.113152 6893 log.cc:1196] T 43879c03538f4696af48118f1ff9ba5d P 48daec8901ad4021b9fbb975adef74b2: Deleting WAL directory at /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-0/wal/wals/43879c03538f4696af48118f1ff9ba5d
I20260805 22:50:22.113365 6893 ts_tablet_manager.cc:1939] T 43879c03538f4696af48118f1ff9ba5d P 48daec8901ad4021b9fbb975adef74b2: Deleting consensus metadata
I20260805 22:50:22.113910 6573 catalog_manager.cc:4841] TS 48daec8901ad4021b9fbb975adef74b2 (127.14.224.129:33539): tablet 43879c03538f4696af48118f1ff9ba5d (table test-table [id=e3b86c9ece5a4c4c9fa26138a2bb866d]) successfully deleted
W20260805 22:50:22.178309 6885 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:50:22.178540 6885 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:50:22.178566 6885 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:50:22.179785 6885 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:50:22.179831 6885 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:50:22.179858 6885 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.130
I20260805 22:50:22.181427 6885 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:39697
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab
--principal=kudu/127.14.224.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.130:38039
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.224.130
--webserver_port=35895
--tserver_master_addrs=127.14.224.190:40037
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6885
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.130
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:50:22.181654 6885 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:50:22.181857 6885 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:50:22.187096 6902 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:50:22.187134 6899 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:50:22.187072 6900 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:50:22.187078 6885 server_base.cc:1034] running on GCE node
I20260805 22:50:22.187597 6885 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:50:22.187848 6885 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:50:22.189020 6885 hybrid_clock.cc:648] HybridClock initialized: now 1785970222189004 us; error 33 us; skew 500 ppm
Aug 05 22:50:22 dist-test-slave-gjrz krb5kdc[5712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970222, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:50:22.192118 6885 init.cc:377] Logged in from keytab as kudu/127.14.224.130@KRBTEST.COM (short username kudu)
I20260805 22:50:22.192593 6885 webserver.cc:460] Webserver started at http://127.14.224.130:35895/ using document root <none> and password file <none>
I20260805 22:50:22.192824 6885 fs_manager.cc:359] Metadata directory not provided
I20260805 22:50:22.192883 6885 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:50:22.194258 6885 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:50:22.194820 6911 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:50:22.194993 6885 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260805 22:50:22.195076 6885 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-1/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-1/wal
uuid: "281ac2be36c944359aabd1985199ca2e"
format_stamp: "Formatted at 2026-08-05 22:50:01 on dist-test-slave-gjrz"
server_key: "db6ac0c4e073e2d722ab6b80aa2f4f39"
server_key_iv: "41bcd99c79d1cd9ef53eaaf2a1117e93"
server_key_version: "encryptionkey@0"
I20260805 22:50:22.195461 6885 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:50:22.209553 6885 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:50:22.211647 6885 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:50:22.211784 6885 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:50:22.212028 6885 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:50:22.212335 6885 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:50:22.212368 6885 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:50:22.212392 6885 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:50:22.212416 6885 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:50:22.218065 6885 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.130:38039
I20260805 22:50:22.218118 7081 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.130:38039 every 8 connection(s)
I20260805 22:50:22.218464 6885 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
Aug 05 22:50:22 dist-test-slave-gjrz krb5kdc[5712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970222, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.130@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:50:22.227807 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 6885
I20260805 22:50:22.228044 6881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:22.219248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:36001 (local address 127.14.224.190:40037)
0805 22:50:22.219334 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0805 22:50:22.219337 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:50:22.219560 (+ 223us) server_negotiation.cc:407] Connection header received
0805 22:50:22.220031 (+ 471us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:50:22.220032 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:50:22.220041 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:50:22.220095 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:50:22.221008 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:50:22.221516 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:50:22.222574 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:50:22.222793 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:50:22.222861 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:50:22.225217 (+ 2356us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:50:22.225219 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:50:22.225220 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:50:22.225228 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:50:22.226541 (+ 1313us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:50:22.226964 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:50:22.226964 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:50:22.226964 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:50:22.227011 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:50:22.227320 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:50:22.227321 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:50:22.227321 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:50:22.227432 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:50:22.227484 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0805 22:50:22.227843 (+ 359us) server_negotiation.cc:299] Negotiation successful
0805 22:50:22.227948 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260805 22:50:22.228088 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.131:45969
--local_ip_for_outbound_sockets=127.14.224.131
--tserver_master_addrs=127.14.224.190:40037
--webserver_port=45873
--webserver_interface=127.14.224.131
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab
--principal=kudu/127.14.224.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:39697
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 22:50:22.228228 7087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:22.219224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:40037 (local address 127.14.224.130:36001)
0805 22:50:22.219435 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:22.219479 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0805 22:50:22.219953 (+ 474us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:50:22.220154 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:50:22.220157 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:50:22.220723 (+ 566us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:50:22.220920 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:50:22.220926 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:50:22.221607 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:50:22.221608 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:50:22.222454 (+ 846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:50:22.222457 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:50:22.222907 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:50:22.222908 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:50:22.223045 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:50:22.223599 (+ 554us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:50:22.223608 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:50:22.225110 (+ 1502us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:50:22.226645 (+ 1535us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:50:22.226654 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:50:22.226656 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:50:22.226900 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:50:22.227092 (+ 192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:50:22.227093 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:50:22.227093 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:50:22.227220 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:50:22.227509 (+ 289us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:50:22.227515 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:50:22.227653 (+ 138us) client_negotiation.cc:769] Sending connection context
0805 22:50:22.227763 (+ 110us) client_negotiation.cc:240] Negotiation successful
0805 22:50:22.227989 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":108,"threads_started":1}
I20260805 22:50:22.228729 7085 heartbeater.cc:347] Connected to a master server at 127.14.224.190:40037
I20260805 22:50:22.228828 7085 heartbeater.cc:464] Registering TS with master...
I20260805 22:50:22.229029 7085 heartbeater.cc:511] Master 127.14.224.190:40037 requested a full tablet report, sending...
I20260805 22:50:22.229396 6596 ts_manager.cc:194] Registered new tserver with Master: 281ac2be36c944359aabd1985199ca2e (127.14.224.130:38039)
I20260805 22:50:22.229784 6596 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.224.130@KRBTEST.COM'} at 127.14.224.130:36001
W20260805 22:50:22.312146 7088 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:50:22.312381 7088 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:50:22.312404 7088 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:50:22.313544 7088 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:50:22.313582 7088 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:50:22.313607 7088 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.131
I20260805 22:50:22.315092 7088 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:39697
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab
--principal=kudu/127.14.224.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.131:45969
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.224.131
--webserver_port=45873
--tserver_master_addrs=127.14.224.190:40037
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7088
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.131
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:50:22.315343 7088 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:50:22.315554 7088 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:50:22.320827 7099 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:50:22.320827 7103 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:50:22.320847 7088 server_base.cc:1034] running on GCE node
W20260805 22:50:22.320834 7101 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:50:22.321285 7088 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:50:22.321580 7088 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:50:22.322770 7088 hybrid_clock.cc:648] HybridClock initialized: now 1785970222322723 us; error 64 us; skew 500 ppm
Aug 05 22:50:22 dist-test-slave-gjrz krb5kdc[5712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970222, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:50:22.325650 7088 init.cc:377] Logged in from keytab as kudu/127.14.224.131@KRBTEST.COM (short username kudu)
I20260805 22:50:22.326148 7088 webserver.cc:460] Webserver started at http://127.14.224.131:45873/ using document root <none> and password file <none>
I20260805 22:50:22.326345 7088 fs_manager.cc:359] Metadata directory not provided
I20260805 22:50:22.326400 7088 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:50:22.327836 7088 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:50:22.328529 7112 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:50:22.328764 7088 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:50:22.328848 7088 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-2/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-2/wal
uuid: "50ecf08c1e7f4f258cf8785ffa073600"
format_stamp: "Formatted at 2026-08-05 22:50:01 on dist-test-slave-gjrz"
server_key: "f75948b64259e48ffc5c8540a371353c"
server_key_iv: "31ce7872f88542692ef43ed93ac795a9"
server_key_version: "encryptionkey@0"
I20260805 22:50:22.329252 7088 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:50:22.349931 7088 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:50:22.352210 7088 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:50:22.352346 7088 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:50:22.352602 7088 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:50:22.352931 7088 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:50:22.352967 7088 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:50:22.352988 7088 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:50:22.352999 7088 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:50:22.358580 7088 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.131:45969
I20260805 22:50:22.358640 7264 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.131:45969 every 8 connection(s)
I20260805 22:50:22.358978 7088 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
I20260805 22:50:22.364503 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 7088
Aug 05 22:50:22 dist-test-slave-gjrz krb5kdc[5712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970222, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.131@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:50:22.368369 6881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:22.359688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:56007 (local address 127.14.224.190:40037)
0805 22:50:22.359738 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0805 22:50:22.359740 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:50:22.359955 (+ 215us) server_negotiation.cc:407] Connection header received
0805 22:50:22.360466 (+ 511us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:50:22.360467 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:50:22.360482 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:50:22.360528 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:50:22.361504 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:50:22.362011 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:50:22.362994 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:50:22.363184 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:50:22.363240 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:50:22.365562 (+ 2322us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:50:22.365564 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:50:22.365564 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:50:22.365572 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:50:22.366945 (+ 1373us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:50:22.367364 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:50:22.367366 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:50:22.367366 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:50:22.367467 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:50:22.367738 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:50:22.367739 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:50:22.367739 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:50:22.367846 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:50:22.367899 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0805 22:50:22.368229 (+ 330us) server_negotiation.cc:299] Negotiation successful
0805 22:50:22.368299 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260805 22:50:22.368619 7267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:22.359659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:40037 (local address 127.14.224.131:56007)
0805 22:50:22.359830 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:22.359865 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0805 22:50:22.360363 (+ 498us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:50:22.360614 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:50:22.360618 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:50:22.361197 (+ 579us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:50:22.361395 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:50:22.361401 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:50:22.362100 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:50:22.362101 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:50:22.362898 (+ 797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:50:22.362901 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:50:22.363256 (+ 355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:50:22.363256 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:50:22.363408 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:50:22.363913 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:50:22.363921 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:50:22.365461 (+ 1540us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:50:22.367021 (+ 1560us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:50:22.367036 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:50:22.367039 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:50:22.367294 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:50:22.367539 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:50:22.367540 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:50:22.367541 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:50:22.367666 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:50:22.367916 (+ 250us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:50:22.367924 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:50:22.368073 (+ 149us) client_negotiation.cc:769] Sending connection context
0805 22:50:22.368193 (+ 120us) client_negotiation.cc:240] Negotiation successful
0805 22:50:22.368373 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":87,"threads_started":1}
I20260805 22:50:22.369163 7265 heartbeater.cc:347] Connected to a master server at 127.14.224.190:40037
I20260805 22:50:22.369266 7265 heartbeater.cc:464] Registering TS with master...
I20260805 22:50:22.369450 7265 heartbeater.cc:511] Master 127.14.224.190:40037 requested a full tablet report, sending...
I20260805 22:50:22.369863 6596 ts_manager.cc:194] Registered new tserver with Master: 50ecf08c1e7f4f258cf8785ffa073600 (127.14.224.131:45969)
I20260805 22:50:22.370226 6596 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.224.131@KRBTEST.COM'} at 127.14.224.131:56007
I20260805 22:50:22.371536 7274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:22.364922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42462 (local address 127.14.224.190:40037)
0805 22:50:22.365083 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0805 22:50:22.365085 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:50:22.365095 (+ 10us) server_negotiation.cc:407] Connection header received
0805 22:50:22.365199 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:50:22.365200 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:50:22.365212 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:50:22.365267 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:50:22.365864 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:50:22.366591 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:50:22.367426 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:50:22.367619 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:50:22.367667 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:50:22.369012 (+ 1345us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:50:22.369014 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:50:22.369014 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:50:22.369023 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:50:22.370467 (+ 1444us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:50:22.370866 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:50:22.370866 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:50:22.370867 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:50:22.370918 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:50:22.371110 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:50:22.371111 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:50:22.371111 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:50:22.371202 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:50:22.371359 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0805 22:50:22.371392 (+ 33us) server_negotiation.cc:299] Negotiation successful
0805 22:50:22.371471 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":111,"threads_started":1}
I20260805 22:50:22.372207 15234 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 22:50:22.374769 7274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:22.372528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42468 (local address 127.14.224.190:40037)
0805 22:50:22.372563 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0805 22:50:22.372565 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:50:22.372679 (+ 114us) server_negotiation.cc:407] Connection header received
0805 22:50:22.372745 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:50:22.372746 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:50:22.372775 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:50:22.372831 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:50:22.372944 (+ 113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:50:22.373405 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:50:22.374103 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:50:22.374291 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:50:22.374346 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:50:22.374498 (+ 152us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:50:22.374542 (+ 44us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0805 22:50:22.374706 (+ 164us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:42468: token expired
Metrics: {"server-negotiator.queue_time_us":15}
W20260805 22:50:22.374833 7274 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:42468: token expired
W20260805 22:50:22.375116 6485 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.14.224.190:40037)
I20260805 22:50:22.380877 7274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:22.375393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42470 (local address 127.14.224.190:40037)
0805 22:50:22.375445 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0805 22:50:22.375447 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:50:22.375455 (+ 8us) server_negotiation.cc:407] Connection header received
0805 22:50:22.375513 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:50:22.375514 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:50:22.375523 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:50:22.375569 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:50:22.376038 (+ 469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:50:22.376488 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:50:22.377142 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:50:22.377322 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:50:22.377374 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:50:22.378538 (+ 1164us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:50:22.378539 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:50:22.378539 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:50:22.378547 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:50:22.379812 (+ 1265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:50:22.380139 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:50:22.380140 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:50:22.380140 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:50:22.380191 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:50:22.380353 (+ 162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:50:22.380353 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:50:22.380354 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:50:22.380505 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:50:22.380597 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0805 22:50:22.380697 (+ 100us) server_negotiation.cc:299] Negotiation successful
0805 22:50:22.380776 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260805 22:50:22.382205 6596 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42470:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:50:22.383847 6596 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:50:22.386229 6771 tablet_service.cc:1467] Processing CreateTablet for tablet eb7de5f973fd404f8242d6230ad3cba1 (DEFAULT_TABLE table=test-table [id=5d455a1d3d8d40878a02a30817ec187a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:50:22.386485 6771 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb7de5f973fd404f8242d6230ad3cba1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:50:22.388043 6724 tablet_bootstrap.cc:492] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2: Bootstrap starting.
I20260805 22:50:22.388338 6724 tablet_bootstrap.cc:654] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2: Neither blocks nor log segments found. Creating new log.
I20260805 22:50:22.389442 6887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:22.385644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.130:38039 (local address 127.0.0.1:40260)
0805 22:50:22.385681 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:22.385693 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:50:22.385727 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:50:22.386258 (+ 531us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:50:22.386260 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:50:22.386261 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:50:22.386305 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:50:22.386306 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:50:22.387301 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:50:22.387302 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:50:22.388362 (+ 1060us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:50:22.388365 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:50:22.389213 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:50:22.389214 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:50:22.389277 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:50:22.389282 (+ 5us) client_negotiation.cc:769] Sending connection context
0805 22:50:22.389325 (+ 43us) client_negotiation.cc:240] Negotiation successful
0805 22:50:22.389372 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18}
I20260805 22:50:22.389657 6724 tablet_bootstrap.cc:492] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2: No bootstrap required, opened a new log
I20260805 22:50:22.389699 7278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:22.385936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40260 (local address 127.14.224.130:38039)
0805 22:50:22.386105 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0805 22:50:22.386108 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:50:22.386117 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:50:22.386150 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:50:22.386152 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:50:22.386163 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:50:22.386375 (+ 212us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:50:22.386464 (+ 89us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:50:22.387192 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:50:22.388459 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:50:22.389116 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:50:22.389191 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:50:22.389252 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0805 22:50:22.389574 (+ 322us) server_negotiation.cc:299] Negotiation successful
0805 22:50:22.389621 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":92,"threads_started":1}
I20260805 22:50:22.389707 6724 ts_tablet_manager.cc:1397] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.000s
I20260805 22:50:22.389812 6724 raft_consensus.cc:348] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "281ac2be36c944359aabd1985199ca2e" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 38039 } } peers { permanent_uuid: "50ecf08c1e7f4f258cf8785ffa073600" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 45969 } } peers { permanent_uuid: "48daec8901ad4021b9fbb975adef74b2" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 33539 } }
I20260805 22:50:22.389866 6724 raft_consensus.cc:374] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:50:22.389895 6724 raft_consensus.cc:729] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48daec8901ad4021b9fbb975adef74b2, State: Initialized, Role: FOLLOWER
I20260805 22:50:22.389918 7276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:22.385746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.131:45969 (local address 127.0.0.1:59190)
0805 22:50:22.385895 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:22.385903 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0805 22:50:22.385939 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:50:22.386249 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:50:22.386250 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:50:22.386252 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:50:22.386325 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:50:22.386327 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:50:22.387705 (+ 1378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:50:22.387706 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:50:22.388670 (+ 964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:50:22.388672 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:50:22.389683 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:50:22.389684 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:50:22.389746 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:50:22.389750 (+ 4us) client_negotiation.cc:769] Sending connection context
0805 22:50:22.389793 (+ 43us) client_negotiation.cc:240] Negotiation successful
0805 22:50:22.389836 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"mutex_wait_us":18,"thread_start_us":102,"threads_started":1}
I20260805 22:50:22.389935 6724 consensus_queue.cc:260] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "281ac2be36c944359aabd1985199ca2e" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 38039 } } peers { permanent_uuid: "50ecf08c1e7f4f258cf8785ffa073600" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 45969 } } peers { permanent_uuid: "48daec8901ad4021b9fbb975adef74b2" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 33539 } }
I20260805 22:50:22.390060 6724 ts_tablet_manager.cc:1428] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260805 22:50:22.390264 7277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:22.385862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59190 (local address 127.14.224.131:45969)
0805 22:50:22.386074 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0805 22:50:22.386080 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:50:22.386089 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:50:22.386132 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:50:22.386134 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:50:22.386150 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:50:22.386235 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:50:22.386435 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:50:22.387622 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:50:22.388743 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:50:22.389583 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:50:22.390031 (+ 448us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:50:22.390098 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0805 22:50:22.390125 (+ 27us) server_negotiation.cc:299] Negotiation successful
0805 22:50:22.390180 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":123,"threads_started":1}
I20260805 22:50:22.390401 6986 tablet_service.cc:1467] Processing CreateTablet for tablet eb7de5f973fd404f8242d6230ad3cba1 (DEFAULT_TABLE table=test-table [id=5d455a1d3d8d40878a02a30817ec187a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:50:22.390697 6986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb7de5f973fd404f8242d6230ad3cba1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:50:22.391896 7177 tablet_service.cc:1467] Processing CreateTablet for tablet eb7de5f973fd404f8242d6230ad3cba1 (DEFAULT_TABLE table=test-table [id=5d455a1d3d8d40878a02a30817ec187a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:50:22.392187 7177 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb7de5f973fd404f8242d6230ad3cba1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:50:22.393567 7280 tablet_bootstrap.cc:492] T eb7de5f973fd404f8242d6230ad3cba1 P 281ac2be36c944359aabd1985199ca2e: Bootstrap starting.
I20260805 22:50:22.394220 7280 tablet_bootstrap.cc:654] T eb7de5f973fd404f8242d6230ad3cba1 P 281ac2be36c944359aabd1985199ca2e: Neither blocks nor log segments found. Creating new log.
I20260805 22:50:22.394807 7280 log.cc:824] T eb7de5f973fd404f8242d6230ad3cba1 P 281ac2be36c944359aabd1985199ca2e: Log is configured to *not* fsync() on all Append() calls
I20260805 22:50:22.395184 7281 tablet_bootstrap.cc:492] T eb7de5f973fd404f8242d6230ad3cba1 P 50ecf08c1e7f4f258cf8785ffa073600: Bootstrap starting.
I20260805 22:50:22.395797 7281 tablet_bootstrap.cc:654] T eb7de5f973fd404f8242d6230ad3cba1 P 50ecf08c1e7f4f258cf8785ffa073600: Neither blocks nor log segments found. Creating new log.
I20260805 22:50:22.396245 7281 log.cc:824] T eb7de5f973fd404f8242d6230ad3cba1 P 50ecf08c1e7f4f258cf8785ffa073600: Log is configured to *not* fsync() on all Append() calls
I20260805 22:50:22.396910 7281 tablet_bootstrap.cc:492] T eb7de5f973fd404f8242d6230ad3cba1 P 50ecf08c1e7f4f258cf8785ffa073600: No bootstrap required, opened a new log
I20260805 22:50:22.396972 7281 ts_tablet_manager.cc:1397] T eb7de5f973fd404f8242d6230ad3cba1 P 50ecf08c1e7f4f258cf8785ffa073600: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260805 22:50:22.398404 7281 raft_consensus.cc:348] T eb7de5f973fd404f8242d6230ad3cba1 P 50ecf08c1e7f4f258cf8785ffa073600 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "281ac2be36c944359aabd1985199ca2e" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 38039 } } peers { permanent_uuid: "50ecf08c1e7f4f258cf8785ffa073600" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 45969 } } peers { permanent_uuid: "48daec8901ad4021b9fbb975adef74b2" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 33539 } }
I20260805 22:50:22.398586 7281 raft_consensus.cc:374] T eb7de5f973fd404f8242d6230ad3cba1 P 50ecf08c1e7f4f258cf8785ffa073600 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:50:22.398623 7281 raft_consensus.cc:729] T eb7de5f973fd404f8242d6230ad3cba1 P 50ecf08c1e7f4f258cf8785ffa073600 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50ecf08c1e7f4f258cf8785ffa073600, State: Initialized, Role: FOLLOWER
I20260805 22:50:22.398741 7281 consensus_queue.cc:260] T eb7de5f973fd404f8242d6230ad3cba1 P 50ecf08c1e7f4f258cf8785ffa073600 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "281ac2be36c944359aabd1985199ca2e" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 38039 } } peers { permanent_uuid: "50ecf08c1e7f4f258cf8785ffa073600" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 45969 } } peers { permanent_uuid: "48daec8901ad4021b9fbb975adef74b2" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 33539 } }
I20260805 22:50:22.398981 7281 ts_tablet_manager.cc:1428] T eb7de5f973fd404f8242d6230ad3cba1 P 50ecf08c1e7f4f258cf8785ffa073600: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260805 22:50:22.399008 7265 heartbeater.cc:503] Master 127.14.224.190:40037 was elected leader, sending a full tablet report...
I20260805 22:50:22.399418 7280 tablet_bootstrap.cc:492] T eb7de5f973fd404f8242d6230ad3cba1 P 281ac2be36c944359aabd1985199ca2e: No bootstrap required, opened a new log
I20260805 22:50:22.399499 7280 ts_tablet_manager.cc:1397] T eb7de5f973fd404f8242d6230ad3cba1 P 281ac2be36c944359aabd1985199ca2e: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260805 22:50:22.400962 7280 raft_consensus.cc:348] T eb7de5f973fd404f8242d6230ad3cba1 P 281ac2be36c944359aabd1985199ca2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "281ac2be36c944359aabd1985199ca2e" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 38039 } } peers { permanent_uuid: "50ecf08c1e7f4f258cf8785ffa073600" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 45969 } } peers { permanent_uuid: "48daec8901ad4021b9fbb975adef74b2" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 33539 } }
I20260805 22:50:22.401101 7280 raft_consensus.cc:374] T eb7de5f973fd404f8242d6230ad3cba1 P 281ac2be36c944359aabd1985199ca2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:50:22.401122 7280 raft_consensus.cc:729] T eb7de5f973fd404f8242d6230ad3cba1 P 281ac2be36c944359aabd1985199ca2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 281ac2be36c944359aabd1985199ca2e, State: Initialized, Role: FOLLOWER
I20260805 22:50:22.401202 7280 consensus_queue.cc:260] T eb7de5f973fd404f8242d6230ad3cba1 P 281ac2be36c944359aabd1985199ca2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "281ac2be36c944359aabd1985199ca2e" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 38039 } } peers { permanent_uuid: "50ecf08c1e7f4f258cf8785ffa073600" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 45969 } } peers { permanent_uuid: "48daec8901ad4021b9fbb975adef74b2" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 33539 } }
I20260805 22:50:22.401429 7280 ts_tablet_manager.cc:1428] T eb7de5f973fd404f8242d6230ad3cba1 P 281ac2be36c944359aabd1985199ca2e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260805 22:50:22.401472 7085 heartbeater.cc:503] Master 127.14.224.190:40037 was elected leader, sending a full tablet report...
I20260805 22:50:22.444504 6886 raft_consensus.cc:482] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:50:22.444654 6886 raft_consensus.cc:504] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "281ac2be36c944359aabd1985199ca2e" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 38039 } } peers { permanent_uuid: "50ecf08c1e7f4f258cf8785ffa073600" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 45969 } } peers { permanent_uuid: "48daec8901ad4021b9fbb975adef74b2" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 33539 } }
I20260805 22:50:22.445009 6886 leader_election.cc:288] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 281ac2be36c944359aabd1985199ca2e (127.14.224.130:38039), 50ecf08c1e7f4f258cf8785ffa073600 (127.14.224.131:45969)
I20260805 22:50:22.448239 6878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:22.445233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.130:38039 (local address 127.14.224.129:48017)
0805 22:50:22.445290 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:22.445305 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0805 22:50:22.445376 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:50:22.445589 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:50:22.445591 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:50:22.445592 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:50:22.445662 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:50:22.445664 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:50:22.446401 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:50:22.446402 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:50:22.447318 (+ 916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:50:22.447322 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:50:22.447964 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:50:22.447965 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:50:22.448051 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:50:22.448055 (+ 4us) client_negotiation.cc:769] Sending connection context
0805 22:50:22.448103 (+ 48us) client_negotiation.cc:240] Negotiation successful
0805 22:50:22.448156 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260805 22:50:22.448443 7277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:22.445484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.129:34457 (local address 127.14.224.131:45969)
0805 22:50:22.445556 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0805 22:50:22.445558 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:50:22.445657 (+ 99us) server_negotiation.cc:407] Connection header received
0805 22:50:22.445701 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:50:22.445702 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:50:22.445712 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:50:22.445763 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:50:22.445973 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:50:22.446520 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:50:22.447560 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:50:22.447982 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:50:22.448084 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:50:22.448095 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0805 22:50:22.448322 (+ 227us) server_negotiation.cc:299] Negotiation successful
0805 22:50:22.448369 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260805 22:50:22.448494 7278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:22.445321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.129:48017 (local address 127.14.224.130:38039)
0805 22:50:22.445367 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0805 22:50:22.445368 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0805 22:50:22.445379 (+ 11us) server_negotiation.cc:407] Connection header received
0805 22:50:22.445446 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:50:22.445447 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:50:22.445459 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:50:22.445531 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:50:22.445753 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:50:22.446300 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:50:22.447439 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:50:22.447887 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:50:22.447961 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:50:22.447971 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0805 22:50:22.448381 (+ 410us) server_negotiation.cc:299] Negotiation successful
0805 22:50:22.448434 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260805 22:50:22.448685 7288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:22.445337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.131:45969 (local address 127.14.224.129:34457)
0805 22:50:22.445578 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:22.445590 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:50:22.445659 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:50:22.445772 (+ 113us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:50:22.445773 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:50:22.445775 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:50:22.445860 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:50:22.445862 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:50:22.446643 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:50:22.446644 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:50:22.447480 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:50:22.447484 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:50:22.448147 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:50:22.448149 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:50:22.448227 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:50:22.448230 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:50:22.448541 (+ 311us) client_negotiation.cc:240] Negotiation successful
0805 22:50:22.448594 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":188,"threads_started":1}
I20260805 22:50:22.448870 7013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb7de5f973fd404f8242d6230ad3cba1" candidate_uuid: "48daec8901ad4021b9fbb975adef74b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "281ac2be36c944359aabd1985199ca2e" is_pre_election: true
I20260805 22:50:22.448973 7208 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb7de5f973fd404f8242d6230ad3cba1" candidate_uuid: "48daec8901ad4021b9fbb975adef74b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50ecf08c1e7f4f258cf8785ffa073600" is_pre_election: true
I20260805 22:50:22.449064 7013 raft_consensus.cc:2454] T eb7de5f973fd404f8242d6230ad3cba1 P 281ac2be36c944359aabd1985199ca2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48daec8901ad4021b9fbb975adef74b2 in term 0.
I20260805 22:50:22.449127 7208 raft_consensus.cc:2454] T eb7de5f973fd404f8242d6230ad3cba1 P 50ecf08c1e7f4f258cf8785ffa073600 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48daec8901ad4021b9fbb975adef74b2 in term 0.
I20260805 22:50:22.449363 6718 leader_election.cc:302] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48daec8901ad4021b9fbb975adef74b2, 50ecf08c1e7f4f258cf8785ffa073600; no voters:
I20260805 22:50:22.449537 6886 raft_consensus.cc:2781] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:50:22.449606 6886 raft_consensus.cc:482] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:50:22.449622 6886 raft_consensus.cc:3037] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:50:22.450345 6886 raft_consensus.cc:504] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "281ac2be36c944359aabd1985199ca2e" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 38039 } } peers { permanent_uuid: "50ecf08c1e7f4f258cf8785ffa073600" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 45969 } } peers { permanent_uuid: "48daec8901ad4021b9fbb975adef74b2" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 33539 } }
I20260805 22:50:22.450562 6886 leader_election.cc:288] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2 [CANDIDATE]: Term 1 election: Requested vote from peers 281ac2be36c944359aabd1985199ca2e (127.14.224.130:38039), 50ecf08c1e7f4f258cf8785ffa073600 (127.14.224.131:45969)
I20260805 22:50:22.450794 7208 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb7de5f973fd404f8242d6230ad3cba1" candidate_uuid: "48daec8901ad4021b9fbb975adef74b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50ecf08c1e7f4f258cf8785ffa073600"
I20260805 22:50:22.450830 7013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb7de5f973fd404f8242d6230ad3cba1" candidate_uuid: "48daec8901ad4021b9fbb975adef74b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "281ac2be36c944359aabd1985199ca2e"
I20260805 22:50:22.450879 7208 raft_consensus.cc:3037] T eb7de5f973fd404f8242d6230ad3cba1 P 50ecf08c1e7f4f258cf8785ffa073600 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:50:22.450909 7013 raft_consensus.cc:3037] T eb7de5f973fd404f8242d6230ad3cba1 P 281ac2be36c944359aabd1985199ca2e [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:50:22.451710 7208 raft_consensus.cc:2454] T eb7de5f973fd404f8242d6230ad3cba1 P 50ecf08c1e7f4f258cf8785ffa073600 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48daec8901ad4021b9fbb975adef74b2 in term 1.
I20260805 22:50:22.451727 7013 raft_consensus.cc:2454] T eb7de5f973fd404f8242d6230ad3cba1 P 281ac2be36c944359aabd1985199ca2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48daec8901ad4021b9fbb975adef74b2 in term 1.
I20260805 22:50:22.451912 6718 leader_election.cc:302] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48daec8901ad4021b9fbb975adef74b2, 50ecf08c1e7f4f258cf8785ffa073600; no voters:
I20260805 22:50:22.452116 6886 raft_consensus.cc:2781] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:50:22.452289 6886 raft_consensus.cc:686] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2 [term 1 LEADER]: Becoming Leader. State: Replica: 48daec8901ad4021b9fbb975adef74b2, State: Running, Role: LEADER
I20260805 22:50:22.452359 6886 consensus_queue.cc:237] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "281ac2be36c944359aabd1985199ca2e" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 38039 } } peers { permanent_uuid: "50ecf08c1e7f4f258cf8785ffa073600" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 45969 } } peers { permanent_uuid: "48daec8901ad4021b9fbb975adef74b2" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 33539 } }
I20260805 22:50:22.453337 6595 catalog_manager.cc:5495] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 48daec8901ad4021b9fbb975adef74b2 (127.14.224.129). New cstate: current_term: 1 leader_uuid: "48daec8901ad4021b9fbb975adef74b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "281ac2be36c944359aabd1985199ca2e" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50ecf08c1e7f4f258cf8785ffa073600" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 45969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48daec8901ad4021b9fbb975adef74b2" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 33539 } health_report { overall_health: HEALTHY } } }
I20260805 22:50:22.468277 6890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:22.465853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50094 (local address 127.14.224.129:33539)
0805 22:50:22.465949 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0805 22:50:22.465952 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:50:22.465962 (+ 10us) server_negotiation.cc:407] Connection header received
0805 22:50:22.466004 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:50:22.466005 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:50:22.466026 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:50:22.466091 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:50:22.466225 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:50:22.466726 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:50:22.467549 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:50:22.467748 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:50:22.467802 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:50:22.467906 (+ 104us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:50:22.468023 (+ 117us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:50:22.468078 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0805 22:50:22.468175 (+ 97us) server_negotiation.cc:299] Negotiation successful
0805 22:50:22.468197 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
W20260805 22:50:22.469030 7086 tablet.cc:2369] T eb7de5f973fd404f8242d6230ad3cba1 P 281ac2be36c944359aabd1985199ca2e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:50:22.470000 7208 raft_consensus.cc:1261] T eb7de5f973fd404f8242d6230ad3cba1 P 50ecf08c1e7f4f258cf8785ffa073600 [term 1 FOLLOWER]: Refusing update from remote peer 48daec8901ad4021b9fbb975adef74b2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:50:22.469998 7013 raft_consensus.cc:1261] T eb7de5f973fd404f8242d6230ad3cba1 P 281ac2be36c944359aabd1985199ca2e [term 1 FOLLOWER]: Refusing update from remote peer 48daec8901ad4021b9fbb975adef74b2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:50:22.470367 6886 consensus_queue.cc:1035] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "281ac2be36c944359aabd1985199ca2e" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:50:22.470513 7289 consensus_queue.cc:1035] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50ecf08c1e7f4f258cf8785ffa073600" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 45969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:50:22.473359 7295 mvcc.cc:205] Tried to move back new op lower bound from 7315334031234469888 to 7315334031165661184. Current Snapshot: MvccSnapshot[applied={T|T < 7315334031234469888}]
I20260805 22:50:22.475734 6594 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42470:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:50:22.475863 6594 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42470:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:50:22.476845 6594 catalog_manager.cc:5782] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216: Sending DeleteTablet for 3 replicas of tablet eb7de5f973fd404f8242d6230ad3cba1
I20260805 22:50:22.477218 6771 tablet_service.cc:1514] Processing DeleteTablet for tablet eb7de5f973fd404f8242d6230ad3cba1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:50:22 UTC) from {username='kudu', principal='kudu/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:50086
I20260805 22:50:22.477322 6893 tablet_replica.cc:330] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2: stopping tablet replica
I20260805 22:50:22.477321 6986 tablet_service.cc:1514] Processing DeleteTablet for tablet eb7de5f973fd404f8242d6230ad3cba1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:50:22 UTC) from {username='kudu', principal='kudu/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:40260
I20260805 22:50:22.477372 6893 raft_consensus.cc:2229] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2 [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:50:22.477334 7177 tablet_service.cc:1514] Processing DeleteTablet for tablet eb7de5f973fd404f8242d6230ad3cba1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:50:22 UTC) from {username='kudu', principal='kudu/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:59190
I20260805 22:50:22.477468 6893 raft_consensus.cc:2258] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:50:22.477648 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 6661
I20260805 22:50:22.477701 7312 tablet_replica.cc:330] T eb7de5f973fd404f8242d6230ad3cba1 P 281ac2be36c944359aabd1985199ca2e: stopping tablet replica
I20260805 22:50:22.477785 6893 ts_tablet_manager.cc:1905] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:50:22.477818 7312 raft_consensus.cc:2229] T eb7de5f973fd404f8242d6230ad3cba1 P 281ac2be36c944359aabd1985199ca2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:50:22.477931 7312 raft_consensus.cc:2258] T eb7de5f973fd404f8242d6230ad3cba1 P 281ac2be36c944359aabd1985199ca2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:50:22.485527 7312 ts_tablet_manager.cc:1905] T eb7de5f973fd404f8242d6230ad3cba1 P 281ac2be36c944359aabd1985199ca2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:50:22.487210 7312 ts_tablet_manager.cc:1918] T eb7de5f973fd404f8242d6230ad3cba1 P 281ac2be36c944359aabd1985199ca2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:50:22.487391 7312 log.cc:1196] T eb7de5f973fd404f8242d6230ad3cba1 P 281ac2be36c944359aabd1985199ca2e: Deleting WAL directory at /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-1/wal/wals/eb7de5f973fd404f8242d6230ad3cba1
I20260805 22:50:22.487797 7312 ts_tablet_manager.cc:1939] T eb7de5f973fd404f8242d6230ad3cba1 P 281ac2be36c944359aabd1985199ca2e: Deleting consensus metadata
I20260805 22:50:22.488438 6572 catalog_manager.cc:4841] TS 281ac2be36c944359aabd1985199ca2e (127.14.224.130:38039): tablet eb7de5f973fd404f8242d6230ad3cba1 (table test-table [id=5d455a1d3d8d40878a02a30817ec187a]) successfully deleted
I20260805 22:50:22.495595 7314 tablet_replica.cc:330] T eb7de5f973fd404f8242d6230ad3cba1 P 50ecf08c1e7f4f258cf8785ffa073600: stopping tablet replica
I20260805 22:50:22.495870 7314 raft_consensus.cc:2229] T eb7de5f973fd404f8242d6230ad3cba1 P 50ecf08c1e7f4f258cf8785ffa073600 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:50:22.496035 7314 raft_consensus.cc:2258] T eb7de5f973fd404f8242d6230ad3cba1 P 50ecf08c1e7f4f258cf8785ffa073600 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:50:22.496622 7314 ts_tablet_manager.cc:1905] T eb7de5f973fd404f8242d6230ad3cba1 P 50ecf08c1e7f4f258cf8785ffa073600: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:50:22.498421 7314 ts_tablet_manager.cc:1918] T eb7de5f973fd404f8242d6230ad3cba1 P 50ecf08c1e7f4f258cf8785ffa073600: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:50:22.498517 7314 log.cc:1196] T eb7de5f973fd404f8242d6230ad3cba1 P 50ecf08c1e7f4f258cf8785ffa073600: Deleting WAL directory at /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-2/wal/wals/eb7de5f973fd404f8242d6230ad3cba1
I20260805 22:50:22.498888 7314 ts_tablet_manager.cc:1939] T eb7de5f973fd404f8242d6230ad3cba1 P 50ecf08c1e7f4f258cf8785ffa073600: Deleting consensus metadata
I20260805 22:50:22.499382 6572 catalog_manager.cc:4841] TS 50ecf08c1e7f4f258cf8785ffa073600 (127.14.224.131:45969): tablet eb7de5f973fd404f8242d6230ad3cba1 (table test-table [id=5d455a1d3d8d40878a02a30817ec187a]) successfully deleted
W20260805 22:50:22.500473 6573 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.224.129:33539 (error 108)
I20260805 22:50:22.500698 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 6885
I20260805 22:50:22.506165 7276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:22.506004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.129:33539 (local address 127.0.0.1:50098)
0805 22:50:22.506069 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:22.506123 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.129:33539: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260805 22:50:22.506803 6573 catalog_manager.cc:4584] TS 48daec8901ad4021b9fbb975adef74b2 (127.14.224.129:33539): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet eb7de5f973fd404f8242d6230ad3cba1: Network error: Client connection negotiation failed: client connection to 127.14.224.129:33539: connect: Connection refused (error 111)
I20260805 22:50:22.512640 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 7088
I20260805 22:50:22.528617 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 6545
I20260805 22:50:42.545678 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:40037
--webserver_interface=127.14.224.190
--webserver_port=45089
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:39697
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.224.190:40037
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:50:42.633574 7316 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:50:42.633805 7316 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:50:42.633828 7316 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:50:42.635049 7316 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260805 22:50:42.635098 7316 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260805 22:50:42.635111 7316 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260805 22:50:42.635121 7316 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:50:42.635145 7316 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:50:42.635170 7316 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:50:42.635191 7316 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:50:42.635213 7316 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:50:42.636844 7316 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:39697
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.14.224.190:40037
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:40037
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.224.190
--webserver_port=45089
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7316
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:50:42.637117 7316 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:50:42.637342 7316 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:50:42.642696 7328 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:50:42.642706 7323 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:50:42.642750 7316 server_base.cc:1034] running on GCE node
W20260805 22:50:42.642704 7322 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:50:42.643203 7316 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:50:42.643514 7316 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:50:42.644667 7316 hybrid_clock.cc:648] HybridClock initialized: now 1785970242644654 us; error 30 us; skew 500 ppm
Aug 05 22:50:42 dist-test-slave-gjrz krb5kdc[5712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970242, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:50:42.653115 7316 init.cc:377] Logged in from keytab as kudu/127.14.224.190@KRBTEST.COM (short username kudu)
I20260805 22:50:42.653647 7316 webserver.cc:460] Webserver started at http://127.14.224.190:45089/ using document root <none> and password file <none>
I20260805 22:50:42.653894 7316 fs_manager.cc:359] Metadata directory not provided
I20260805 22:50:42.653949 7316 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:50:42.655370 7316 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:50:42.656072 7337 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:50:42.656237 7316 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260805 22:50:42.656327 7316 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/master-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/master-0/wal
uuid: "be4af01bcd0b47378618c4f308318216"
format_stamp: "Formatted at 2026-08-05 22:50:00 on dist-test-slave-gjrz"
server_key: "61e9a70d01fb2b4ea7569418895b8e9d"
server_key_iv: "73211f41bce997d23940c1e4997f4fcd"
server_key_version: "encryptionkey@0"
I20260805 22:50:42.656708 7316 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:50:42.686275 7316 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:50:42.688414 7316 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:50:42.688566 7316 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:50:42.692792 7316 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.190:40037
I20260805 22:50:42.692834 7414 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.190:40037 every 8 connection(s)
I20260805 22:50:42.693228 7316 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
I20260805 22:50:42.694772 7415 sys_catalog.cc:263] Verifying existing consensus state
I20260805 22:50:42.695509 7415 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216: Bootstrap starting.
I20260805 22:50:42.703325 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 7316
I20260805 22:50:42.703640 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.129:33539
--local_ip_for_outbound_sockets=127.14.224.129
--tserver_master_addrs=127.14.224.190:40037
--webserver_port=45171
--webserver_interface=127.14.224.129
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab
--principal=kudu/127.14.224.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:39697
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 22:50:42.704138 7415 log.cc:824] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216: Log is configured to *not* fsync() on all Append() calls
I20260805 22:50:42.707165 7415 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260805 22:50:42.707506 7415 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216: Bootstrap complete.
I20260805 22:50:42.709681 7415 raft_consensus.cc:348] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be4af01bcd0b47378618c4f308318216" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 40037 } }
I20260805 22:50:42.709923 7415 raft_consensus.cc:729] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: be4af01bcd0b47378618c4f308318216, State: Initialized, Role: FOLLOWER
I20260805 22:50:42.710111 7415 consensus_queue.cc:260] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be4af01bcd0b47378618c4f308318216" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 40037 } }
I20260805 22:50:42.710198 7415 raft_consensus.cc:388] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:50:42.710253 7415 raft_consensus.cc:482] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:50:42.710301 7415 raft_consensus.cc:3037] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216 [term 2 FOLLOWER]: Advancing to term 3
I20260805 22:50:42.711431 7415 raft_consensus.cc:504] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be4af01bcd0b47378618c4f308318216" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 40037 } }
I20260805 22:50:42.711547 7415 leader_election.cc:302] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: be4af01bcd0b47378618c4f308318216; no voters:
I20260805 22:50:42.711726 7415 leader_election.cc:288] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260805 22:50:42.711778 7421 raft_consensus.cc:2781] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216 [term 3 FOLLOWER]: Leader election won for term 3
I20260805 22:50:42.711900 7421 raft_consensus.cc:686] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216 [term 3 LEADER]: Becoming Leader. State: Replica: be4af01bcd0b47378618c4f308318216, State: Running, Role: LEADER
I20260805 22:50:42.711994 7421 consensus_queue.cc:237] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be4af01bcd0b47378618c4f308318216" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 40037 } }
I20260805 22:50:42.712041 7415 sys_catalog.cc:564] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:50:42.712304 7422 sys_catalog.cc:455] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "be4af01bcd0b47378618c4f308318216" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be4af01bcd0b47378618c4f308318216" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 40037 } } }
I20260805 22:50:42.712410 7422 sys_catalog.cc:458] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216 [sys.catalog]: This master's current role is: LEADER
I20260805 22:50:42.712611 7423 sys_catalog.cc:455] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216 [sys.catalog]: SysCatalogTable state changed. Reason: New leader be4af01bcd0b47378618c4f308318216. Latest consensus state: current_term: 3 leader_uuid: "be4af01bcd0b47378618c4f308318216" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be4af01bcd0b47378618c4f308318216" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 40037 } } }
I20260805 22:50:42.712677 7423 sys_catalog.cc:458] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216 [sys.catalog]: This master's current role is: LEADER
I20260805 22:50:42.712775 7429 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:50:42.713702 7429 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:50:42.713827 7429 catalog_manager.cc:1259] Loaded cluster ID: 481573c600f04be69bf064863ce850e4
I20260805 22:50:42.713865 7429 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:50:42.714772 7429 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:50:42.714951 7429 catalog_manager.cc:5879] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216: Loaded TSK: 0
I20260805 22:50:42.714990 7429 catalog_manager.cc:5879] T 00000000000000000000000000000000 P be4af01bcd0b47378618c4f308318216: Loaded TSK: 1
F20260805 22:50:42.715195 7429 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f35bf2189ad google::LogMessage::Fail() at ??:0
@ 0x7f35bf21b88a google::LogMessage::SendToLog() at ??:0
@ 0x7f35bf2184de google::LogMessage::Flush() at ??:0
@ 0x7f35bf219a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f35c1985104 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f35c1982d41 kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f35c71721cd kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f35c717248e kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f35c7172594 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f35c7138c48 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f35c7142ad0 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f35c10e60d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f35c10db954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f35c1f3f6db start_thread at ??:0
@ 0x7f35bdd1661f clone at ??:0
W20260805 22:50:42.809386 7419 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:50:42.809607 7419 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:50:42.809631 7419 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:50:42.810837 7419 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:50:42.810883 7419 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:50:42.810910 7419 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.129
I20260805 22:50:42.812489 7419 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:39697
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab
--principal=kudu/127.14.224.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.129:33539
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.224.129
--webserver_port=45171
--tserver_master_addrs=127.14.224.190:40037
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7419
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.129
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:50:42.812731 7419 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:50:42.813097 7419 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:50:42.819397 7477 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:50:42.819427 7419 server_base.cc:1034] running on GCE node
W20260805 22:50:42.819509 7483 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:50:42.819623 7478 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:50:42.819840 7419 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:50:42.820093 7419 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:50:42.821259 7419 hybrid_clock.cc:648] HybridClock initialized: now 1785970242821243 us; error 31 us; skew 500 ppm
Aug 05 22:50:42 dist-test-slave-gjrz krb5kdc[5712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970242, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:50:42.824224 7419 init.cc:377] Logged in from keytab as kudu/127.14.224.129@KRBTEST.COM (short username kudu)
I20260805 22:50:42.824901 7419 webserver.cc:460] Webserver started at http://127.14.224.129:45171/ using document root <none> and password file <none>
I20260805 22:50:42.825178 7419 fs_manager.cc:359] Metadata directory not provided
I20260805 22:50:42.825256 7419 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:50:42.827131 7419 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260805 22:50:42.828132 7494 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:50:42.828320 7419 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:50:42.828436 7419 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-0/wal
uuid: "48daec8901ad4021b9fbb975adef74b2"
format_stamp: "Formatted at 2026-08-05 22:50:00 on dist-test-slave-gjrz"
server_key: "59520f1cd6920eb22c906e79980d66e4"
server_key_iv: "f34ae71d5e745e09cb873950c39bd533"
server_key_version: "encryptionkey@0"
I20260805 22:50:42.828914 7419 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:50:42.859712 7419 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:50:42.862458 7419 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:50:42.862628 7419 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:50:42.862912 7419 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:50:42.863570 7503 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260805 22:50:42.865154 7419 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260805 22:50:42.865223 7419 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260805 22:50:42.865259 7419 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260805 22:50:42.866168 7419 ts_tablet_manager.cc:610] Registered 1 tablets
I20260805 22:50:42.866212 7419 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260805 22:50:42.866290 7503 tablet_bootstrap.cc:492] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2: Bootstrap starting.
I20260805 22:50:42.867949 7503 log.cc:824] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2: Log is configured to *not* fsync() on all Append() calls
I20260805 22:50:42.871019 7503 tablet_bootstrap.cc:492] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260805 22:50:42.871392 7503 tablet_bootstrap.cc:492] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2: Bootstrap complete.
I20260805 22:50:42.871551 7503 ts_tablet_manager.cc:1397] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260805 22:50:42.873296 7503 raft_consensus.cc:348] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "281ac2be36c944359aabd1985199ca2e" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 38039 } } peers { permanent_uuid: "50ecf08c1e7f4f258cf8785ffa073600" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 45969 } } peers { permanent_uuid: "48daec8901ad4021b9fbb975adef74b2" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 33539 } }
I20260805 22:50:42.873559 7503 raft_consensus.cc:729] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48daec8901ad4021b9fbb975adef74b2, State: Initialized, Role: FOLLOWER
I20260805 22:50:42.873781 7503 consensus_queue.cc:260] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "281ac2be36c944359aabd1985199ca2e" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 38039 } } peers { permanent_uuid: "50ecf08c1e7f4f258cf8785ffa073600" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 45969 } } peers { permanent_uuid: "48daec8901ad4021b9fbb975adef74b2" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 33539 } }
I20260805 22:50:42.873829 7419 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.129:33539
I20260805 22:50:42.874090 7503 ts_tablet_manager.cc:1428] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260805 22:50:42.874267 7419 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
I20260805 22:50:42.874377 7679 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.129:33539 every 8 connection(s)
I20260805 22:50:42.880999 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 7419
I20260805 22:50:42.881305 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.130:38039
--local_ip_for_outbound_sockets=127.14.224.130
--tserver_master_addrs=127.14.224.190:40037
--webserver_port=35895
--webserver_interface=127.14.224.130
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab
--principal=kudu/127.14.224.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:39697
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:50:42.925237 7688 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:50:42.875085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:40037 (local address 127.14.224.129:39133)
0805 22:50:42.875287 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:42.875336 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0805 22:50:42.875475 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:50:42.925062 (+ 49587us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:40037: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":83,"threads_started":1}
W20260805 22:50:42.925527 7682 heartbeater.cc:644] Failed to heartbeat to 127.14.224.190:40037 (0 consecutive failures): Network error: Failed to ping master at 127.14.224.190:40037: Client connection negotiation failed: client connection to 127.14.224.190:40037: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260805 22:50:42.925876 7688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:42.925764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:40037 (local address 127.14.224.129:43803)
0805 22:50:42.925813 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:42.925855 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:40037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260805 22:50:42.926191 7688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:42.926108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:40037 (local address 127.14.224.129:36157)
0805 22:50:42.926148 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:42.926171 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:40037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260805 22:50:42.926302 7682 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260805 22:50:42.970543 7689 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:50:42.970772 7689 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:50:42.970796 7689 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:50:42.972026 7689 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:50:42.972074 7689 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:50:42.972100 7689 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.130
I20260805 22:50:42.973558 7689 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:39697
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab
--principal=kudu/127.14.224.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.130:38039
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.224.130
--webserver_port=35895
--tserver_master_addrs=127.14.224.190:40037
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7689
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.130
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:50:42.973780 7689 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:50:42.973995 7689 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260805 22:50:42.979100 7689 server_base.cc:1034] running on GCE node
W20260805 22:50:42.979127 7700 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:50:42.979125 7704 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:50:42.979161 7698 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:50:42.979532 7689 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:50:42.979765 7689 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:50:42.980916 7689 hybrid_clock.cc:648] HybridClock initialized: now 1785970242980897 us; error 35 us; skew 500 ppm
Aug 05 22:50:42 dist-test-slave-gjrz krb5kdc[5712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970242, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:50:42.983493 7689 init.cc:377] Logged in from keytab as kudu/127.14.224.130@KRBTEST.COM (short username kudu)
I20260805 22:50:42.983976 7689 webserver.cc:460] Webserver started at http://127.14.224.130:35895/ using document root <none> and password file <none>
I20260805 22:50:42.984215 7689 fs_manager.cc:359] Metadata directory not provided
I20260805 22:50:42.984267 7689 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:50:42.985617 7689 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:50:42.986212 7715 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:50:42.986371 7689 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260805 22:50:42.986455 7689 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-1/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-1/wal
uuid: "281ac2be36c944359aabd1985199ca2e"
format_stamp: "Formatted at 2026-08-05 22:50:01 on dist-test-slave-gjrz"
server_key: "db6ac0c4e073e2d722ab6b80aa2f4f39"
server_key_iv: "41bcd99c79d1cd9ef53eaaf2a1117e93"
server_key_version: "encryptionkey@0"
I20260805 22:50:42.986812 7689 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:50:42.997902 7689 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:50:43.000111 7689 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:50:43.000263 7689 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:50:43.000500 7689 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:50:43.000856 7689 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:50:43.000898 7689 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:50:43.000931 7689 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:50:43.000954 7689 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:50:43.007439 7689 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.130:38039
I20260805 22:50:43.007499 7882 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.130:38039 every 8 connection(s)
I20260805 22:50:43.007899 7689 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
I20260805 22:50:43.009132 7889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:43.008679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:40037 (local address 127.14.224.130:47777)
0805 22:50:43.008864 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:43.008978 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:40037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":87,"threads_started":1}
W20260805 22:50:43.009569 7885 heartbeater.cc:644] Failed to heartbeat to 127.14.224.190:40037 (0 consecutive failures): Network error: Failed to ping master at 127.14.224.190:40037: Client connection negotiation failed: client connection to 127.14.224.190:40037: connect: Connection refused (error 111)
I20260805 22:50:43.009953 7889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:43.009825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:40037 (local address 127.14.224.130:58041)
0805 22:50:43.009891 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:43.009928 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:40037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260805 22:50:43.010306 7889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:43.010239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:40037 (local address 127.14.224.130:48679)
0805 22:50:43.010269 (+ 30us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:43.010290 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:40037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
W20260805 22:50:43.010394 7885 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260805 22:50:43.010849 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 7689
I20260805 22:50:43.011102 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.131:45969
--local_ip_for_outbound_sockets=127.14.224.131
--tserver_master_addrs=127.14.224.190:40037
--webserver_port=45873
--webserver_interface=127.14.224.131
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab
--principal=kudu/127.14.224.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:39697
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:50:43.098043 7890 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:50:43.098274 7890 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:50:43.098307 7890 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:50:43.099519 7890 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:50:43.099565 7890 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:50:43.099601 7890 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.131
I20260805 22:50:43.101096 7890 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:39697
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab
--principal=kudu/127.14.224.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.131:45969
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.224.131
--webserver_port=45873
--tserver_master_addrs=127.14.224.190:40037
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7890
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.131
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:50:43.101334 7890 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:50:43.101548 7890 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:50:43.106868 7896 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:50:43.106889 7890 server_base.cc:1034] running on GCE node
W20260805 22:50:43.106871 7898 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:50:43.106899 7895 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:50:43.107376 7890 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:50:43.107635 7890 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:50:43.108803 7890 hybrid_clock.cc:648] HybridClock initialized: now 1785970243108789 us; error 32 us; skew 500 ppm
Aug 05 22:50:43 dist-test-slave-gjrz krb5kdc[5712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970243, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:50:43.111431 7890 init.cc:377] Logged in from keytab as kudu/127.14.224.131@KRBTEST.COM (short username kudu)
I20260805 22:50:43.111954 7890 webserver.cc:460] Webserver started at http://127.14.224.131:45873/ using document root <none> and password file <none>
I20260805 22:50:43.112239 7890 fs_manager.cc:359] Metadata directory not provided
I20260805 22:50:43.112303 7890 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:50:43.113655 7890 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:50:43.114223 7909 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:50:43.114408 7890 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260805 22:50:43.114499 7890 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-2/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-2/wal
uuid: "50ecf08c1e7f4f258cf8785ffa073600"
format_stamp: "Formatted at 2026-08-05 22:50:01 on dist-test-slave-gjrz"
server_key: "f75948b64259e48ffc5c8540a371353c"
server_key_iv: "31ce7872f88542692ef43ed93ac795a9"
server_key_version: "encryptionkey@0"
I20260805 22:50:43.114849 7890 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:50:43.128654 7890 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:50:43.131009 7890 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:50:43.131348 7890 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:50:43.131639 7890 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:50:43.131956 7890 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:50:43.131991 7890 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:50:43.132014 7890 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:50:43.132025 7890 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:50:43.138038 7890 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.131:45969
I20260805 22:50:43.138089 8085 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.131:45969 every 8 connection(s)
I20260805 22:50:43.138446 7890 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
I20260805 22:50:43.139649 8090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:43.139147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:40037 (local address 127.14.224.131:37597)
0805 22:50:43.139376 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:43.139488 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:40037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":127,"threads_started":1}
W20260805 22:50:43.140267 8086 heartbeater.cc:644] Failed to heartbeat to 127.14.224.190:40037 (0 consecutive failures): Network error: Failed to ping master at 127.14.224.190:40037: Client connection negotiation failed: client connection to 127.14.224.190:40037: connect: Connection refused (error 111)
I20260805 22:50:43.140664 8090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:43.140548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:40037 (local address 127.14.224.131:46393)
0805 22:50:43.140610 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:43.140640 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:40037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260805 22:50:43.140947 8090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:43.140862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:40037 (local address 127.14.224.131:42099)
0805 22:50:43.140897 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:43.140919 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:40037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
W20260805 22:50:43.141045 8086 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260805 22:50:43.147790 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 7890
I20260805 22:50:43.926975 8092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:43.926704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:40037 (local address 127.14.224.129:42229)
0805 22:50:43.926859 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:43.926907 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:40037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":69,"threads_started":1}
I20260805 22:50:44.011080 8094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:44.010813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:40037 (local address 127.14.224.130:60469)
0805 22:50:44.010966 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:44.011014 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:40037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":66,"threads_started":1}
I20260805 22:50:44.141602 8095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:44.141338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:40037 (local address 127.14.224.131:50479)
0805 22:50:44.141499 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:44.141540 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:40037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":80,"threads_started":1}
I20260805 22:50:44.711656 8096 raft_consensus.cc:482] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:50:44.711797 8096 raft_consensus.cc:504] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "281ac2be36c944359aabd1985199ca2e" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 38039 } } peers { permanent_uuid: "50ecf08c1e7f4f258cf8785ffa073600" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 45969 } } peers { permanent_uuid: "48daec8901ad4021b9fbb975adef74b2" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 33539 } }
I20260805 22:50:44.712126 8096 leader_election.cc:288] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 281ac2be36c944359aabd1985199ca2e (127.14.224.130:38039), 50ecf08c1e7f4f258cf8785ffa073600 (127.14.224.131:45969)
Aug 05 22:50:44 dist-test-slave-gjrz krb5kdc[5712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970242, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.129@KRBTEST.COM for kudu/127.14.224.130@KRBTEST.COM
Aug 05 22:50:44 dist-test-slave-gjrz krb5kdc[5712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970242, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.129@KRBTEST.COM for kudu/127.14.224.131@KRBTEST.COM
I20260805 22:50:44.722499 8100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:44.712593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.129:56525 (local address 127.14.224.131:45969)
0805 22:50:44.712737 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0805 22:50:44.712746 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:50:44.712766 (+ 20us) server_negotiation.cc:407] Connection header received
0805 22:50:44.713210 (+ 444us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:50:44.713213 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:50:44.713253 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:50:44.713379 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:50:44.714149 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:50:44.715015 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:50:44.716028 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:50:44.716416 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:50:44.716517 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:50:44.719124 (+ 2607us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:50:44.719129 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:50:44.719129 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:50:44.719141 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:50:44.720795 (+ 1654us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:50:44.721139 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:50:44.721142 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:50:44.721142 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:50:44.721238 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:50:44.721496 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:50:44.721496 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:50:44.721497 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:50:44.721826 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:50:44.721927 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0805 22:50:44.722254 (+ 327us) server_negotiation.cc:299] Negotiation successful
0805 22:50:44.722395 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105,"thread_start_us":57,"threads_started":1}
I20260805 22:50:44.722497 8099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:44.712474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.131:45969 (local address 127.14.224.129:56525)
0805 22:50:44.712588 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:44.712596 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0805 22:50:44.712669 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:50:44.713416 (+ 747us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:50:44.713418 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:50:44.713795 (+ 377us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:50:44.714027 (+ 232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:50:44.714034 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:50:44.715111 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:50:44.715112 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:50:44.715947 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:50:44.715950 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:50:44.716501 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:50:44.716502 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:50:44.716627 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:50:44.717156 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:50:44.717165 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:50:44.719019 (+ 1854us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:50:44.720867 (+ 1848us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:50:44.720868 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:50:44.720869 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:50:44.721071 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:50:44.721295 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:50:44.721295 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:50:44.721296 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:50:44.721433 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:50:44.721905 (+ 472us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:50:44.721911 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:50:44.722069 (+ 158us) client_negotiation.cc:769] Sending connection context
0805 22:50:44.722186 (+ 117us) client_negotiation.cc:240] Negotiation successful
0805 22:50:44.722358 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103,"mutex_wait_us":27,"thread_start_us":43,"threads_started":1}
I20260805 22:50:44.722854 8098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:44.712400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.129:58713 (local address 127.14.224.130:38039)
0805 22:50:44.712638 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0805 22:50:44.712652 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0805 22:50:44.712681 (+ 29us) server_negotiation.cc:407] Connection header received
0805 22:50:44.713146 (+ 465us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:50:44.713149 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:50:44.713194 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:50:44.713334 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:50:44.714293 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:50:44.715129 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:50:44.716028 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:50:44.716420 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:50:44.716516 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:50:44.718793 (+ 2277us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:50:44.718798 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:50:44.718799 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:50:44.718812 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:50:44.720611 (+ 1799us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:50:44.721075 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:50:44.721077 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:50:44.721078 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:50:44.721201 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:50:44.721496 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:50:44.721497 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:50:44.721497 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:50:44.721826 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:50:44.721927 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0805 22:50:44.722254 (+ 327us) server_negotiation.cc:299] Negotiation successful
0805 22:50:44.722756 (+ 502us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":197,"thread_start_us":55,"threads_started":1}
I20260805 22:50:44.723141 8097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:44.712278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.130:38039 (local address 127.14.224.129:58713)
0805 22:50:44.712414 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:44.712424 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0805 22:50:44.712498 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:50:44.713393 (+ 895us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:50:44.713396 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:50:44.713794 (+ 398us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:50:44.714189 (+ 395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:50:44.714192 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:50:44.715221 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:50:44.715222 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:50:44.715947 (+ 725us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:50:44.715949 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:50:44.716504 (+ 555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:50:44.716505 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:50:44.716629 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:50:44.717205 (+ 576us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:50:44.717210 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:50:44.718686 (+ 1476us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:50:44.720693 (+ 2007us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:50:44.720702 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:50:44.720703 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:50:44.720996 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:50:44.721267 (+ 271us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:50:44.721267 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:50:44.721268 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:50:44.721433 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:50:44.721905 (+ 472us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:50:44.721911 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:50:44.722069 (+ 158us) client_negotiation.cc:769] Sending connection context
0805 22:50:44.722186 (+ 117us) client_negotiation.cc:240] Negotiation successful
0805 22:50:44.722423 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"mutex_wait_us":103,"thread_start_us":73,"threads_started":1}
W20260805 22:50:44.723488 7497 leader_election.cc:341] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 50ecf08c1e7f4f258cf8785ffa073600 (127.14.224.131:45969): Not found: Tablet not found: eb7de5f973fd404f8242d6230ad3cba1
W20260805 22:50:44.723798 7497 leader_election.cc:341] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 281ac2be36c944359aabd1985199ca2e (127.14.224.130:38039): Not found: Tablet not found: eb7de5f973fd404f8242d6230ad3cba1
I20260805 22:50:44.723834 7497 leader_election.cc:302] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48daec8901ad4021b9fbb975adef74b2; no voters: 281ac2be36c944359aabd1985199ca2e, 50ecf08c1e7f4f258cf8785ffa073600
I20260805 22:50:44.723941 8096 raft_consensus.cc:2726] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260805 22:50:44.927659 8097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:44.927510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:40037 (local address 127.14.224.129:39537)
0805 22:50:44.927574 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:44.927616 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:40037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260805 22:50:45.011968 8101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:45.011645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:40037 (local address 127.14.224.130:40959)
0805 22:50:45.011820 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:45.011881 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:40037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":84,"threads_started":1}
I20260805 22:50:45.142407 8102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:45.142103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:40037 (local address 127.14.224.131:41639)
0805 22:50:45.142287 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:45.142351 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:40037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":91,"threads_started":1}
I20260805 22:50:45.928323 8104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:45.928118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:40037 (local address 127.14.224.129:57869)
0805 22:50:45.928240 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:45.928275 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:40037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":66,"threads_started":1}
I20260805 22:50:46.012778 8105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:46.012535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:40037 (local address 127.14.224.130:52741)
0805 22:50:46.012683 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:46.012722 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:40037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":67,"threads_started":1}
I20260805 22:50:46.143235 8106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:46.142971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:40037 (local address 127.14.224.131:51001)
0805 22:50:46.143136 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:46.143185 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:40037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":75,"threads_started":1}
I20260805 22:50:46.459904 8107 raft_consensus.cc:482] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:50:46.460047 8107 raft_consensus.cc:504] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "281ac2be36c944359aabd1985199ca2e" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 38039 } } peers { permanent_uuid: "50ecf08c1e7f4f258cf8785ffa073600" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 45969 } } peers { permanent_uuid: "48daec8901ad4021b9fbb975adef74b2" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 33539 } }
I20260805 22:50:46.460223 8107 leader_election.cc:288] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 281ac2be36c944359aabd1985199ca2e (127.14.224.130:38039), 50ecf08c1e7f4f258cf8785ffa073600 (127.14.224.131:45969)
W20260805 22:50:46.460973 7497 leader_election.cc:341] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 50ecf08c1e7f4f258cf8785ffa073600 (127.14.224.131:45969): Not found: Tablet not found: eb7de5f973fd404f8242d6230ad3cba1
W20260805 22:50:46.461066 7497 leader_election.cc:341] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 281ac2be36c944359aabd1985199ca2e (127.14.224.130:38039): Not found: Tablet not found: eb7de5f973fd404f8242d6230ad3cba1
I20260805 22:50:46.461086 7497 leader_election.cc:302] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48daec8901ad4021b9fbb975adef74b2; no voters: 281ac2be36c944359aabd1985199ca2e, 50ecf08c1e7f4f258cf8785ffa073600
I20260805 22:50:46.461155 8107 raft_consensus.cc:2726] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260805 22:50:46.929049 8111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:46.928775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:40037 (local address 127.14.224.129:48637)
0805 22:50:46.928951 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:46.928999 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:40037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":101,"threads_started":1}
I20260805 22:50:47.013571 8113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:47.013309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:40037 (local address 127.14.224.130:55055)
0805 22:50:47.013468 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:47.013522 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:40037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":69,"threads_started":1}
I20260805 22:50:47.143973 8114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:47.143733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:40037 (local address 127.14.224.131:48599)
0805 22:50:47.143884 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:47.143925 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:40037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":64,"threads_started":1}
I20260805 22:50:47.929754 8115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:47.929508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:40037 (local address 127.14.224.129:57729)
0805 22:50:47.929665 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:47.929707 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:40037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":70,"threads_started":1}
I20260805 22:50:48.014454 8120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:48.014187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:40037 (local address 127.14.224.130:35489)
0805 22:50:48.014351 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:48.014394 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:40037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":70,"threads_started":1}
I20260805 22:50:48.144929 8121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:48.144650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:40037 (local address 127.14.224.131:52043)
0805 22:50:48.144825 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:48.144876 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:40037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":74,"threads_started":1}
I20260805 22:50:48.889453 8122 raft_consensus.cc:482] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:50:48.889561 8122 raft_consensus.cc:504] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "281ac2be36c944359aabd1985199ca2e" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 38039 } } peers { permanent_uuid: "50ecf08c1e7f4f258cf8785ffa073600" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 45969 } } peers { permanent_uuid: "48daec8901ad4021b9fbb975adef74b2" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 33539 } }
I20260805 22:50:48.889704 8122 leader_election.cc:288] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 281ac2be36c944359aabd1985199ca2e (127.14.224.130:38039), 50ecf08c1e7f4f258cf8785ffa073600 (127.14.224.131:45969)
W20260805 22:50:48.890175 7497 leader_election.cc:341] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 50ecf08c1e7f4f258cf8785ffa073600 (127.14.224.131:45969): Not found: Tablet not found: eb7de5f973fd404f8242d6230ad3cba1
W20260805 22:50:48.890251 7497 leader_election.cc:341] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 281ac2be36c944359aabd1985199ca2e (127.14.224.130:38039): Not found: Tablet not found: eb7de5f973fd404f8242d6230ad3cba1
I20260805 22:50:48.890266 7497 leader_election.cc:302] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48daec8901ad4021b9fbb975adef74b2; no voters: 281ac2be36c944359aabd1985199ca2e, 50ecf08c1e7f4f258cf8785ffa073600
I20260805 22:50:48.890337 8122 raft_consensus.cc:2726] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260805 22:50:48.930506 8124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:48.930273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:40037 (local address 127.14.224.129:49875)
0805 22:50:48.930416 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:48.930456 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:40037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":88,"threads_started":1}
I20260805 22:50:49.015232 8125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:49.014935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:40037 (local address 127.14.224.130:51581)
0805 22:50:49.015140 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:49.015185 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:40037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":109,"threads_started":1}
I20260805 22:50:49.145771 8126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:49.145542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:40037 (local address 127.14.224.131:60341)
0805 22:50:49.145672 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:49.145721 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:40037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":61,"threads_started":1}
I20260805 22:50:49.931432 8127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:49.931099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:40037 (local address 127.14.224.129:45895)
0805 22:50:49.931334 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:49.931382 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:40037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":104,"threads_started":1}
I20260805 22:50:50.016060 8128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:50.015789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:40037 (local address 127.14.224.130:44019)
0805 22:50:50.015963 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:50.016009 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:40037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":140,"threads_started":1}
I20260805 22:50:50.146642 8129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:50.146344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:40037 (local address 127.14.224.131:47909)
0805 22:50:50.146537 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:50.146590 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:40037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":96,"threads_started":1}
I20260805 22:50:50.932253 8133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:50.931958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:40037 (local address 127.14.224.129:44021)
0805 22:50:50.932145 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:50.932203 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:40037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":90,"threads_started":1}
I20260805 22:50:51.016773 8134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:51.016518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:40037 (local address 127.14.224.130:41401)
0805 22:50:51.016679 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:51.016726 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:40037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":85,"threads_started":1}
I20260805 22:50:51.147567 8136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:51.147306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:40037 (local address 127.14.224.131:34847)
0805 22:50:51.147466 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:51.147516 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:40037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":88,"threads_started":1}
I20260805 22:50:51.933037 8137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:51.932769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:40037 (local address 127.14.224.129:58429)
0805 22:50:51.932935 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:51.932987 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:40037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":70,"threads_started":1}
I20260805 22:50:52.017556 8138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:52.017312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:40037 (local address 127.14.224.130:33509)
0805 22:50:52.017443 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:52.017492 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:40037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":68,"threads_started":1}
I20260805 22:50:52.148371 8139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:52.148118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:40037 (local address 127.14.224.131:54751)
0805 22:50:52.148271 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:52.148320 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:40037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":72,"threads_started":1}
I20260805 22:50:52.642495 8140 raft_consensus.cc:482] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:50:52.642601 8140 raft_consensus.cc:504] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "281ac2be36c944359aabd1985199ca2e" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 38039 } } peers { permanent_uuid: "50ecf08c1e7f4f258cf8785ffa073600" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 45969 } } peers { permanent_uuid: "48daec8901ad4021b9fbb975adef74b2" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 33539 } }
I20260805 22:50:52.642740 8140 leader_election.cc:288] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 281ac2be36c944359aabd1985199ca2e (127.14.224.130:38039), 50ecf08c1e7f4f258cf8785ffa073600 (127.14.224.131:45969)
W20260805 22:50:52.643142 7497 leader_election.cc:341] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 281ac2be36c944359aabd1985199ca2e (127.14.224.130:38039): Not found: Tablet not found: eb7de5f973fd404f8242d6230ad3cba1
W20260805 22:50:52.643234 7497 leader_election.cc:341] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 50ecf08c1e7f4f258cf8785ffa073600 (127.14.224.131:45969): Not found: Tablet not found: eb7de5f973fd404f8242d6230ad3cba1
I20260805 22:50:52.643288 7497 leader_election.cc:302] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48daec8901ad4021b9fbb975adef74b2; no voters: 281ac2be36c944359aabd1985199ca2e, 50ecf08c1e7f4f258cf8785ffa073600
I20260805 22:50:52.643380 8140 raft_consensus.cc:2726] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260805 22:50:52.933830 8144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:52.933551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:40037 (local address 127.14.224.129:37671)
0805 22:50:52.933717 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:52.933769 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:40037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":81,"threads_started":1}
I20260805 22:50:53.018348 8147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:53.018089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:40037 (local address 127.14.224.130:57361)
0805 22:50:53.018248 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:53.018295 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:40037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":82,"threads_started":1}
I20260805 22:50:53.149309 8148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:53.149018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:40037 (local address 127.14.224.131:43743)
0805 22:50:53.149202 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:53.149255 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:40037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":95,"threads_started":1}
I20260805 22:50:53.934578 8149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:53.934330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:40037 (local address 127.14.224.129:41877)
0805 22:50:53.934476 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:53.934528 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:40037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":72,"threads_started":1}
I20260805 22:50:54.019147 8150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:54.018869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:40037 (local address 127.14.224.130:49283)
0805 22:50:54.019051 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:54.019099 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:40037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":82,"threads_started":1}
I20260805 22:50:54.150298 8151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:54.149953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:40037 (local address 127.14.224.131:49289)
0805 22:50:54.150201 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:54.150249 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:40037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":148,"threads_started":1}
I20260805 22:50:54.935209 8153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:54.934986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:40037 (local address 127.14.224.129:39033)
0805 22:50:54.935118 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:54.935160 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:40037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":69,"threads_started":1}
I20260805 22:50:55.019939 8154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:55.019675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:40037 (local address 127.14.224.130:42141)
0805 22:50:55.019853 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:55.019893 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:40037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":78,"threads_started":1}
I20260805 22:50:55.151108 8156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:55.150859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:40037 (local address 127.14.224.131:47213)
0805 22:50:55.151008 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:55.151060 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:40037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":71,"threads_started":1}
I20260805 22:50:55.935894 8161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:55.935673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:40037 (local address 127.14.224.129:51079)
0805 22:50:55.935800 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:55.935847 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:40037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":67,"threads_started":1}
I20260805 22:50:56.020821 8162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:56.020573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:40037 (local address 127.14.224.130:39377)
0805 22:50:56.020722 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:56.020772 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:40037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":67,"threads_started":1}
I20260805 22:50:56.151899 8164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:56.151649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:40037 (local address 127.14.224.131:38553)
0805 22:50:56.151807 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:56.151849 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:40037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":84,"threads_started":1}
I20260805 22:50:56.936664 8165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:56.936411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:40037 (local address 127.14.224.129:37589)
0805 22:50:56.936571 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:56.936618 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:40037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":83,"threads_started":1}
I20260805 22:50:57.021579 8166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:57.021343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:40037 (local address 127.14.224.130:58847)
0805 22:50:57.021489 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:57.021531 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:40037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":82,"threads_started":1}
I20260805 22:50:57.126092 8167 raft_consensus.cc:482] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:50:57.126214 8167 raft_consensus.cc:504] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "281ac2be36c944359aabd1985199ca2e" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 38039 } } peers { permanent_uuid: "50ecf08c1e7f4f258cf8785ffa073600" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 45969 } } peers { permanent_uuid: "48daec8901ad4021b9fbb975adef74b2" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 33539 } }
I20260805 22:50:57.126402 8167 leader_election.cc:288] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 281ac2be36c944359aabd1985199ca2e (127.14.224.130:38039), 50ecf08c1e7f4f258cf8785ffa073600 (127.14.224.131:45969)
W20260805 22:50:57.126861 7497 leader_election.cc:341] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 50ecf08c1e7f4f258cf8785ffa073600 (127.14.224.131:45969): Not found: Tablet not found: eb7de5f973fd404f8242d6230ad3cba1
W20260805 22:50:57.126929 7497 leader_election.cc:341] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 281ac2be36c944359aabd1985199ca2e (127.14.224.130:38039): Not found: Tablet not found: eb7de5f973fd404f8242d6230ad3cba1
I20260805 22:50:57.126945 7497 leader_election.cc:302] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48daec8901ad4021b9fbb975adef74b2; no voters: 281ac2be36c944359aabd1985199ca2e, 50ecf08c1e7f4f258cf8785ffa073600
I20260805 22:50:57.127039 8167 raft_consensus.cc:2726] T eb7de5f973fd404f8242d6230ad3cba1 P 48daec8901ad4021b9fbb975adef74b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260805 22:50:57.152670 8169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:57.152430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:40037 (local address 127.14.224.131:42769)
0805 22:50:57.152571 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:57.152621 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:40037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":77,"threads_started":1}
I20260805 22:50:57.937526 8170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:57.937285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:40037 (local address 127.14.224.129:48555)
0805 22:50:57.937439 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:57.937478 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:40037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":65,"threads_started":1}
I20260805 22:50:58.022513 8173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:58.022256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:40037 (local address 127.14.224.130:33679)
0805 22:50:58.022424 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:58.022466 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:40037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":81,"threads_started":1}
I20260805 22:50:58.149760 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 7419
I20260805 22:50:58.159970 8175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:58.158160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:40037 (local address 127.14.224.131:52371)
0805 22:50:58.159855 (+ 1695us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:58.159908 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.190:40037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1672,"thread_start_us":1209,"threads_started":1}
I20260805 22:50:58.163965 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 7689
I20260805 22:50:58.172379 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 7890
2026-08-05T22:50:58Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (58797 ms)
[----------] 30 tests from SecurityITest (236884 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:50:58 dist-test-slave-gjrz krb5kdc[8180](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:50:58 dist-test-slave-gjrz krb5kdc[8180](info): set up 2 sockets
Aug 05 22:50:58 dist-test-slave-gjrz krb5kdc[8180](info): commencing operation
krb5kdc: starting...
W20260805 22:50:59.317162 15234 mini_kdc.cc:121] Time spent starting KDC: real 1.118s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Aug 05 22:50:59 dist-test-slave-gjrz krb5kdc[8180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970259, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:50:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:50:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.224.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab.
Entry for principal kudu/127.14.224.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab.
I20260805 22:50:59.449548 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:41525
--webserver_interface=127.14.224.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:40079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.224.190:41525
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:50:59.537878 8199 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:50:59.538136 8199 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:50:59.538172 8199 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:50:59.539431 8199 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:50:59.539486 8199 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:50:59.539505 8199 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:50:59.539521 8199 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:50:59.539535 8199 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:50:59.541178 8199 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:40079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.224.190:41525
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:41525
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.224.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8199
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:50:59.541461 8199 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:50:59.541700 8199 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:50:59.546797 8208 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:50:59.546862 8206 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:50:59.547070 8199 server_base.cc:1034] running on GCE node
W20260805 22:50:59.546862 8205 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:50:59.547663 8199 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:50:59.547989 8199 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:50:59.549151 8199 hybrid_clock.cc:648] HybridClock initialized: now 1785970259549138 us; error 34 us; skew 500 ppm
Aug 05 22:50:59 dist-test-slave-gjrz krb5kdc[8180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970259, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:50:59.551784 8199 init.cc:377] Logged in from keytab as kudu/127.14.224.190@KRBTEST.COM (short username kudu)
I20260805 22:50:59.552251 8199 webserver.cc:460] Webserver started at http://127.14.224.190:46093/ using document root <none> and password file <none>
I20260805 22:50:59.552486 8199 fs_manager.cc:359] Metadata directory not provided
I20260805 22:50:59.552538 8199 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:50:59.552670 8199 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:50:59.553757 8199 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/minicluster-data/master-0/data/instance:
uuid: "a27428688b0a4679bfed64775b4a39fc"
format_stamp: "Formatted at 2026-08-05 22:50:59 on dist-test-slave-gjrz"
server_key: "e7ada6e2f4c7ea188d1456c87e91cd17"
server_key_iv: "998c612a6b6f5e9890028ea2c489b120"
server_key_version: "encryptionkey@0"
I20260805 22:50:59.554103 8199 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/minicluster-data/master-0/wal/instance:
uuid: "a27428688b0a4679bfed64775b4a39fc"
format_stamp: "Formatted at 2026-08-05 22:50:59 on dist-test-slave-gjrz"
server_key: "e7ada6e2f4c7ea188d1456c87e91cd17"
server_key_iv: "998c612a6b6f5e9890028ea2c489b120"
server_key_version: "encryptionkey@0"
I20260805 22:50:59.555639 8199 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260805 22:50:59.556440 8216 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:50:59.556600 8199 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260805 22:50:59.556692 8199 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/minicluster-data/master-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/minicluster-data/master-0/wal
uuid: "a27428688b0a4679bfed64775b4a39fc"
format_stamp: "Formatted at 2026-08-05 22:50:59 on dist-test-slave-gjrz"
server_key: "e7ada6e2f4c7ea188d1456c87e91cd17"
server_key_iv: "998c612a6b6f5e9890028ea2c489b120"
server_key_version: "encryptionkey@0"
I20260805 22:50:59.556764 8199 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:50:59.576959 8199 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:50:59.579082 8199 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:50:59.579237 8199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:50:59.583382 8199 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.190:41525
I20260805 22:50:59.583425 8296 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.190:41525 every 8 connection(s)
I20260805 22:50:59.583796 8199 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
I20260805 22:50:59.584758 8297 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:50:59.585552 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 8199
I20260805 22:50:59.585671 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/minicluster-data/master-0/wal/instance
I20260805 22:50:59.585872 15234 external_mini_cluster.cc:1428] Setting key cd878cc8deedc032a73e7ce254bbe73d
I20260805 22:50:59.588222 8297 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a27428688b0a4679bfed64775b4a39fc: Bootstrap starting.
I20260805 22:50:59.588881 8297 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a27428688b0a4679bfed64775b4a39fc: Neither blocks nor log segments found. Creating new log.
I20260805 22:50:59.589167 8297 log.cc:824] T 00000000000000000000000000000000 P a27428688b0a4679bfed64775b4a39fc: Log is configured to *not* fsync() on all Append() calls
I20260805 22:50:59.589872 8297 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a27428688b0a4679bfed64775b4a39fc: No bootstrap required, opened a new log
I20260805 22:50:59.591980 8297 raft_consensus.cc:348] T 00000000000000000000000000000000 P a27428688b0a4679bfed64775b4a39fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a27428688b0a4679bfed64775b4a39fc" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 41525 } }
I20260805 22:50:59.592142 8297 raft_consensus.cc:374] T 00000000000000000000000000000000 P a27428688b0a4679bfed64775b4a39fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:50:59.592178 8297 raft_consensus.cc:729] T 00000000000000000000000000000000 P a27428688b0a4679bfed64775b4a39fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a27428688b0a4679bfed64775b4a39fc, State: Initialized, Role: FOLLOWER
I20260805 22:50:59.592332 8297 consensus_queue.cc:260] T 00000000000000000000000000000000 P a27428688b0a4679bfed64775b4a39fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a27428688b0a4679bfed64775b4a39fc" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 41525 } }
I20260805 22:50:59.592437 8297 raft_consensus.cc:388] T 00000000000000000000000000000000 P a27428688b0a4679bfed64775b4a39fc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:50:59.592476 8297 raft_consensus.cc:482] T 00000000000000000000000000000000 P a27428688b0a4679bfed64775b4a39fc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:50:59.592525 8297 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a27428688b0a4679bfed64775b4a39fc [term 0 FOLLOWER]: Advancing to term 1
Aug 05 22:50:59 dist-test-slave-gjrz krb5kdc[8180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970259, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:50:59.593246 8297 raft_consensus.cc:504] T 00000000000000000000000000000000 P a27428688b0a4679bfed64775b4a39fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a27428688b0a4679bfed64775b4a39fc" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 41525 } }
I20260805 22:50:59.593350 8297 leader_election.cc:302] T 00000000000000000000000000000000 P a27428688b0a4679bfed64775b4a39fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a27428688b0a4679bfed64775b4a39fc; no voters:
I20260805 22:50:59.593575 8297 leader_election.cc:288] T 00000000000000000000000000000000 P a27428688b0a4679bfed64775b4a39fc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:50:59.593626 8304 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a27428688b0a4679bfed64775b4a39fc [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:50:59.593873 8297 sys_catalog.cc:564] T 00000000000000000000000000000000 P a27428688b0a4679bfed64775b4a39fc [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:50:59.594079 8304 raft_consensus.cc:686] T 00000000000000000000000000000000 P a27428688b0a4679bfed64775b4a39fc [term 1 LEADER]: Becoming Leader. State: Replica: a27428688b0a4679bfed64775b4a39fc, State: Running, Role: LEADER
I20260805 22:50:59.594180 8304 consensus_queue.cc:237] T 00000000000000000000000000000000 P a27428688b0a4679bfed64775b4a39fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a27428688b0a4679bfed64775b4a39fc" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 41525 } }
I20260805 22:50:59.594988 8306 sys_catalog.cc:455] T 00000000000000000000000000000000 P a27428688b0a4679bfed64775b4a39fc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a27428688b0a4679bfed64775b4a39fc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a27428688b0a4679bfed64775b4a39fc" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 41525 } } }
I20260805 22:50:59.595170 8306 sys_catalog.cc:458] T 00000000000000000000000000000000 P a27428688b0a4679bfed64775b4a39fc [sys.catalog]: This master's current role is: LEADER
I20260805 22:50:59.595574 8307 sys_catalog.cc:455] T 00000000000000000000000000000000 P a27428688b0a4679bfed64775b4a39fc [sys.catalog]: SysCatalogTable state changed. Reason: New leader a27428688b0a4679bfed64775b4a39fc. Latest consensus state: current_term: 1 leader_uuid: "a27428688b0a4679bfed64775b4a39fc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a27428688b0a4679bfed64775b4a39fc" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 41525 } } }
I20260805 22:50:59.595852 8307 sys_catalog.cc:458] T 00000000000000000000000000000000 P a27428688b0a4679bfed64775b4a39fc [sys.catalog]: This master's current role is: LEADER
W20260805 22:50:59.596331 8331 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a27428688b0a4679bfed64775b4a39fc: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260805 22:50:59.596386 8331 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260805 22:50:59.596431 8329 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:50:59.596580 8329 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:50:59.597098 8301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:59.586477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51432 (local address 127.14.224.190:41525)
0805 22:50:59.586652 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0805 22:50:59.586661 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:50:59.586689 (+ 28us) server_negotiation.cc:407] Connection header received
0805 22:50:59.587168 (+ 479us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:50:59.587176 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:50:59.587232 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:50:59.587430 (+ 198us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:50:59.588290 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:50:59.589357 (+ 1067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:50:59.590216 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:50:59.590659 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:50:59.590767 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:50:59.593432 (+ 2665us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:50:59.593437 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:50:59.593438 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:50:59.593459 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:50:59.595437 (+ 1978us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:50:59.595873 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:50:59.595877 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:50:59.595877 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:50:59.595986 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:50:59.596202 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:50:59.596204 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:50:59.596204 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:50:59.596488 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:50:59.596654 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0805 22:50:59.596766 (+ 112us) server_negotiation.cc:299] Negotiation successful
0805 22:50:59.596919 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":76,"threads_started":1}
I20260805 22:50:59.598363 8329 catalog_manager.cc:1347] Generated new cluster ID: 5c55a4a7fe51473981258301101a8470
I20260805 22:50:59.598407 8329 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:50:59.606724 8329 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:50:59.607311 8329 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:50:59.612176 8329 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a27428688b0a4679bfed64775b4a39fc: Generated new TSK 0
I20260805 22:50:59.612397 8329 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.224.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab.
Entry for principal kudu/127.14.224.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab.
I20260805 22:50:59.653824 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.129:0
--local_ip_for_outbound_sockets=127.14.224.129
--webserver_interface=127.14.224.129
--webserver_port=0
--tserver_master_addrs=127.14.224.190:41525
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab
--principal=kudu/127.14.224.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:40079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:50:59.776108 8340 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:50:59.776381 8340 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:50:59.776409 8340 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:50:59.777693 8340 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:50:59.777746 8340 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:50:59.777776 8340 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.129
I20260805 22:50:59.779419 8340 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:40079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab
--principal=kudu/127.14.224.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.224.129
--webserver_port=0
--tserver_master_addrs=127.14.224.190:41525
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8340
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.129
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:50:59.779676 8340 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:50:59.779943 8340 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:50:59.785200 8346 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:50:59.785200 8350 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:50:59.785233 8340 server_base.cc:1034] running on GCE node
W20260805 22:50:59.785195 8345 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:50:59.785635 8340 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:50:59.785876 8340 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:50:59.787016 8340 hybrid_clock.cc:648] HybridClock initialized: now 1785970259786998 us; error 38 us; skew 500 ppm
Aug 05 22:50:59 dist-test-slave-gjrz krb5kdc[8180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970259, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:50:59.789790 8340 init.cc:377] Logged in from keytab as kudu/127.14.224.129@KRBTEST.COM (short username kudu)
I20260805 22:50:59.790299 8340 webserver.cc:460] Webserver started at http://127.14.224.129:46751/ using document root <none> and password file <none>
I20260805 22:50:59.790530 8340 fs_manager.cc:359] Metadata directory not provided
I20260805 22:50:59.790581 8340 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:50:59.790714 8340 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:50:59.791853 8340 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/minicluster-data/ts-0/data/instance:
uuid: "fcc898c6cd1645a2b5ffa44debd33a34"
format_stamp: "Formatted at 2026-08-05 22:50:59 on dist-test-slave-gjrz"
server_key: "7e2e0717bc5a957afbbdafaf12951219"
server_key_iv: "24d68ea62747c64479fbd18fb857c7cd"
server_key_version: "encryptionkey@0"
I20260805 22:50:59.792205 8340 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/minicluster-data/ts-0/wal/instance:
uuid: "fcc898c6cd1645a2b5ffa44debd33a34"
format_stamp: "Formatted at 2026-08-05 22:50:59 on dist-test-slave-gjrz"
server_key: "7e2e0717bc5a957afbbdafaf12951219"
server_key_iv: "24d68ea62747c64479fbd18fb857c7cd"
server_key_version: "encryptionkey@0"
I20260805 22:50:59.793596 8340 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260805 22:50:59.794402 8360 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:50:59.794560 8340 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260805 22:50:59.794651 8340 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/minicluster-data/ts-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/minicluster-data/ts-0/wal
uuid: "fcc898c6cd1645a2b5ffa44debd33a34"
format_stamp: "Formatted at 2026-08-05 22:50:59 on dist-test-slave-gjrz"
server_key: "7e2e0717bc5a957afbbdafaf12951219"
server_key_iv: "24d68ea62747c64479fbd18fb857c7cd"
server_key_version: "encryptionkey@0"
I20260805 22:50:59.794728 8340 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:50:59.810446 8340 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:50:59.812717 8340 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:50:59.812875 8340 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:50:59.813118 8340 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:50:59.813442 8340 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:50:59.813483 8340 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:50:59.813516 8340 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:50:59.813537 8340 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:50:59.819319 8340 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.129:46673
I20260805 22:50:59.819387 8534 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.129:46673 every 8 connection(s)
I20260805 22:50:59.819723 8340 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
I20260805 22:50:59.820858 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 8340
I20260805 22:50:59.820976 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/minicluster-data/ts-0/wal/instance
I20260805 22:50:59.821171 15234 external_mini_cluster.cc:1428] Setting key 54042d3d9670bf50d197858538bf3833
Aug 05 22:50:59 dist-test-slave-gjrz krb5kdc[8180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970259, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.129@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:50:59.830468 8301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:59.820468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.129:36395 (local address 127.14.224.190:41525)
0805 22:50:59.820521 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0805 22:50:59.820524 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:50:59.820760 (+ 236us) server_negotiation.cc:407] Connection header received
0805 22:50:59.821334 (+ 574us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:50:59.821335 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:50:59.821348 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:50:59.821399 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:50:59.822426 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:50:59.822945 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:50:59.824377 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:50:59.824605 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:50:59.824674 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:50:59.827610 (+ 2936us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:50:59.827612 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:50:59.827613 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:50:59.827623 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:50:59.828991 (+ 1368us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:50:59.829447 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:50:59.829448 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:50:59.829449 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:50:59.829513 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:50:59.829764 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:50:59.829765 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:50:59.829765 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:50:59.829896 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:50:59.829958 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0805 22:50:59.830269 (+ 311us) server_negotiation.cc:299] Negotiation successful
0805 22:50:59.830372 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260805 22:50:59.830660 8540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:59.820468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:41525 (local address 127.14.224.129:36395)
0805 22:50:59.820632 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:59.820672 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0805 22:50:59.821231 (+ 559us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:50:59.821487 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:50:59.821491 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:50:59.822118 (+ 627us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:50:59.822323 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:50:59.822329 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:50:59.823044 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:50:59.823045 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:50:59.824253 (+ 1208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:50:59.824259 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:50:59.824725 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:50:59.824726 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:50:59.824887 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:50:59.825400 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:50:59.825411 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:50:59.827486 (+ 2075us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:50:59.829102 (+ 1616us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:50:59.829113 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:50:59.829117 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:50:59.829371 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:50:59.829575 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:50:59.829576 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:50:59.829577 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:50:59.829702 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:50:59.829957 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:50:59.829965 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:50:59.830136 (+ 171us) client_negotiation.cc:769] Sending connection context
0805 22:50:59.830235 (+ 99us) client_negotiation.cc:240] Negotiation successful
0805 22:50:59.830418 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":80,"threads_started":1}
WARNING: no policy specified for kudu/127.14.224.130@KRBTEST.COM; defaulting to no policy
I20260805 22:50:59.831207 8535 heartbeater.cc:347] Connected to a master server at 127.14.224.190:41525
I20260805 22:50:59.831337 8535 heartbeater.cc:464] Registering TS with master...
I20260805 22:50:59.831521 8535 heartbeater.cc:511] Master 127.14.224.190:41525 requested a full tablet report, sending...
I20260805 22:50:59.832157 8240 ts_manager.cc:194] Registered new tserver with Master: fcc898c6cd1645a2b5ffa44debd33a34 (127.14.224.129:46673)
I20260805 22:50:59.832813 8240 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.224.129@KRBTEST.COM'} at 127.14.224.129:36395
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab.
Entry for principal kudu/127.14.224.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab.
I20260805 22:50:59.849999 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.130:0
--local_ip_for_outbound_sockets=127.14.224.130
--webserver_interface=127.14.224.130
--webserver_port=0
--tserver_master_addrs=127.14.224.190:41525
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab
--principal=kudu/127.14.224.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:40079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:50:59.934650 8545 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:50:59.934893 8545 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:50:59.934921 8545 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:50:59.936203 8545 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:50:59.936259 8545 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:50:59.936288 8545 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.130
I20260805 22:50:59.937891 8545 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:40079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab
--principal=kudu/127.14.224.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.224.130
--webserver_port=0
--tserver_master_addrs=127.14.224.190:41525
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8545
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.130
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:50:59.938158 8545 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:50:59.938395 8545 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:50:59.943642 8555 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:50:59.943791 8556 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:50:59.943642 8545 server_base.cc:1034] running on GCE node
W20260805 22:50:59.943643 8559 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:50:59.944141 8545 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:50:59.944427 8545 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:50:59.945585 8545 hybrid_clock.cc:648] HybridClock initialized: now 1785970259945565 us; error 36 us; skew 500 ppm
Aug 05 22:50:59 dist-test-slave-gjrz krb5kdc[8180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970259, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:50:59.948216 8545 init.cc:377] Logged in from keytab as kudu/127.14.224.130@KRBTEST.COM (short username kudu)
I20260805 22:50:59.948691 8545 webserver.cc:460] Webserver started at http://127.14.224.130:36229/ using document root <none> and password file <none>
I20260805 22:50:59.948899 8545 fs_manager.cc:359] Metadata directory not provided
I20260805 22:50:59.948942 8545 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:50:59.949075 8545 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:50:59.950161 8545 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/minicluster-data/ts-1/data/instance:
uuid: "58fc56a3b2c6451a930e9e8f82cc3da9"
format_stamp: "Formatted at 2026-08-05 22:50:59 on dist-test-slave-gjrz"
server_key: "2aa1178b8a498552100423ea997d8b06"
server_key_iv: "c1a7746bd9562fbe5d2dd47a87a45897"
server_key_version: "encryptionkey@0"
I20260805 22:50:59.950495 8545 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/minicluster-data/ts-1/wal/instance:
uuid: "58fc56a3b2c6451a930e9e8f82cc3da9"
format_stamp: "Formatted at 2026-08-05 22:50:59 on dist-test-slave-gjrz"
server_key: "2aa1178b8a498552100423ea997d8b06"
server_key_iv: "c1a7746bd9562fbe5d2dd47a87a45897"
server_key_version: "encryptionkey@0"
I20260805 22:50:59.951851 8545 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260805 22:50:59.952569 8571 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:50:59.952728 8545 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260805 22:50:59.952819 8545 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/minicluster-data/ts-1/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/minicluster-data/ts-1/wal
uuid: "58fc56a3b2c6451a930e9e8f82cc3da9"
format_stamp: "Formatted at 2026-08-05 22:50:59 on dist-test-slave-gjrz"
server_key: "2aa1178b8a498552100423ea997d8b06"
server_key_iv: "c1a7746bd9562fbe5d2dd47a87a45897"
server_key_version: "encryptionkey@0"
I20260805 22:50:59.952890 8545 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:50:59.969977 8545 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:50:59.972205 8545 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:50:59.972327 8545 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:50:59.972568 8545 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:50:59.972875 8545 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:50:59.972916 8545 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:50:59.972947 8545 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:50:59.972970 8545 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:50:59.978688 8545 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.130:41611
I20260805 22:50:59.978741 8745 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.130:41611 every 8 connection(s)
I20260805 22:50:59.979065 8545 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
Aug 05 22:50:59 dist-test-slave-gjrz krb5kdc[8180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970259, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.130@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:50:59.986163 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 8545
I20260805 22:50:59.986266 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/minicluster-data/ts-1/wal/instance
I20260805 22:50:59.986477 15234 external_mini_cluster.cc:1428] Setting key 008b3da1a063af783a2e09c0b357a12c
I20260805 22:50:59.988978 8301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:59.979837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:59613 (local address 127.14.224.190:41525)
0805 22:50:59.979893 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0805 22:50:59.979895 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:50:59.980115 (+ 220us) server_negotiation.cc:407] Connection header received
0805 22:50:59.980573 (+ 458us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:50:59.980574 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:50:59.980586 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:50:59.980648 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:50:59.981652 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:50:59.982170 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:50:59.983221 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:50:59.983440 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:50:59.983495 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:50:59.985646 (+ 2151us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:50:59.985648 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:50:59.985648 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:50:59.985657 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:50:59.987643 (+ 1986us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:50:59.988077 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:50:59.988078 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:50:59.988078 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:50:59.988146 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:50:59.988368 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:50:59.988369 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:50:59.988370 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:50:59.988508 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:50:59.988573 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0805 22:50:59.988802 (+ 229us) server_negotiation.cc:299] Negotiation successful
0805 22:50:59.988886 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260805 22:50:59.989183 8751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:50:59.979806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:41525 (local address 127.14.224.130:59613)
0805 22:50:59.979962 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0805 22:50:59.980005 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0805 22:50:59.980487 (+ 482us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:50:59.980702 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:50:59.980706 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:50:59.981276 (+ 570us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:50:59.981545 (+ 269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:50:59.981552 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:50:59.982278 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:50:59.982280 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:50:59.983120 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:50:59.983123 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:50:59.983520 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:50:59.983520 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:50:59.983630 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:50:59.984145 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:50:59.984154 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:50:59.985549 (+ 1395us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:50:59.987723 (+ 2174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:50:59.987731 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:50:59.987733 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:50:59.988001 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:50:59.988206 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:50:59.988207 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:50:59.988207 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:50:59.988318 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:50:59.988563 (+ 245us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:50:59.988567 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:50:59.988689 (+ 122us) client_negotiation.cc:769] Sending connection context
0805 22:50:59.988771 (+ 82us) client_negotiation.cc:240] Negotiation successful
0805 22:50:59.988905 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":67,"threads_started":1}
I20260805 22:50:59.989635 8746 heartbeater.cc:347] Connected to a master server at 127.14.224.190:41525
I20260805 22:50:59.989734 8746 heartbeater.cc:464] Registering TS with master...
I20260805 22:50:59.989934 8746 heartbeater.cc:511] Master 127.14.224.190:41525 requested a full tablet report, sending...
I20260805 22:50:59.990360 8240 ts_manager.cc:194] Registered new tserver with Master: 58fc56a3b2c6451a930e9e8f82cc3da9 (127.14.224.130:41611)
I20260805 22:50:59.990753 8240 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.224.130@KRBTEST.COM'} at 127.14.224.130:59613
WARNING: no policy specified for kudu/127.14.224.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab.
Entry for principal kudu/127.14.224.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab.
I20260805 22:51:00.019146 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.131:0
--local_ip_for_outbound_sockets=127.14.224.131
--webserver_interface=127.14.224.131
--webserver_port=0
--tserver_master_addrs=127.14.224.190:41525
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab
--principal=kudu/127.14.224.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:40079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:51:00.104880 8756 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:51:00.105121 8756 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:51:00.105159 8756 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:51:00.106413 8756 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:51:00.106463 8756 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:51:00.106503 8756 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.131
I20260805 22:51:00.108238 8756 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:40079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab
--principal=kudu/127.14.224.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.224.131
--webserver_port=0
--tserver_master_addrs=127.14.224.190:41525
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8756
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.131
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:51:00.108510 8756 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:51:00.108752 8756 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:51:00.114125 8768 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:00.114087 8765 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:00.114140 8764 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:51:00.114231 8756 server_base.cc:1034] running on GCE node
I20260805 22:51:00.114568 8756 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:51:00.114817 8756 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:51:00.115959 8756 hybrid_clock.cc:648] HybridClock initialized: now 1785970260115947 us; error 29 us; skew 500 ppm
Aug 05 22:51:00 dist-test-slave-gjrz krb5kdc[8180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970260, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:51:00.118620 8756 init.cc:377] Logged in from keytab as kudu/127.14.224.131@KRBTEST.COM (short username kudu)
I20260805 22:51:00.119068 8756 webserver.cc:460] Webserver started at http://127.14.224.131:40293/ using document root <none> and password file <none>
I20260805 22:51:00.119328 8756 fs_manager.cc:359] Metadata directory not provided
I20260805 22:51:00.119378 8756 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:51:00.119495 8756 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:51:00.120553 8756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/minicluster-data/ts-2/data/instance:
uuid: "0da164da45894beabcea1177a4a1b31e"
format_stamp: "Formatted at 2026-08-05 22:51:00 on dist-test-slave-gjrz"
server_key: "de733c35fe7238f751a5bceefb596377"
server_key_iv: "cc23c1b9e249dd7bf7117e929e8790c8"
server_key_version: "encryptionkey@0"
I20260805 22:51:00.120872 8756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/minicluster-data/ts-2/wal/instance:
uuid: "0da164da45894beabcea1177a4a1b31e"
format_stamp: "Formatted at 2026-08-05 22:51:00 on dist-test-slave-gjrz"
server_key: "de733c35fe7238f751a5bceefb596377"
server_key_iv: "cc23c1b9e249dd7bf7117e929e8790c8"
server_key_version: "encryptionkey@0"
I20260805 22:51:00.122318 8756 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260805 22:51:00.123103 8778 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:00.123327 8756 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:51:00.123414 8756 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/minicluster-data/ts-2/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/minicluster-data/ts-2/wal
uuid: "0da164da45894beabcea1177a4a1b31e"
format_stamp: "Formatted at 2026-08-05 22:51:00 on dist-test-slave-gjrz"
server_key: "de733c35fe7238f751a5bceefb596377"
server_key_iv: "cc23c1b9e249dd7bf7117e929e8790c8"
server_key_version: "encryptionkey@0"
I20260805 22:51:00.123499 8756 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:51:00.134654 8756 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:51:00.136943 8756 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:51:00.137140 8756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:51:00.137398 8756 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:51:00.137741 8756 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:51:00.137778 8756 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:00.137809 8756 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:51:00.137828 8756 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:00.143949 8756 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.131:38715
I20260805 22:51:00.144006 8964 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.131:38715 every 8 connection(s)
I20260805 22:51:00.144351 8756 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
I20260805 22:51:00.145290 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 8756
I20260805 22:51:00.145402 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/minicluster-data/ts-2/wal/instance
I20260805 22:51:00.145628 15234 external_mini_cluster.cc:1428] Setting key f459161fd45812dd7b8f96c4d173495d
Aug 05 22:51:00 dist-test-slave-gjrz krb5kdc[8180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970260, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.131@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:51:00.155812 8301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:00.145074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:39475 (local address 127.14.224.190:41525)
0805 22:51:00.145147 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:00.145150 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:00.145403 (+ 253us) server_negotiation.cc:407] Connection header received
0805 22:51:00.146102 (+ 699us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:00.146103 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:00.146142 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:00.146192 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:00.147296 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:00.147815 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:00.148970 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:00.149245 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:00.149385 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:00.152643 (+ 3258us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:00.152645 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:00.152645 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:51:00.152657 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:00.154117 (+ 1460us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:00.154641 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:00.154642 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:00.154642 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:00.154706 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:00.154945 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:00.154946 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:00.154946 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:00.155095 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:00.155185 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:00.155631 (+ 446us) server_negotiation.cc:299] Negotiation successful
0805 22:51:00.155735 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260805 22:51:00.155999 8967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:00.145052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:41525 (local address 127.14.224.131:39475)
0805 22:51:00.145248 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:00.145303 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0805 22:51:00.145979 (+ 676us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:51:00.146273 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:51:00.146278 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:51:00.146962 (+ 684us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:51:00.147172 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:00.147177 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:00.147944 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:00.147945 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:00.148789 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:00.148792 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:00.149424 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:00.149425 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:00.149645 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:00.150270 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:51:00.150280 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:51:00.152475 (+ 2195us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:51:00.154258 (+ 1783us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:51:00.154268 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:51:00.154271 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:51:00.154557 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:51:00.154761 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:51:00.154762 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:51:00.154762 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:51:00.154868 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:51:00.155219 (+ 351us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:51:00.155227 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:51:00.155436 (+ 209us) client_negotiation.cc:769] Sending connection context
0805 22:51:00.155607 (+ 171us) client_negotiation.cc:240] Negotiation successful
0805 22:51:00.155772 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":101,"threads_started":1}
I20260805 22:51:00.156508 8965 heartbeater.cc:347] Connected to a master server at 127.14.224.190:41525
I20260805 22:51:00.156648 8965 heartbeater.cc:464] Registering TS with master...
I20260805 22:51:00.156874 8965 heartbeater.cc:511] Master 127.14.224.190:41525 requested a full tablet report, sending...
I20260805 22:51:00.157330 8239 ts_manager.cc:194] Registered new tserver with Master: 0da164da45894beabcea1177a4a1b31e (127.14.224.131:38715)
I20260805 22:51:00.157722 8239 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.224.131@KRBTEST.COM'} at 127.14.224.131:39475
I20260805 22:51:00.168424 15234 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 22:51:00.175745 8301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:00.169785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46336 (local address 127.14.224.190:41525)
0805 22:51:00.169843 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:00.169845 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:00.169989 (+ 144us) server_negotiation.cc:407] Connection header received
0805 22:51:00.170058 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:00.170060 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:00.170071 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:00.170128 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:00.170702 (+ 574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:00.171228 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:00.172022 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:00.172221 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:00.172280 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:00.173450 (+ 1170us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:00.173451 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:00.173452 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:51:00.173460 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:00.174566 (+ 1106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:00.174899 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:00.174900 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:00.174901 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:00.174957 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:00.175130 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:00.175131 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:00.175131 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:00.175345 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:00.175442 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:00.175559 (+ 117us) server_negotiation.cc:299] Negotiation successful
0805 22:51:00.175647 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260805 22:51:00.177385 8239 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46336:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:51:00.178964 8239 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:51:00.185834 8980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:00.181372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.130:41611 (local address 127.0.0.1:43834)
0805 22:51:00.181501 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:00.181545 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0805 22:51:00.181632 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:51:00.182259 (+ 627us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:51:00.182263 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:51:00.182266 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:51:00.182387 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:00.182390 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:00.183383 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:00.183384 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:00.184735 (+ 1351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:00.184738 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:00.185491 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:00.185492 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:00.185579 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:00.185596 (+ 17us) client_negotiation.cc:769] Sending connection context
0805 22:51:00.185664 (+ 68us) client_negotiation.cc:240] Negotiation successful
0805 22:51:00.185730 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":91,"mutex_wait_us":27,"thread_start_us":56,"threads_started":1}
I20260805 22:51:00.185834 8982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:00.181380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.129:46673 (local address 127.0.0.1:45310)
0805 22:51:00.181797 (+ 417us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:00.181807 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0805 22:51:00.181853 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:51:00.182266 (+ 413us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:51:00.182267 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:51:00.182269 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:51:00.182413 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:00.182414 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:00.183824 (+ 1410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:00.183825 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:00.184749 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:00.184752 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:00.185613 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:00.185614 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:00.185686 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:00.185689 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:51:00.185732 (+ 43us) client_negotiation.cc:240] Negotiation successful
0805 22:51:00.185762 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":385,"mutex_wait_us":8,"thread_start_us":97,"threads_started":1}
I20260805 22:51:00.185901 8988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:00.181722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45310 (local address 127.14.224.129:46673)
0805 22:51:00.181912 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:00.181917 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:00.181928 (+ 11us) server_negotiation.cc:407] Connection header received
0805 22:51:00.181972 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:00.181975 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:00.181991 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:00.182499 (+ 508us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:51:00.182576 (+ 77us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:00.183706 (+ 1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:00.184829 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:00.185539 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:00.185619 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:00.185671 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:00.185761 (+ 90us) server_negotiation.cc:299] Negotiation successful
0805 22:51:00.185810 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":91,"threads_started":1}
I20260805 22:51:00.186033 8981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:00.181563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.131:38715 (local address 127.0.0.1:51542)
0805 22:51:00.182025 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:00.182036 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:51:00.182079 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:51:00.182372 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:51:00.182373 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:51:00.182374 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:51:00.182407 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:00.182408 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:00.183809 (+ 1401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:00.183810 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:00.184920 (+ 1110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:00.184922 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:00.185806 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:00.185808 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:00.185874 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:00.185879 (+ 5us) client_negotiation.cc:769] Sending connection context
0805 22:51:00.185909 (+ 30us) client_negotiation.cc:240] Negotiation successful
0805 22:51:00.185949 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":440,"mutex_wait_us":22,"thread_start_us":79,"threads_started":1}
I20260805 22:51:00.186154 8987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:00.181567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43834 (local address 127.14.224.130:41611)
0805 22:51:00.181983 (+ 416us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:00.181988 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:00.181999 (+ 11us) server_negotiation.cc:407] Connection header received
0805 22:51:00.182040 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:00.182043 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:00.182109 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:00.182464 (+ 355us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:51:00.182528 (+ 64us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:00.183219 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:00.184845 (+ 1626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:00.185408 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:00.185482 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:00.185547 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:00.186001 (+ 454us) server_negotiation.cc:299] Negotiation successful
0805 22:51:00.186058 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":377,"thread_start_us":87,"threads_started":1}
I20260805 22:51:00.186635 8989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:00.182024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51542 (local address 127.14.224.131:38715)
0805 22:51:00.182212 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:00.182216 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:00.182225 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:51:00.182261 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:00.182263 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:00.182278 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:00.182476 (+ 198us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:51:00.182534 (+ 58us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:00.183682 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:00.185006 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:00.185711 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:00.186407 (+ 696us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:00.186476 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:00.186504 (+ 28us) server_negotiation.cc:299] Negotiation successful
0805 22:51:00.186555 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":114,"threads_started":1}
I20260805 22:51:00.186775 8439 tablet_service.cc:1467] Processing CreateTablet for tablet 35285ff5422f4d60a0c4adcfb9b46f34 (DEFAULT_TABLE table=test-table [id=d226fab36032462da3b5e91552248241]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:51:00.187129 8439 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35285ff5422f4d60a0c4adcfb9b46f34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:51:00.187695 8652 tablet_service.cc:1467] Processing CreateTablet for tablet 35285ff5422f4d60a0c4adcfb9b46f34 (DEFAULT_TABLE table=test-table [id=d226fab36032462da3b5e91552248241]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:51:00.188015 8652 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35285ff5422f4d60a0c4adcfb9b46f34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:51:00.189951 8994 tablet_bootstrap.cc:492] T 35285ff5422f4d60a0c4adcfb9b46f34 P fcc898c6cd1645a2b5ffa44debd33a34: Bootstrap starting.
I20260805 22:51:00.190677 8994 tablet_bootstrap.cc:654] T 35285ff5422f4d60a0c4adcfb9b46f34 P fcc898c6cd1645a2b5ffa44debd33a34: Neither blocks nor log segments found. Creating new log.
I20260805 22:51:00.190800 8995 tablet_bootstrap.cc:492] T 35285ff5422f4d60a0c4adcfb9b46f34 P 58fc56a3b2c6451a930e9e8f82cc3da9: Bootstrap starting.
I20260805 22:51:00.191540 8864 tablet_service.cc:1467] Processing CreateTablet for tablet 35285ff5422f4d60a0c4adcfb9b46f34 (DEFAULT_TABLE table=test-table [id=d226fab36032462da3b5e91552248241]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:51:00.191642 8995 tablet_bootstrap.cc:654] T 35285ff5422f4d60a0c4adcfb9b46f34 P 58fc56a3b2c6451a930e9e8f82cc3da9: Neither blocks nor log segments found. Creating new log.
I20260805 22:51:00.191892 8864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35285ff5422f4d60a0c4adcfb9b46f34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:51:00.192214 8994 log.cc:824] T 35285ff5422f4d60a0c4adcfb9b46f34 P fcc898c6cd1645a2b5ffa44debd33a34: Log is configured to *not* fsync() on all Append() calls
I20260805 22:51:00.192360 8995 log.cc:824] T 35285ff5422f4d60a0c4adcfb9b46f34 P 58fc56a3b2c6451a930e9e8f82cc3da9: Log is configured to *not* fsync() on all Append() calls
I20260805 22:51:00.193255 8994 tablet_bootstrap.cc:492] T 35285ff5422f4d60a0c4adcfb9b46f34 P fcc898c6cd1645a2b5ffa44debd33a34: No bootstrap required, opened a new log
I20260805 22:51:00.193341 8994 ts_tablet_manager.cc:1397] T 35285ff5422f4d60a0c4adcfb9b46f34 P fcc898c6cd1645a2b5ffa44debd33a34: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260805 22:51:00.193501 8995 tablet_bootstrap.cc:492] T 35285ff5422f4d60a0c4adcfb9b46f34 P 58fc56a3b2c6451a930e9e8f82cc3da9: No bootstrap required, opened a new log
I20260805 22:51:00.193573 8995 ts_tablet_manager.cc:1397] T 35285ff5422f4d60a0c4adcfb9b46f34 P 58fc56a3b2c6451a930e9e8f82cc3da9: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260805 22:51:00.195256 8994 raft_consensus.cc:348] T 35285ff5422f4d60a0c4adcfb9b46f34 P fcc898c6cd1645a2b5ffa44debd33a34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcc898c6cd1645a2b5ffa44debd33a34" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 46673 } } peers { permanent_uuid: "58fc56a3b2c6451a930e9e8f82cc3da9" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41611 } } peers { permanent_uuid: "0da164da45894beabcea1177a4a1b31e" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 38715 } }
I20260805 22:51:00.195462 8994 raft_consensus.cc:374] T 35285ff5422f4d60a0c4adcfb9b46f34 P fcc898c6cd1645a2b5ffa44debd33a34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:51:00.195485 8994 raft_consensus.cc:729] T 35285ff5422f4d60a0c4adcfb9b46f34 P fcc898c6cd1645a2b5ffa44debd33a34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcc898c6cd1645a2b5ffa44debd33a34, State: Initialized, Role: FOLLOWER
I20260805 22:51:00.195595 8994 consensus_queue.cc:260] T 35285ff5422f4d60a0c4adcfb9b46f34 P fcc898c6cd1645a2b5ffa44debd33a34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcc898c6cd1645a2b5ffa44debd33a34" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 46673 } } peers { permanent_uuid: "58fc56a3b2c6451a930e9e8f82cc3da9" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41611 } } peers { permanent_uuid: "0da164da45894beabcea1177a4a1b31e" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 38715 } }
I20260805 22:51:00.195904 8535 heartbeater.cc:503] Master 127.14.224.190:41525 was elected leader, sending a full tablet report...
I20260805 22:51:00.195969 8995 raft_consensus.cc:348] T 35285ff5422f4d60a0c4adcfb9b46f34 P 58fc56a3b2c6451a930e9e8f82cc3da9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcc898c6cd1645a2b5ffa44debd33a34" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 46673 } } peers { permanent_uuid: "58fc56a3b2c6451a930e9e8f82cc3da9" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41611 } } peers { permanent_uuid: "0da164da45894beabcea1177a4a1b31e" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 38715 } }
I20260805 22:51:00.196143 8995 raft_consensus.cc:374] T 35285ff5422f4d60a0c4adcfb9b46f34 P 58fc56a3b2c6451a930e9e8f82cc3da9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:51:00.196131 9001 tablet_bootstrap.cc:492] T 35285ff5422f4d60a0c4adcfb9b46f34 P 0da164da45894beabcea1177a4a1b31e: Bootstrap starting.
I20260805 22:51:00.196177 8995 raft_consensus.cc:729] T 35285ff5422f4d60a0c4adcfb9b46f34 P 58fc56a3b2c6451a930e9e8f82cc3da9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58fc56a3b2c6451a930e9e8f82cc3da9, State: Initialized, Role: FOLLOWER
I20260805 22:51:00.196286 8995 consensus_queue.cc:260] T 35285ff5422f4d60a0c4adcfb9b46f34 P 58fc56a3b2c6451a930e9e8f82cc3da9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcc898c6cd1645a2b5ffa44debd33a34" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 46673 } } peers { permanent_uuid: "58fc56a3b2c6451a930e9e8f82cc3da9" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41611 } } peers { permanent_uuid: "0da164da45894beabcea1177a4a1b31e" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 38715 } }
I20260805 22:51:00.196583 8995 ts_tablet_manager.cc:1428] T 35285ff5422f4d60a0c4adcfb9b46f34 P 58fc56a3b2c6451a930e9e8f82cc3da9: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260805 22:51:00.196617 8746 heartbeater.cc:503] Master 127.14.224.190:41525 was elected leader, sending a full tablet report...
I20260805 22:51:00.196723 8994 ts_tablet_manager.cc:1428] T 35285ff5422f4d60a0c4adcfb9b46f34 P fcc898c6cd1645a2b5ffa44debd33a34: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260805 22:51:00.197207 9001 tablet_bootstrap.cc:654] T 35285ff5422f4d60a0c4adcfb9b46f34 P 0da164da45894beabcea1177a4a1b31e: Neither blocks nor log segments found. Creating new log.
I20260805 22:51:00.197829 9001 log.cc:824] T 35285ff5422f4d60a0c4adcfb9b46f34 P 0da164da45894beabcea1177a4a1b31e: Log is configured to *not* fsync() on all Append() calls
I20260805 22:51:00.198920 9001 tablet_bootstrap.cc:492] T 35285ff5422f4d60a0c4adcfb9b46f34 P 0da164da45894beabcea1177a4a1b31e: No bootstrap required, opened a new log
I20260805 22:51:00.199035 9001 ts_tablet_manager.cc:1397] T 35285ff5422f4d60a0c4adcfb9b46f34 P 0da164da45894beabcea1177a4a1b31e: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260805 22:51:00.200773 9001 raft_consensus.cc:348] T 35285ff5422f4d60a0c4adcfb9b46f34 P 0da164da45894beabcea1177a4a1b31e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcc898c6cd1645a2b5ffa44debd33a34" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 46673 } } peers { permanent_uuid: "58fc56a3b2c6451a930e9e8f82cc3da9" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41611 } } peers { permanent_uuid: "0da164da45894beabcea1177a4a1b31e" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 38715 } }
I20260805 22:51:00.200960 9001 raft_consensus.cc:374] T 35285ff5422f4d60a0c4adcfb9b46f34 P 0da164da45894beabcea1177a4a1b31e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:51:00.200994 9001 raft_consensus.cc:729] T 35285ff5422f4d60a0c4adcfb9b46f34 P 0da164da45894beabcea1177a4a1b31e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0da164da45894beabcea1177a4a1b31e, State: Initialized, Role: FOLLOWER
I20260805 22:51:00.201128 9001 consensus_queue.cc:260] T 35285ff5422f4d60a0c4adcfb9b46f34 P 0da164da45894beabcea1177a4a1b31e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcc898c6cd1645a2b5ffa44debd33a34" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 46673 } } peers { permanent_uuid: "58fc56a3b2c6451a930e9e8f82cc3da9" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41611 } } peers { permanent_uuid: "0da164da45894beabcea1177a4a1b31e" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 38715 } }
I20260805 22:51:00.201452 9001 ts_tablet_manager.cc:1428] T 35285ff5422f4d60a0c4adcfb9b46f34 P 0da164da45894beabcea1177a4a1b31e: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260805 22:51:00.201503 8965 heartbeater.cc:503] Master 127.14.224.190:41525 was elected leader, sending a full tablet report...
W20260805 22:51:00.229645 8748 tablet.cc:2369] T 35285ff5422f4d60a0c4adcfb9b46f34 P 58fc56a3b2c6451a930e9e8f82cc3da9: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260805 22:51:00.320581 8536 tablet.cc:2369] T 35285ff5422f4d60a0c4adcfb9b46f34 P fcc898c6cd1645a2b5ffa44debd33a34: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:51:00.349205 9007 raft_consensus.cc:482] T 35285ff5422f4d60a0c4adcfb9b46f34 P 0da164da45894beabcea1177a4a1b31e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:51:00.349368 9007 raft_consensus.cc:504] T 35285ff5422f4d60a0c4adcfb9b46f34 P 0da164da45894beabcea1177a4a1b31e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcc898c6cd1645a2b5ffa44debd33a34" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 46673 } } peers { permanent_uuid: "58fc56a3b2c6451a930e9e8f82cc3da9" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41611 } } peers { permanent_uuid: "0da164da45894beabcea1177a4a1b31e" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 38715 } }
I20260805 22:51:00.349776 9007 leader_election.cc:288] T 35285ff5422f4d60a0c4adcfb9b46f34 P 0da164da45894beabcea1177a4a1b31e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcc898c6cd1645a2b5ffa44debd33a34 (127.14.224.129:46673), 58fc56a3b2c6451a930e9e8f82cc3da9 (127.14.224.130:41611)
I20260805 22:51:00.354166 8967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:00.349990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.129:46673 (local address 127.14.224.131:37391)
0805 22:51:00.350049 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:00.350063 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0805 22:51:00.350113 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:51:00.350302 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:51:00.350304 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:51:00.350306 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:51:00.350384 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:00.350387 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:00.351355 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:00.351355 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:00.352705 (+ 1350us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:00.352709 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:00.353851 (+ 1142us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:00.353852 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:00.353948 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:00.353950 (+ 2us) client_negotiation.cc:769] Sending connection context
0805 22:51:00.354007 (+ 57us) client_negotiation.cc:240] Negotiation successful
0805 22:51:00.354058 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34,"mutex_wait_us":59}
I20260805 22:51:00.354192 8987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:00.350072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:51037 (local address 127.14.224.130:41611)
0805 22:51:00.350165 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:00.350167 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:00.350344 (+ 177us) server_negotiation.cc:407] Connection header received
0805 22:51:00.350382 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:00.350383 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:00.350392 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:00.350435 (+ 43us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:51:00.350558 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:00.351241 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:00.352914 (+ 1673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:00.353739 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:00.353833 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:00.353844 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:00.354056 (+ 212us) server_negotiation.cc:299] Negotiation successful
0805 22:51:00.354115 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260805 22:51:00.354192 8988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:00.350073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:37391 (local address 127.14.224.129:46673)
0805 22:51:00.350147 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:00.350149 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:00.350164 (+ 15us) server_negotiation.cc:407] Connection header received
0805 22:51:00.350199 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:00.350200 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:00.350214 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:00.350275 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:51:00.350453 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:00.351213 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:00.352913 (+ 1700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:00.353738 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:00.353832 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:00.353844 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:00.354056 (+ 212us) server_negotiation.cc:299] Negotiation successful
0805 22:51:00.354115 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260805 22:51:00.354171 9009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:00.349996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.130:41611 (local address 127.14.224.131:51037)
0805 22:51:00.350262 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:00.350273 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:51:00.350332 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:51:00.350449 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:51:00.350449 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:51:00.350451 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:51:00.350505 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:00.350506 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:00.351353 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:00.351354 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:00.352705 (+ 1351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:00.352709 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:00.353851 (+ 1142us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:00.353852 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:00.353943 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:00.353948 (+ 5us) client_negotiation.cc:769] Sending connection context
0805 22:51:00.354007 (+ 59us) client_negotiation.cc:240] Negotiation successful
0805 22:51:00.354057 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"mutex_wait_us":129,"thread_start_us":113,"threads_started":1}
I20260805 22:51:00.354583 8467 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35285ff5422f4d60a0c4adcfb9b46f34" candidate_uuid: "0da164da45894beabcea1177a4a1b31e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcc898c6cd1645a2b5ffa44debd33a34" is_pre_election: true
I20260805 22:51:00.354594 8677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35285ff5422f4d60a0c4adcfb9b46f34" candidate_uuid: "0da164da45894beabcea1177a4a1b31e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58fc56a3b2c6451a930e9e8f82cc3da9" is_pre_election: true
I20260805 22:51:00.354758 8467 raft_consensus.cc:2454] T 35285ff5422f4d60a0c4adcfb9b46f34 P fcc898c6cd1645a2b5ffa44debd33a34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0da164da45894beabcea1177a4a1b31e in term 0.
I20260805 22:51:00.354758 8677 raft_consensus.cc:2454] T 35285ff5422f4d60a0c4adcfb9b46f34 P 58fc56a3b2c6451a930e9e8f82cc3da9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0da164da45894beabcea1177a4a1b31e in term 0.
I20260805 22:51:00.355021 8781 leader_election.cc:302] T 35285ff5422f4d60a0c4adcfb9b46f34 P 0da164da45894beabcea1177a4a1b31e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0da164da45894beabcea1177a4a1b31e, fcc898c6cd1645a2b5ffa44debd33a34; no voters:
I20260805 22:51:00.355181 9007 raft_consensus.cc:2781] T 35285ff5422f4d60a0c4adcfb9b46f34 P 0da164da45894beabcea1177a4a1b31e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:51:00.355237 9007 raft_consensus.cc:482] T 35285ff5422f4d60a0c4adcfb9b46f34 P 0da164da45894beabcea1177a4a1b31e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:51:00.355280 9007 raft_consensus.cc:3037] T 35285ff5422f4d60a0c4adcfb9b46f34 P 0da164da45894beabcea1177a4a1b31e [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:51:00.356101 9007 raft_consensus.cc:504] T 35285ff5422f4d60a0c4adcfb9b46f34 P 0da164da45894beabcea1177a4a1b31e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcc898c6cd1645a2b5ffa44debd33a34" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 46673 } } peers { permanent_uuid: "58fc56a3b2c6451a930e9e8f82cc3da9" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41611 } } peers { permanent_uuid: "0da164da45894beabcea1177a4a1b31e" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 38715 } }
I20260805 22:51:00.356253 9007 leader_election.cc:288] T 35285ff5422f4d60a0c4adcfb9b46f34 P 0da164da45894beabcea1177a4a1b31e [CANDIDATE]: Term 1 election: Requested vote from peers fcc898c6cd1645a2b5ffa44debd33a34 (127.14.224.129:46673), 58fc56a3b2c6451a930e9e8f82cc3da9 (127.14.224.130:41611)
I20260805 22:51:00.356444 8467 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35285ff5422f4d60a0c4adcfb9b46f34" candidate_uuid: "0da164da45894beabcea1177a4a1b31e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcc898c6cd1645a2b5ffa44debd33a34"
I20260805 22:51:00.356444 8677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35285ff5422f4d60a0c4adcfb9b46f34" candidate_uuid: "0da164da45894beabcea1177a4a1b31e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58fc56a3b2c6451a930e9e8f82cc3da9"
I20260805 22:51:00.356525 8467 raft_consensus.cc:3037] T 35285ff5422f4d60a0c4adcfb9b46f34 P fcc898c6cd1645a2b5ffa44debd33a34 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:51:00.356527 8677 raft_consensus.cc:3037] T 35285ff5422f4d60a0c4adcfb9b46f34 P 58fc56a3b2c6451a930e9e8f82cc3da9 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:51:00.357262 8467 raft_consensus.cc:2454] T 35285ff5422f4d60a0c4adcfb9b46f34 P fcc898c6cd1645a2b5ffa44debd33a34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0da164da45894beabcea1177a4a1b31e in term 1.
I20260805 22:51:00.357296 8677 raft_consensus.cc:2454] T 35285ff5422f4d60a0c4adcfb9b46f34 P 58fc56a3b2c6451a930e9e8f82cc3da9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0da164da45894beabcea1177a4a1b31e in term 1.
I20260805 22:51:00.357455 8781 leader_election.cc:302] T 35285ff5422f4d60a0c4adcfb9b46f34 P 0da164da45894beabcea1177a4a1b31e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0da164da45894beabcea1177a4a1b31e, fcc898c6cd1645a2b5ffa44debd33a34; no voters:
I20260805 22:51:00.357581 9007 raft_consensus.cc:2781] T 35285ff5422f4d60a0c4adcfb9b46f34 P 0da164da45894beabcea1177a4a1b31e [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:51:00.357748 9007 raft_consensus.cc:686] T 35285ff5422f4d60a0c4adcfb9b46f34 P 0da164da45894beabcea1177a4a1b31e [term 1 LEADER]: Becoming Leader. State: Replica: 0da164da45894beabcea1177a4a1b31e, State: Running, Role: LEADER
I20260805 22:51:00.357836 9007 consensus_queue.cc:237] T 35285ff5422f4d60a0c4adcfb9b46f34 P 0da164da45894beabcea1177a4a1b31e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcc898c6cd1645a2b5ffa44debd33a34" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 46673 } } peers { permanent_uuid: "58fc56a3b2c6451a930e9e8f82cc3da9" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41611 } } peers { permanent_uuid: "0da164da45894beabcea1177a4a1b31e" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 38715 } }
I20260805 22:51:00.358698 8240 catalog_manager.cc:5495] T 35285ff5422f4d60a0c4adcfb9b46f34 P 0da164da45894beabcea1177a4a1b31e reported cstate change: term changed from 0 to 1, leader changed from <none> to 0da164da45894beabcea1177a4a1b31e (127.14.224.131). New cstate: current_term: 1 leader_uuid: "0da164da45894beabcea1177a4a1b31e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcc898c6cd1645a2b5ffa44debd33a34" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 46673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58fc56a3b2c6451a930e9e8f82cc3da9" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0da164da45894beabcea1177a4a1b31e" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 38715 } health_report { overall_health: HEALTHY } } }
I20260805 22:51:00.371634 8989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:00.369174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51544 (local address 127.14.224.131:38715)
0805 22:51:00.369228 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:00.369231 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:00.369240 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:51:00.369316 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:00.369317 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:00.369335 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:00.369398 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:51:00.369535 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:00.370047 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:00.370828 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:00.371023 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:00.371083 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:00.371228 (+ 145us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:51:00.371382 (+ 154us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:51:00.371464 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:00.371502 (+ 38us) server_negotiation.cc:299] Negotiation successful
0805 22:51:00.371527 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260805 22:51:00.373462 8677 raft_consensus.cc:1261] T 35285ff5422f4d60a0c4adcfb9b46f34 P 58fc56a3b2c6451a930e9e8f82cc3da9 [term 1 FOLLOWER]: Refusing update from remote peer 0da164da45894beabcea1177a4a1b31e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:51:00.373461 8467 raft_consensus.cc:1261] T 35285ff5422f4d60a0c4adcfb9b46f34 P fcc898c6cd1645a2b5ffa44debd33a34 [term 1 FOLLOWER]: Refusing update from remote peer 0da164da45894beabcea1177a4a1b31e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:51:00.373812 9010 consensus_queue.cc:1035] T 35285ff5422f4d60a0c4adcfb9b46f34 P 0da164da45894beabcea1177a4a1b31e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcc898c6cd1645a2b5ffa44debd33a34" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 46673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:51:00.373934 9007 consensus_queue.cc:1035] T 35285ff5422f4d60a0c4adcfb9b46f34 P 0da164da45894beabcea1177a4a1b31e [LEADER]: Connected to new peer: Peer: permanent_uuid: "58fc56a3b2c6451a930e9e8f82cc3da9" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:51:00.376490 9017 mvcc.cc:205] Tried to move back new op lower bound from 7315334186487058432 to 7315334186426441728. Current Snapshot: MvccSnapshot[applied={T|T < 7315334186487058432}]
I20260805 22:51:00.377112 9019 mvcc.cc:205] Tried to move back new op lower bound from 7315334186487058432 to 7315334186426441728. Current Snapshot: MvccSnapshot[applied={T|T < 7315334186487058432}]
I20260805 22:51:00.377231 9022 mvcc.cc:205] Tried to move back new op lower bound from 7315334186487058432 to 7315334186426441728. Current Snapshot: MvccSnapshot[applied={T|T < 7315334186487058432}]
I20260805 22:51:00.378927 8238 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46336:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:51:00.379026 8238 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46336:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:51:00.379878 8238 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a27428688b0a4679bfed64775b4a39fc: Sending DeleteTablet for 3 replicas of tablet 35285ff5422f4d60a0c4adcfb9b46f34
I20260805 22:51:00.380256 8652 tablet_service.cc:1514] Processing DeleteTablet for tablet 35285ff5422f4d60a0c4adcfb9b46f34 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:51:00 UTC) from {username='kudu', principal='kudu/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:43834
I20260805 22:51:00.380271 8439 tablet_service.cc:1514] Processing DeleteTablet for tablet 35285ff5422f4d60a0c4adcfb9b46f34 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:51:00 UTC) from {username='kudu', principal='kudu/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:45310
I20260805 22:51:00.380296 8864 tablet_service.cc:1514] Processing DeleteTablet for tablet 35285ff5422f4d60a0c4adcfb9b46f34 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:51:00 UTC) from {username='kudu', principal='kudu/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:51542
I20260805 22:51:00.380681 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 8340
I20260805 22:51:00.380716 9035 tablet_replica.cc:330] T 35285ff5422f4d60a0c4adcfb9b46f34 P 58fc56a3b2c6451a930e9e8f82cc3da9: stopping tablet replica
I20260805 22:51:00.416241 9035 raft_consensus.cc:2229] T 35285ff5422f4d60a0c4adcfb9b46f34 P 58fc56a3b2c6451a930e9e8f82cc3da9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:51:00.416486 9035 raft_consensus.cc:2258] T 35285ff5422f4d60a0c4adcfb9b46f34 P 58fc56a3b2c6451a930e9e8f82cc3da9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:51:00.416801 9033 tablet_replica.cc:330] T 35285ff5422f4d60a0c4adcfb9b46f34 P 0da164da45894beabcea1177a4a1b31e: stopping tablet replica
I20260805 22:51:00.417498 9033 raft_consensus.cc:2229] T 35285ff5422f4d60a0c4adcfb9b46f34 P 0da164da45894beabcea1177a4a1b31e [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:51:00.417651 9035 ts_tablet_manager.cc:1905] T 35285ff5422f4d60a0c4adcfb9b46f34 P 58fc56a3b2c6451a930e9e8f82cc3da9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:51:00.417737 9033 raft_consensus.cc:2258] T 35285ff5422f4d60a0c4adcfb9b46f34 P 0da164da45894beabcea1177a4a1b31e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:51:00.418244 9033 ts_tablet_manager.cc:1905] T 35285ff5422f4d60a0c4adcfb9b46f34 P 0da164da45894beabcea1177a4a1b31e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:51:00.419591 9035 ts_tablet_manager.cc:1918] T 35285ff5422f4d60a0c4adcfb9b46f34 P 58fc56a3b2c6451a930e9e8f82cc3da9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:51:00.419745 9035 log.cc:1196] T 35285ff5422f4d60a0c4adcfb9b46f34 P 58fc56a3b2c6451a930e9e8f82cc3da9: Deleting WAL directory at /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/minicluster-data/ts-1/wal/wals/35285ff5422f4d60a0c4adcfb9b46f34
I20260805 22:51:00.419951 9033 ts_tablet_manager.cc:1918] T 35285ff5422f4d60a0c4adcfb9b46f34 P 0da164da45894beabcea1177a4a1b31e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:51:00.420087 9035 ts_tablet_manager.cc:1939] T 35285ff5422f4d60a0c4adcfb9b46f34 P 58fc56a3b2c6451a930e9e8f82cc3da9: Deleting consensus metadata
I20260805 22:51:00.420117 9033 log.cc:1196] T 35285ff5422f4d60a0c4adcfb9b46f34 P 0da164da45894beabcea1177a4a1b31e: Deleting WAL directory at /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970021300824-15234-0/minicluster-data/ts-2/wal/wals/35285ff5422f4d60a0c4adcfb9b46f34
I20260805 22:51:00.420411 9033 ts_tablet_manager.cc:1939] T 35285ff5422f4d60a0c4adcfb9b46f34 P 0da164da45894beabcea1177a4a1b31e: Deleting consensus metadata
I20260805 22:51:00.420704 8225 catalog_manager.cc:4841] TS 58fc56a3b2c6451a930e9e8f82cc3da9 (127.14.224.130:41611): tablet 35285ff5422f4d60a0c4adcfb9b46f34 (table test-table [id=d226fab36032462da3b5e91552248241]) successfully deleted
I20260805 22:51:00.420899 8225 catalog_manager.cc:4841] TS 0da164da45894beabcea1177a4a1b31e (127.14.224.131:38715): tablet 35285ff5422f4d60a0c4adcfb9b46f34 (table test-table [id=d226fab36032462da3b5e91552248241]) successfully deleted
W20260805 22:51:00.421638 8223 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.224.129:46673 (error 108)
I20260805 22:51:00.422216 8981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:00.422078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.129:46673 (local address 127.0.0.1:45322)
0805 22:51:00.422134 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:00.422179 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.129:46673: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260805 22:51:00.422291 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 8545
W20260805 22:51:00.431577 8223 catalog_manager.cc:4584] TS fcc898c6cd1645a2b5ffa44debd33a34 (127.14.224.129:46673): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 35285ff5422f4d60a0c4adcfb9b46f34: Network error: Client connection negotiation failed: client connection to 127.14.224.129:46673: connect: Connection refused (error 111)
I20260805 22:51:00.437032 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 8756
I20260805 22:51:00.449499 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 8199
2026-08-05T22:51:00Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2276 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-05T22:51:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:51:00Z Disabled control of system clock
I20260805 22:51:00.484190 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970021300824-15234-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970021300824-15234-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970021300824-15234-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:37037
--webserver_interface=127.14.224.190
--webserver_port=0
--builtin_ntp_servers=127.14.224.148:33415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.224.190:37037
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260805 22:51:00.569384 9043 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:51:00.569634 9043 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:51:00.569657 9043 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:51:00.570873 9043 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:51:00.570923 9043 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:51:00.570935 9043 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:51:00.570946 9043 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:51:00.570971 9043 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:51:00.572460 9043 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:33415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970021300824-15234-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970021300824-15234-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.224.190:37037
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:37037
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.224.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9043
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970021300824-15234-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:51:00.572734 9043 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:51:00.573061 9043 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260805 22:51:00.578045 9043 server_base.cc:1034] running on GCE node
W20260805 22:51:00.578004 9054 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:00.578001 9048 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:00.578004 9049 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:51:00.578589 9043 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:51:00.578909 9043 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:51:00.580061 9043 hybrid_clock.cc:648] HybridClock initialized: now 1785970260580048 us; error 33 us; skew 500 ppm
I20260805 22:51:00.581450 9043 webserver.cc:460] Webserver started at http://127.14.224.190:45947/ using document root <none> and password file <none>
I20260805 22:51:00.581719 9043 fs_manager.cc:359] Metadata directory not provided
I20260805 22:51:00.581772 9043 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:51:00.581926 9043 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:51:00.583081 9043 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970021300824-15234-0/minicluster-data/master-0/data/instance:
uuid: "cccbc3bd376243fca10f5b55b9a0aac0"
format_stamp: "Formatted at 2026-08-05 22:51:00 on dist-test-slave-gjrz"
server_key: "0a1a54408dd56cb77ef4270a2ed459ef"
server_key_iv: "42d8abbeeb37e3cbea407740f523901e"
server_key_version: "encryptionkey@0"
I20260805 22:51:00.583470 9043 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970021300824-15234-0/minicluster-data/master-0/wal/instance:
uuid: "cccbc3bd376243fca10f5b55b9a0aac0"
format_stamp: "Formatted at 2026-08-05 22:51:00 on dist-test-slave-gjrz"
server_key: "0a1a54408dd56cb77ef4270a2ed459ef"
server_key_iv: "42d8abbeeb37e3cbea407740f523901e"
server_key_version: "encryptionkey@0"
I20260805 22:51:00.584856 9043 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:51:00.585660 9061 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:00.585825 9043 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:51:00.585915 9043 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970021300824-15234-0/minicluster-data/master-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970021300824-15234-0/minicluster-data/master-0/wal
uuid: "cccbc3bd376243fca10f5b55b9a0aac0"
format_stamp: "Formatted at 2026-08-05 22:51:00 on dist-test-slave-gjrz"
server_key: "0a1a54408dd56cb77ef4270a2ed459ef"
server_key_iv: "42d8abbeeb37e3cbea407740f523901e"
server_key_version: "encryptionkey@0"
I20260805 22:51:00.585984 9043 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970021300824-15234-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970021300824-15234-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970021300824-15234-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:51:00.605563 9043 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:51:00.605906 9043 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:51:00.606047 9043 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:51:00.610103 9043 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.190:37037
I20260805 22:51:00.610143 9142 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.190:37037 every 8 connection(s)
I20260805 22:51:00.610498 9043 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
I20260805 22:51:00.611516 9143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:51:00.613838 9143 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cccbc3bd376243fca10f5b55b9a0aac0: Bootstrap starting.
I20260805 22:51:00.614535 9143 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cccbc3bd376243fca10f5b55b9a0aac0: Neither blocks nor log segments found. Creating new log.
I20260805 22:51:00.614796 9143 log.cc:824] T 00000000000000000000000000000000 P cccbc3bd376243fca10f5b55b9a0aac0: Log is configured to *not* fsync() on all Append() calls
I20260805 22:51:00.615571 9143 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cccbc3bd376243fca10f5b55b9a0aac0: No bootstrap required, opened a new log
I20260805 22:51:00.617216 9143 raft_consensus.cc:348] T 00000000000000000000000000000000 P cccbc3bd376243fca10f5b55b9a0aac0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cccbc3bd376243fca10f5b55b9a0aac0" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 37037 } }
I20260805 22:51:00.617362 9143 raft_consensus.cc:374] T 00000000000000000000000000000000 P cccbc3bd376243fca10f5b55b9a0aac0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:51:00.617385 9143 raft_consensus.cc:729] T 00000000000000000000000000000000 P cccbc3bd376243fca10f5b55b9a0aac0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cccbc3bd376243fca10f5b55b9a0aac0, State: Initialized, Role: FOLLOWER
I20260805 22:51:00.617501 9143 consensus_queue.cc:260] T 00000000000000000000000000000000 P cccbc3bd376243fca10f5b55b9a0aac0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cccbc3bd376243fca10f5b55b9a0aac0" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 37037 } }
I20260805 22:51:00.617576 9143 raft_consensus.cc:388] T 00000000000000000000000000000000 P cccbc3bd376243fca10f5b55b9a0aac0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:51:00.617604 9143 raft_consensus.cc:482] T 00000000000000000000000000000000 P cccbc3bd376243fca10f5b55b9a0aac0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:51:00.617640 9143 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cccbc3bd376243fca10f5b55b9a0aac0 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:51:00.618156 9143 raft_consensus.cc:504] T 00000000000000000000000000000000 P cccbc3bd376243fca10f5b55b9a0aac0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cccbc3bd376243fca10f5b55b9a0aac0" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 37037 } }
I20260805 22:51:00.618242 9143 leader_election.cc:302] T 00000000000000000000000000000000 P cccbc3bd376243fca10f5b55b9a0aac0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cccbc3bd376243fca10f5b55b9a0aac0; no voters:
I20260805 22:51:00.618379 9143 leader_election.cc:288] T 00000000000000000000000000000000 P cccbc3bd376243fca10f5b55b9a0aac0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:51:00.618460 9151 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cccbc3bd376243fca10f5b55b9a0aac0 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:51:00.618656 9151 raft_consensus.cc:686] T 00000000000000000000000000000000 P cccbc3bd376243fca10f5b55b9a0aac0 [term 1 LEADER]: Becoming Leader. State: Replica: cccbc3bd376243fca10f5b55b9a0aac0, State: Running, Role: LEADER
I20260805 22:51:00.618655 9143 sys_catalog.cc:564] T 00000000000000000000000000000000 P cccbc3bd376243fca10f5b55b9a0aac0 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:51:00.618829 9151 consensus_queue.cc:237] T 00000000000000000000000000000000 P cccbc3bd376243fca10f5b55b9a0aac0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cccbc3bd376243fca10f5b55b9a0aac0" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 37037 } }
I20260805 22:51:00.619239 9153 sys_catalog.cc:455] T 00000000000000000000000000000000 P cccbc3bd376243fca10f5b55b9a0aac0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cccbc3bd376243fca10f5b55b9a0aac0. Latest consensus state: current_term: 1 leader_uuid: "cccbc3bd376243fca10f5b55b9a0aac0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cccbc3bd376243fca10f5b55b9a0aac0" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 37037 } } }
I20260805 22:51:00.619345 9152 sys_catalog.cc:455] T 00000000000000000000000000000000 P cccbc3bd376243fca10f5b55b9a0aac0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cccbc3bd376243fca10f5b55b9a0aac0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cccbc3bd376243fca10f5b55b9a0aac0" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 37037 } } }
I20260805 22:51:00.619423 9153 sys_catalog.cc:458] T 00000000000000000000000000000000 P cccbc3bd376243fca10f5b55b9a0aac0 [sys.catalog]: This master's current role is: LEADER
I20260805 22:51:00.619489 9152 sys_catalog.cc:458] T 00000000000000000000000000000000 P cccbc3bd376243fca10f5b55b9a0aac0 [sys.catalog]: This master's current role is: LEADER
I20260805 22:51:00.619594 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 9043
I20260805 22:51:00.619697 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970021300824-15234-0/minicluster-data/master-0/wal/instance
I20260805 22:51:00.619879 9161 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:51:00.619906 15234 external_mini_cluster.cc:1428] Setting key 20307e6aa7ff469d54de0d2004fe73c5
I20260805 22:51:00.620415 9161 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:51:00.622031 9161 catalog_manager.cc:1347] Generated new cluster ID: 301ee5c2fd29486281ff0ec12a03ce01
I20260805 22:51:00.622079 9161 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:51:00.629212 9167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:00.620380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53658 (local address 127.14.224.190:37037)
0805 22:51:00.623451 (+ 3071us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:00.623460 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:00.623497 (+ 37us) server_negotiation.cc:407] Connection header received
0805 22:51:00.623626 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:00.623633 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:00.623701 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:00.623840 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:00.624093 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:00.625504 (+ 1411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:00.626689 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:00.627380 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:00.627501 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:00.628288 (+ 787us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:00.628293 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:00.628293 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:51:00.628544 (+ 251us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:00.628589 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:51:00.628604 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:00.628658 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:00.628879 (+ 221us) server_negotiation.cc:299] Negotiation successful
0805 22:51:00.628977 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2987,"thread_start_us":82,"threads_started":1}
I20260805 22:51:00.632464 9161 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:51:00.632973 9161 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:51:00.635218 9161 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cccbc3bd376243fca10f5b55b9a0aac0: Generated new TSK 0
I20260805 22:51:00.635443 9161 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:51:00.641001 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970021300824-15234-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970021300824-15234-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970021300824-15234-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.129:0
--local_ip_for_outbound_sockets=127.14.224.129
--webserver_interface=127.14.224.129
--webserver_port=0
--tserver_master_addrs=127.14.224.190:37037
--builtin_ntp_servers=127.14.224.148:33415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260805 22:51:00.728416 9182 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:51:00.728768 9182 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:51:00.728824 9182 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:51:00.730155 9182 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:51:00.730209 9182 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:51:00.730237 9182 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.129
I20260805 22:51:00.731802 9182 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:33415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970021300824-15234-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970021300824-15234-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.224.129
--webserver_port=0
--tserver_master_addrs=127.14.224.190:37037
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9182
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.129
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970021300824-15234-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:51:00.732084 9182 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:51:00.732411 9182 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:51:00.738284 9192 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:00.738284 9194 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:51:00.738404 9182 server_base.cc:1034] running on GCE node
W20260805 22:51:00.738529 9191 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:51:00.738778 9182 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:51:00.739104 9182 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:51:00.740274 9182 hybrid_clock.cc:648] HybridClock initialized: now 1785970260740256 us; error 34 us; skew 500 ppm
I20260805 22:51:00.741704 9182 webserver.cc:460] Webserver started at http://127.14.224.129:44267/ using document root <none> and password file <none>
I20260805 22:51:00.741976 9182 fs_manager.cc:359] Metadata directory not provided
I20260805 22:51:00.742026 9182 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:51:00.742151 9182 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:51:00.743324 9182 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970021300824-15234-0/minicluster-data/ts-0/data/instance:
uuid: "17279a821fe24203b2521b6304409ca9"
format_stamp: "Formatted at 2026-08-05 22:51:00 on dist-test-slave-gjrz"
server_key: "cc08e047ab08c07bf1c51fb1ad70698a"
server_key_iv: "09ce0b4171be2273a91ba927920b4888"
server_key_version: "encryptionkey@0"
I20260805 22:51:00.743681 9182 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970021300824-15234-0/minicluster-data/ts-0/wal/instance:
uuid: "17279a821fe24203b2521b6304409ca9"
format_stamp: "Formatted at 2026-08-05 22:51:00 on dist-test-slave-gjrz"
server_key: "cc08e047ab08c07bf1c51fb1ad70698a"
server_key_iv: "09ce0b4171be2273a91ba927920b4888"
server_key_version: "encryptionkey@0"
I20260805 22:51:00.745007 9182 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:51:00.745774 9203 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:00.745945 9182 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:51:00.746037 9182 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970021300824-15234-0/minicluster-data/ts-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970021300824-15234-0/minicluster-data/ts-0/wal
uuid: "17279a821fe24203b2521b6304409ca9"
format_stamp: "Formatted at 2026-08-05 22:51:00 on dist-test-slave-gjrz"
server_key: "cc08e047ab08c07bf1c51fb1ad70698a"
server_key_iv: "09ce0b4171be2273a91ba927920b4888"
server_key_version: "encryptionkey@0"
I20260805 22:51:00.746104 9182 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970021300824-15234-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970021300824-15234-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970021300824-15234-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:51:00.786644 9182 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:51:00.786983 9182 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:51:00.787127 9182 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:51:00.787418 9182 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:51:00.787768 9182 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:51:00.787804 9182 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:00.787835 9182 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:51:00.787859 9182 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:00.793659 9182 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.129:35481
I20260805 22:51:00.793713 9388 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.129:35481 every 8 connection(s)
I20260805 22:51:00.794111 9182 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
I20260805 22:51:00.797462 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 9182
I20260805 22:51:00.797571 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970021300824-15234-0/minicluster-data/ts-0/wal/instance
I20260805 22:51:00.797776 15234 external_mini_cluster.cc:1428] Setting key e622ca6d8122ea51dbef359b875a43a0
I20260805 22:51:00.798815 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970021300824-15234-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970021300824-15234-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970021300824-15234-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.130:0
--local_ip_for_outbound_sockets=127.14.224.130
--webserver_interface=127.14.224.130
--webserver_port=0
--tserver_master_addrs=127.14.224.190:37037
--builtin_ntp_servers=127.14.224.148:33415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260805 22:51:00.800067 9167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:00.794893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.129:48645 (local address 127.14.224.190:37037)
0805 22:51:00.794990 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:00.794992 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:00.795198 (+ 206us) server_negotiation.cc:407] Connection header received
0805 22:51:00.795776 (+ 578us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:00.795777 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:00.795790 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:00.795861 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:00.796586 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:00.797128 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:00.798516 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:00.798752 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:00.798811 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:00.799799 (+ 988us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:00.799801 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:00.799801 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:51:00.799806 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:00.799823 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:51:00.799828 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:00.799873 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:00.799974 (+ 101us) server_negotiation.cc:299] Negotiation successful
0805 22:51:00.800004 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260805 22:51:00.800320 9393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:00.794878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:37037 (local address 127.14.224.129:48645)
0805 22:51:00.795075 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:00.795121 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0805 22:51:00.795671 (+ 550us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:51:00.795928 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:51:00.795931 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:51:00.795940 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:51:00.796472 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:00.796477 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:00.797253 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:00.797255 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:00.798434 (+ 1179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:00.798439 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:00.798847 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:00.798848 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:00.799052 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:00.799625 (+ 573us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 22:51:00.799625 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:51:00.799667 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 22:51:00.799701 (+ 34us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:51:00.799886 (+ 185us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:51:00.799891 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:51:00.799895 (+ 4us) client_negotiation.cc:769] Sending connection context
0805 22:51:00.799965 (+ 70us) client_negotiation.cc:240] Negotiation successful
0805 22:51:00.800085 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":80,"threads_started":1}
I20260805 22:51:00.800829 9390 heartbeater.cc:347] Connected to a master server at 127.14.224.190:37037
I20260805 22:51:00.800945 9390 heartbeater.cc:464] Registering TS with master...
I20260805 22:51:00.801149 9390 heartbeater.cc:511] Master 127.14.224.190:37037 requested a full tablet report, sending...
I20260805 22:51:00.801718 9085 ts_manager.cc:194] Registered new tserver with Master: 17279a821fe24203b2521b6304409ca9 (127.14.224.129:35481)
I20260805 22:51:00.802382 9085 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.224.129:48645
W20260805 22:51:00.883250 9395 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:51:00.883555 9395 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:51:00.883579 9395 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:51:00.884876 9395 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:51:00.884928 9395 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:51:00.884956 9395 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.130
I20260805 22:51:00.886471 9395 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:33415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970021300824-15234-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970021300824-15234-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.224.130
--webserver_port=0
--tserver_master_addrs=127.14.224.190:37037
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9395
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.130
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970021300824-15234-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:51:00.886713 9395 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:51:00.887019 9395 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:51:00.892122 9406 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:00.892133 9405 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:00.892123 9409 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:51:00.892468 9395 server_base.cc:1034] running on GCE node
I20260805 22:51:00.892712 9395 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:51:00.892968 9395 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:51:00.894158 9395 hybrid_clock.cc:648] HybridClock initialized: now 1785970260894143 us; error 33 us; skew 500 ppm
I20260805 22:51:00.898336 9395 webserver.cc:460] Webserver started at http://127.14.224.130:42209/ using document root <none> and password file <none>
I20260805 22:51:00.898622 9395 fs_manager.cc:359] Metadata directory not provided
I20260805 22:51:00.898681 9395 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:51:00.898823 9395 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:51:00.900067 9395 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970021300824-15234-0/minicluster-data/ts-1/data/instance:
uuid: "4ce5f0bda0a8421eb6ac8382f6dc7a1c"
format_stamp: "Formatted at 2026-08-05 22:51:00 on dist-test-slave-gjrz"
server_key: "c656306ddad6378ee59f9b4c1758802c"
server_key_iv: "79b07ebd37bc874b8c05eda0eb2c9289"
server_key_version: "encryptionkey@0"
I20260805 22:51:00.900430 9395 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970021300824-15234-0/minicluster-data/ts-1/wal/instance:
uuid: "4ce5f0bda0a8421eb6ac8382f6dc7a1c"
format_stamp: "Formatted at 2026-08-05 22:51:00 on dist-test-slave-gjrz"
server_key: "c656306ddad6378ee59f9b4c1758802c"
server_key_iv: "79b07ebd37bc874b8c05eda0eb2c9289"
server_key_version: "encryptionkey@0"
I20260805 22:51:00.901806 9395 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260805 22:51:00.902633 9416 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:00.902849 9395 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:51:00.902948 9395 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970021300824-15234-0/minicluster-data/ts-1/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970021300824-15234-0/minicluster-data/ts-1/wal
uuid: "4ce5f0bda0a8421eb6ac8382f6dc7a1c"
format_stamp: "Formatted at 2026-08-05 22:51:00 on dist-test-slave-gjrz"
server_key: "c656306ddad6378ee59f9b4c1758802c"
server_key_iv: "79b07ebd37bc874b8c05eda0eb2c9289"
server_key_version: "encryptionkey@0"
I20260805 22:51:00.903019 9395 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970021300824-15234-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970021300824-15234-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970021300824-15234-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:51:00.923996 9395 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:51:00.924309 9395 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:51:00.924417 9395 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:51:00.924609 9395 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:51:00.924978 9395 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:51:00.925015 9395 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:00.925048 9395 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:51:00.925065 9395 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:00.930855 9395 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.130:38085
I20260805 22:51:00.930927 9583 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.130:38085 every 8 connection(s)
I20260805 22:51:00.931305 9395 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
I20260805 22:51:00.935592 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 9395
I20260805 22:51:00.935705 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970021300824-15234-0/minicluster-data/ts-1/wal/instance
I20260805 22:51:00.935905 15234 external_mini_cluster.cc:1428] Setting key ec7c1a47f0fc1da4cfb5b1663d72aa06
I20260805 22:51:00.936905 9167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:00.932056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:60927 (local address 127.14.224.190:37037)
0805 22:51:00.932124 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:00.932126 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:00.932358 (+ 232us) server_negotiation.cc:407] Connection header received
0805 22:51:00.932912 (+ 554us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:00.932913 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:00.932926 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:00.932988 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:00.933706 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:00.934311 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:00.935340 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:00.935622 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:00.935697 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:00.936628 (+ 931us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:00.936630 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:00.936630 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:51:00.936635 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:00.936651 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:51:00.936655 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:00.936695 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:00.936790 (+ 95us) server_negotiation.cc:299] Negotiation successful
0805 22:51:00.936823 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260805 22:51:00.936925 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970021300824-15234-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970021300824-15234-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970021300824-15234-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.131:0
--local_ip_for_outbound_sockets=127.14.224.131
--webserver_interface=127.14.224.131
--webserver_port=0
--tserver_master_addrs=127.14.224.190:37037
--builtin_ntp_servers=127.14.224.148:33415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260805 22:51:00.937150 9586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:00.932021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:37037 (local address 127.14.224.130:60927)
0805 22:51:00.932232 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:00.932269 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0805 22:51:00.932801 (+ 532us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:51:00.933077 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:51:00.933081 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:51:00.933092 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:51:00.933614 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:00.933619 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:00.934409 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:00.934410 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:00.935218 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:00.935221 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:00.935721 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:00.935723 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:00.935875 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:00.936442 (+ 567us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 22:51:00.936443 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:51:00.936495 (+ 52us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 22:51:00.936526 (+ 31us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:51:00.936711 (+ 185us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:51:00.936719 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:51:00.936722 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:51:00.936789 (+ 67us) client_negotiation.cc:240] Negotiation successful
0805 22:51:00.936906 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":87,"threads_started":1}
I20260805 22:51:00.937604 9584 heartbeater.cc:347] Connected to a master server at 127.14.224.190:37037
I20260805 22:51:00.937718 9584 heartbeater.cc:464] Registering TS with master...
I20260805 22:51:00.937923 9584 heartbeater.cc:511] Master 127.14.224.190:37037 requested a full tablet report, sending...
I20260805 22:51:00.938313 9085 ts_manager.cc:194] Registered new tserver with Master: 4ce5f0bda0a8421eb6ac8382f6dc7a1c (127.14.224.130:38085)
I20260805 22:51:00.938766 9085 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.224.130:60927
W20260805 22:51:01.023538 9587 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:51:01.023769 9587 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:51:01.023792 9587 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:51:01.024989 9587 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:51:01.025032 9587 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:51:01.025059 9587 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.131
I20260805 22:51:01.026461 9587 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:33415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970021300824-15234-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970021300824-15234-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.224.131
--webserver_port=0
--tserver_master_addrs=127.14.224.190:37037
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9587
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.131
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970021300824-15234-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:51:01.026703 9587 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:51:01.027024 9587 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:51:01.033779 9592 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:01.033782 9593 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:01.033779 9598 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:51:01.033957 9587 server_base.cc:1034] running on GCE node
I20260805 22:51:01.034381 9587 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:51:01.034675 9587 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:51:01.035844 9587 hybrid_clock.cc:648] HybridClock initialized: now 1785970261035823 us; error 34 us; skew 500 ppm
I20260805 22:51:01.037309 9587 webserver.cc:460] Webserver started at http://127.14.224.131:37247/ using document root <none> and password file <none>
I20260805 22:51:01.037582 9587 fs_manager.cc:359] Metadata directory not provided
I20260805 22:51:01.037638 9587 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:51:01.037777 9587 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:51:01.038894 9587 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970021300824-15234-0/minicluster-data/ts-2/data/instance:
uuid: "c8f15377f0704b5b8e6ae0757bb0156a"
format_stamp: "Formatted at 2026-08-05 22:51:01 on dist-test-slave-gjrz"
server_key: "c405d6b5417ae3417e75c224a1023e92"
server_key_iv: "1329ba12d785804652e06cdf734a6788"
server_key_version: "encryptionkey@0"
I20260805 22:51:01.039315 9587 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970021300824-15234-0/minicluster-data/ts-2/wal/instance:
uuid: "c8f15377f0704b5b8e6ae0757bb0156a"
format_stamp: "Formatted at 2026-08-05 22:51:01 on dist-test-slave-gjrz"
server_key: "c405d6b5417ae3417e75c224a1023e92"
server_key_iv: "1329ba12d785804652e06cdf734a6788"
server_key_version: "encryptionkey@0"
I20260805 22:51:01.040710 9587 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:51:01.041579 9607 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:01.041785 9587 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:51:01.041889 9587 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970021300824-15234-0/minicluster-data/ts-2/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970021300824-15234-0/minicluster-data/ts-2/wal
uuid: "c8f15377f0704b5b8e6ae0757bb0156a"
format_stamp: "Formatted at 2026-08-05 22:51:01 on dist-test-slave-gjrz"
server_key: "c405d6b5417ae3417e75c224a1023e92"
server_key_iv: "1329ba12d785804652e06cdf734a6788"
server_key_version: "encryptionkey@0"
I20260805 22:51:01.041965 9587 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970021300824-15234-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970021300824-15234-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970021300824-15234-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:51:01.052156 9587 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:51:01.052480 9587 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:51:01.052610 9587 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:51:01.052831 9587 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:51:01.053215 9587 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:51:01.053251 9587 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:01.053272 9587 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:51:01.053283 9587 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:01.058842 9587 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.131:37549
I20260805 22:51:01.058897 9772 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.131:37549 every 8 connection(s)
I20260805 22:51:01.059247 9587 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
I20260805 22:51:01.063196 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 9587
I20260805 22:51:01.063329 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970021300824-15234-0/minicluster-data/ts-2/wal/instance
I20260805 22:51:01.063572 15234 external_mini_cluster.cc:1428] Setting key ee2ffc9f6b50c96b545fe80e8b2814b8
I20260805 22:51:01.064584 9167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:01.060043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:43149 (local address 127.14.224.190:37037)
0805 22:51:01.060109 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:01.060111 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:01.060312 (+ 201us) server_negotiation.cc:407] Connection header received
0805 22:51:01.060786 (+ 474us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:01.060787 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:01.060797 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:01.060861 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:01.061512 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:01.062021 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:01.063035 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:01.063282 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:01.063359 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:01.064281 (+ 922us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:01.064282 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:01.064282 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:51:01.064287 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:01.064307 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:51:01.064312 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:01.064364 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:01.064454 (+ 90us) server_negotiation.cc:299] Negotiation successful
0805 22:51:01.064491 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260805 22:51:01.064764 9778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:01.060001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:37037 (local address 127.14.224.131:43149)
0805 22:51:01.060188 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:01.060230 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0805 22:51:01.060711 (+ 481us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:51:01.060917 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:51:01.060920 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:51:01.060929 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:51:01.061441 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:01.061445 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:01.062111 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:01.062112 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:01.062922 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:01.062924 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:01.063389 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:01.063390 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:01.063562 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:01.064157 (+ 595us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 22:51:01.064157 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:51:01.064190 (+ 33us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 22:51:01.064217 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:51:01.064369 (+ 152us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:51:01.064372 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:51:01.064374 (+ 2us) client_negotiation.cc:769] Sending connection context
0805 22:51:01.064431 (+ 57us) client_negotiation.cc:240] Negotiation successful
0805 22:51:01.064546 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":88,"threads_started":1}
I20260805 22:51:01.065444 9773 heartbeater.cc:347] Connected to a master server at 127.14.224.190:37037
I20260805 22:51:01.065565 9773 heartbeater.cc:464] Registering TS with master...
I20260805 22:51:01.065732 9773 heartbeater.cc:511] Master 127.14.224.190:37037 requested a full tablet report, sending...
I20260805 22:51:01.066139 9085 ts_manager.cc:194] Registered new tserver with Master: c8f15377f0704b5b8e6ae0757bb0156a (127.14.224.131:37549)
I20260805 22:51:01.066488 9085 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.224.131:43149
I20260805 22:51:01.075471 15234 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 22:51:01.080021 9167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:01.077037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53672 (local address 127.14.224.190:37037)
0805 22:51:01.077136 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:01.077138 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:01.077255 (+ 117us) server_negotiation.cc:407] Connection header received
0805 22:51:01.077353 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:01.077354 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:01.077370 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:01.077420 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:01.077588 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:01.078094 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:01.078845 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:01.079043 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:01.079099 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:01.079775 (+ 676us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:01.079776 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:01.079777 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:51:01.079783 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:01.079799 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:51:01.079804 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:01.079847 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:01.079903 (+ 56us) server_negotiation.cc:299] Negotiation successful
0805 22:51:01.079932 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260805 22:51:01.081624 9085 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53672:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:51:01.083235 9085 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:51:01.090157 9798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:01.085665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.131:37549 (local address 127.0.0.1:56636)
0805 22:51:01.085941 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:01.085951 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0805 22:51:01.086004 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:51:01.086395 (+ 391us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:51:01.086396 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:51:01.086398 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:51:01.086471 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:01.086474 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:01.087904 (+ 1430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:01.087905 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:01.088835 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:01.088838 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:01.089824 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:01.089825 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:01.089905 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:01.089920 (+ 15us) client_negotiation.cc:769] Sending connection context
0805 22:51:01.090015 (+ 95us) client_negotiation.cc:240] Negotiation successful
0805 22:51:01.090074 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255,"mutex_wait_us":20,"thread_start_us":58,"threads_started":1}
I20260805 22:51:01.090176 9801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:01.086040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56636 (local address 127.14.224.131:37549)
0805 22:51:01.086203 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:01.086208 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:01.086219 (+ 11us) server_negotiation.cc:407] Connection header received
0805 22:51:01.086260 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:01.086262 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:01.086278 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:01.086440 (+ 162us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:51:01.086612 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:01.087805 (+ 1193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:01.088931 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:01.089682 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:01.089781 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:01.089882 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:01.090033 (+ 151us) server_negotiation.cc:299] Negotiation successful
0805 22:51:01.090074 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":86,"threads_started":1}
I20260805 22:51:01.090910 9795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:01.085665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.130:38085 (local address 127.0.0.1:53922)
0805 22:51:01.085836 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:01.085873 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0805 22:51:01.085942 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:51:01.086410 (+ 468us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:51:01.086411 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:51:01.086412 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:51:01.086477 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:01.086479 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:01.087872 (+ 1393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:01.087873 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:01.088930 (+ 1057us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:01.088934 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:01.090675 (+ 1741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:01.090676 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:01.090741 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:01.090746 (+ 5us) client_negotiation.cc:769] Sending connection context
0805 22:51:01.090793 (+ 47us) client_negotiation.cc:240] Negotiation successful
0805 22:51:01.090836 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":57,"threads_started":1}
I20260805 22:51:01.090936 9799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:01.085856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53922 (local address 127.14.224.130:38085)
0805 22:51:01.086244 (+ 388us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:01.086248 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:01.086258 (+ 10us) server_negotiation.cc:407] Connection header received
0805 22:51:01.086292 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:01.086294 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:01.086309 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:01.086550 (+ 241us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:51:01.086608 (+ 58us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:01.087779 (+ 1171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:01.089847 (+ 2068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:01.090571 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:01.090685 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:01.090779 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:01.090811 (+ 32us) server_negotiation.cc:299] Negotiation successful
0805 22:51:01.090851 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":351,"thread_start_us":85,"threads_started":1}
I20260805 22:51:01.091344 9788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:01.085673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.129:35481 (local address 127.0.0.1:56606)
0805 22:51:01.086110 (+ 437us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:01.086119 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0805 22:51:01.086169 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:51:01.086343 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:51:01.086346 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:51:01.086348 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:51:01.086563 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:01.086565 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:01.087503 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:01.087504 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:01.088937 (+ 1433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:01.088939 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:01.091081 (+ 2142us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:01.091082 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:01.091157 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:01.091162 (+ 5us) client_negotiation.cc:769] Sending connection context
0805 22:51:01.091205 (+ 43us) client_negotiation.cc:240] Negotiation successful
0805 22:51:01.091248 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":424,"mutex_wait_us":2,"thread_start_us":104,"threads_started":1}
I20260805 22:51:01.091378 9800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:01.085941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56606 (local address 127.14.224.129:35481)
0805 22:51:01.086099 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:01.086105 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:01.086161 (+ 56us) server_negotiation.cc:407] Connection header received
0805 22:51:01.086234 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:01.086237 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:01.086251 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:01.086515 (+ 264us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:51:01.086633 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:01.087423 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:01.089027 (+ 1604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:01.089771 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:01.091085 (+ 1314us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:01.091196 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:01.091221 (+ 25us) server_negotiation.cc:299] Negotiation successful
0805 22:51:01.091302 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":92,"threads_started":1}
I20260805 22:51:01.091212 9686 tablet_service.cc:1467] Processing CreateTablet for tablet 9852782292f44ea0928119ddbb245a7c (DEFAULT_TABLE table=test-table [id=9e83e7557496410caa0311a02ce3f70a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:51:01.091677 9686 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9852782292f44ea0928119ddbb245a7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:51:01.091995 9488 tablet_service.cc:1467] Processing CreateTablet for tablet 9852782292f44ea0928119ddbb245a7c (DEFAULT_TABLE table=test-table [id=9e83e7557496410caa0311a02ce3f70a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:51:01.092374 9488 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9852782292f44ea0928119ddbb245a7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:51:01.092272 9282 tablet_service.cc:1467] Processing CreateTablet for tablet 9852782292f44ea0928119ddbb245a7c (DEFAULT_TABLE table=test-table [id=9e83e7557496410caa0311a02ce3f70a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:51:01.092609 9282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9852782292f44ea0928119ddbb245a7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:51:01.094725 9802 tablet_bootstrap.cc:492] T 9852782292f44ea0928119ddbb245a7c P c8f15377f0704b5b8e6ae0757bb0156a: Bootstrap starting.
I20260805 22:51:01.095450 9802 tablet_bootstrap.cc:654] T 9852782292f44ea0928119ddbb245a7c P c8f15377f0704b5b8e6ae0757bb0156a: Neither blocks nor log segments found. Creating new log.
I20260805 22:51:01.095745 9802 log.cc:824] T 9852782292f44ea0928119ddbb245a7c P c8f15377f0704b5b8e6ae0757bb0156a: Log is configured to *not* fsync() on all Append() calls
I20260805 22:51:01.096068 9803 tablet_bootstrap.cc:492] T 9852782292f44ea0928119ddbb245a7c P 17279a821fe24203b2521b6304409ca9: Bootstrap starting.
I20260805 22:51:01.096736 9803 tablet_bootstrap.cc:654] T 9852782292f44ea0928119ddbb245a7c P 17279a821fe24203b2521b6304409ca9: Neither blocks nor log segments found. Creating new log.
I20260805 22:51:01.096839 9802 tablet_bootstrap.cc:492] T 9852782292f44ea0928119ddbb245a7c P c8f15377f0704b5b8e6ae0757bb0156a: No bootstrap required, opened a new log
I20260805 22:51:01.096918 9802 ts_tablet_manager.cc:1397] T 9852782292f44ea0928119ddbb245a7c P c8f15377f0704b5b8e6ae0757bb0156a: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260805 22:51:01.097121 9803 log.cc:824] T 9852782292f44ea0928119ddbb245a7c P 17279a821fe24203b2521b6304409ca9: Log is configured to *not* fsync() on all Append() calls
I20260805 22:51:01.097509 9806 tablet_bootstrap.cc:492] T 9852782292f44ea0928119ddbb245a7c P 4ce5f0bda0a8421eb6ac8382f6dc7a1c: Bootstrap starting.
I20260805 22:51:01.098245 9806 tablet_bootstrap.cc:654] T 9852782292f44ea0928119ddbb245a7c P 4ce5f0bda0a8421eb6ac8382f6dc7a1c: Neither blocks nor log segments found. Creating new log.
I20260805 22:51:01.098560 9806 log.cc:824] T 9852782292f44ea0928119ddbb245a7c P 4ce5f0bda0a8421eb6ac8382f6dc7a1c: Log is configured to *not* fsync() on all Append() calls
I20260805 22:51:01.099205 9803 tablet_bootstrap.cc:492] T 9852782292f44ea0928119ddbb245a7c P 17279a821fe24203b2521b6304409ca9: No bootstrap required, opened a new log
I20260805 22:51:01.099323 9803 ts_tablet_manager.cc:1397] T 9852782292f44ea0928119ddbb245a7c P 17279a821fe24203b2521b6304409ca9: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260805 22:51:01.099476 9806 tablet_bootstrap.cc:492] T 9852782292f44ea0928119ddbb245a7c P 4ce5f0bda0a8421eb6ac8382f6dc7a1c: No bootstrap required, opened a new log
I20260805 22:51:01.099591 9806 ts_tablet_manager.cc:1397] T 9852782292f44ea0928119ddbb245a7c P 4ce5f0bda0a8421eb6ac8382f6dc7a1c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260805 22:51:01.100119 9802 raft_consensus.cc:348] T 9852782292f44ea0928119ddbb245a7c P c8f15377f0704b5b8e6ae0757bb0156a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8f15377f0704b5b8e6ae0757bb0156a" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 37549 } } peers { permanent_uuid: "4ce5f0bda0a8421eb6ac8382f6dc7a1c" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 38085 } } peers { permanent_uuid: "17279a821fe24203b2521b6304409ca9" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 35481 } }
I20260805 22:51:01.100323 9802 raft_consensus.cc:374] T 9852782292f44ea0928119ddbb245a7c P c8f15377f0704b5b8e6ae0757bb0156a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:51:01.100360 9802 raft_consensus.cc:729] T 9852782292f44ea0928119ddbb245a7c P c8f15377f0704b5b8e6ae0757bb0156a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8f15377f0704b5b8e6ae0757bb0156a, State: Initialized, Role: FOLLOWER
I20260805 22:51:01.100531 9802 consensus_queue.cc:260] T 9852782292f44ea0928119ddbb245a7c P c8f15377f0704b5b8e6ae0757bb0156a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8f15377f0704b5b8e6ae0757bb0156a" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 37549 } } peers { permanent_uuid: "4ce5f0bda0a8421eb6ac8382f6dc7a1c" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 38085 } } peers { permanent_uuid: "17279a821fe24203b2521b6304409ca9" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 35481 } }
I20260805 22:51:01.100864 9773 heartbeater.cc:503] Master 127.14.224.190:37037 was elected leader, sending a full tablet report...
I20260805 22:51:01.101122 9802 ts_tablet_manager.cc:1428] T 9852782292f44ea0928119ddbb245a7c P c8f15377f0704b5b8e6ae0757bb0156a: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260805 22:51:01.101949 9803 raft_consensus.cc:348] T 9852782292f44ea0928119ddbb245a7c P 17279a821fe24203b2521b6304409ca9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8f15377f0704b5b8e6ae0757bb0156a" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 37549 } } peers { permanent_uuid: "4ce5f0bda0a8421eb6ac8382f6dc7a1c" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 38085 } } peers { permanent_uuid: "17279a821fe24203b2521b6304409ca9" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 35481 } }
I20260805 22:51:01.102041 9806 raft_consensus.cc:348] T 9852782292f44ea0928119ddbb245a7c P 4ce5f0bda0a8421eb6ac8382f6dc7a1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8f15377f0704b5b8e6ae0757bb0156a" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 37549 } } peers { permanent_uuid: "4ce5f0bda0a8421eb6ac8382f6dc7a1c" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 38085 } } peers { permanent_uuid: "17279a821fe24203b2521b6304409ca9" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 35481 } }
I20260805 22:51:01.102181 9803 raft_consensus.cc:374] T 9852782292f44ea0928119ddbb245a7c P 17279a821fe24203b2521b6304409ca9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:51:01.102231 9803 raft_consensus.cc:729] T 9852782292f44ea0928119ddbb245a7c P 17279a821fe24203b2521b6304409ca9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17279a821fe24203b2521b6304409ca9, State: Initialized, Role: FOLLOWER
I20260805 22:51:01.102264 9806 raft_consensus.cc:374] T 9852782292f44ea0928119ddbb245a7c P 4ce5f0bda0a8421eb6ac8382f6dc7a1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:51:01.102324 9806 raft_consensus.cc:729] T 9852782292f44ea0928119ddbb245a7c P 4ce5f0bda0a8421eb6ac8382f6dc7a1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ce5f0bda0a8421eb6ac8382f6dc7a1c, State: Initialized, Role: FOLLOWER
I20260805 22:51:01.102383 9803 consensus_queue.cc:260] T 9852782292f44ea0928119ddbb245a7c P 17279a821fe24203b2521b6304409ca9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8f15377f0704b5b8e6ae0757bb0156a" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 37549 } } peers { permanent_uuid: "4ce5f0bda0a8421eb6ac8382f6dc7a1c" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 38085 } } peers { permanent_uuid: "17279a821fe24203b2521b6304409ca9" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 35481 } }
I20260805 22:51:01.102478 9806 consensus_queue.cc:260] T 9852782292f44ea0928119ddbb245a7c P 4ce5f0bda0a8421eb6ac8382f6dc7a1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8f15377f0704b5b8e6ae0757bb0156a" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 37549 } } peers { permanent_uuid: "4ce5f0bda0a8421eb6ac8382f6dc7a1c" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 38085 } } peers { permanent_uuid: "17279a821fe24203b2521b6304409ca9" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 35481 } }
I20260805 22:51:01.102690 9803 ts_tablet_manager.cc:1428] T 9852782292f44ea0928119ddbb245a7c P 17279a821fe24203b2521b6304409ca9: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260805 22:51:01.102759 9806 ts_tablet_manager.cc:1428] T 9852782292f44ea0928119ddbb245a7c P 4ce5f0bda0a8421eb6ac8382f6dc7a1c: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260805 22:51:01.102828 9584 heartbeater.cc:503] Master 127.14.224.190:37037 was elected leader, sending a full tablet report...
I20260805 22:51:01.102721 9390 heartbeater.cc:503] Master 127.14.224.190:37037 was elected leader, sending a full tablet report...
W20260805 22:51:01.181870 9585 tablet.cc:2369] T 9852782292f44ea0928119ddbb245a7c P 4ce5f0bda0a8421eb6ac8382f6dc7a1c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:51:01.270256 9810 raft_consensus.cc:482] T 9852782292f44ea0928119ddbb245a7c P c8f15377f0704b5b8e6ae0757bb0156a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:51:01.270398 9810 raft_consensus.cc:504] T 9852782292f44ea0928119ddbb245a7c P c8f15377f0704b5b8e6ae0757bb0156a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8f15377f0704b5b8e6ae0757bb0156a" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 37549 } } peers { permanent_uuid: "4ce5f0bda0a8421eb6ac8382f6dc7a1c" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 38085 } } peers { permanent_uuid: "17279a821fe24203b2521b6304409ca9" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 35481 } }
I20260805 22:51:01.270756 9810 leader_election.cc:288] T 9852782292f44ea0928119ddbb245a7c P c8f15377f0704b5b8e6ae0757bb0156a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ce5f0bda0a8421eb6ac8382f6dc7a1c (127.14.224.130:38085), 17279a821fe24203b2521b6304409ca9 (127.14.224.129:35481)
I20260805 22:51:01.273540 9799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:01.271047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:45705 (local address 127.14.224.130:38085)
0805 22:51:01.271092 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:01.271094 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:01.271103 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:51:01.271132 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:01.271133 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:01.271143 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:01.271193 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:51:01.271378 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:01.271853 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:01.272810 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:01.273205 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:01.273270 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:01.273280 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:01.273419 (+ 139us) server_negotiation.cc:299] Negotiation successful
0805 22:51:01.273461 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260805 22:51:01.273540 9778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:01.270940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.130:38085 (local address 127.14.224.131:45705)
0805 22:51:01.271003 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:01.271015 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:51:01.271063 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:51:01.271208 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:51:01.271208 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:51:01.271210 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:51:01.271310 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:01.271312 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:01.271938 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:01.271939 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:01.272710 (+ 771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:01.272713 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:01.273286 (+ 573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:01.273287 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:01.273356 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:01.273359 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:51:01.273404 (+ 45us) client_negotiation.cc:240] Negotiation successful
0805 22:51:01.273459 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42,"mutex_wait_us":14}
I20260805 22:51:01.273648 9800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:01.271058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:56549 (local address 127.14.224.129:35481)
0805 22:51:01.271140 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:01.271142 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:01.271214 (+ 72us) server_negotiation.cc:407] Connection header received
0805 22:51:01.271296 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:01.271297 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:01.271309 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:01.271361 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:51:01.271530 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:01.271989 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:01.272931 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:01.273292 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:01.273354 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:01.273362 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:01.273516 (+ 154us) server_negotiation.cc:299] Negotiation successful
0805 22:51:01.273567 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260805 22:51:01.273675 9815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:01.270960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.129:35481 (local address 127.14.224.131:56549)
0805 22:51:01.271157 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:01.271166 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0805 22:51:01.271226 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:51:01.271373 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:51:01.271374 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:51:01.271375 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:51:01.271464 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:01.271466 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:01.272068 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:01.272069 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:01.272838 (+ 769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:01.272840 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:01.273374 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:01.273375 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:01.273454 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:01.273457 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:51:01.273503 (+ 46us) client_negotiation.cc:240] Negotiation successful
0805 22:51:01.273543 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":116,"threads_started":1}
I20260805 22:51:01.273928 9519 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9852782292f44ea0928119ddbb245a7c" candidate_uuid: "c8f15377f0704b5b8e6ae0757bb0156a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ce5f0bda0a8421eb6ac8382f6dc7a1c" is_pre_election: true
I20260805 22:51:01.274075 9519 raft_consensus.cc:2454] T 9852782292f44ea0928119ddbb245a7c P 4ce5f0bda0a8421eb6ac8382f6dc7a1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8f15377f0704b5b8e6ae0757bb0156a in term 0.
I20260805 22:51:01.274308 9611 leader_election.cc:302] T 9852782292f44ea0928119ddbb245a7c P c8f15377f0704b5b8e6ae0757bb0156a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ce5f0bda0a8421eb6ac8382f6dc7a1c, c8f15377f0704b5b8e6ae0757bb0156a; no voters:
I20260805 22:51:01.274339 9314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9852782292f44ea0928119ddbb245a7c" candidate_uuid: "c8f15377f0704b5b8e6ae0757bb0156a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17279a821fe24203b2521b6304409ca9" is_pre_election: true
I20260805 22:51:01.274466 9810 raft_consensus.cc:2781] T 9852782292f44ea0928119ddbb245a7c P c8f15377f0704b5b8e6ae0757bb0156a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:51:01.274493 9314 raft_consensus.cc:2454] T 9852782292f44ea0928119ddbb245a7c P 17279a821fe24203b2521b6304409ca9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8f15377f0704b5b8e6ae0757bb0156a in term 0.
I20260805 22:51:01.274526 9810 raft_consensus.cc:482] T 9852782292f44ea0928119ddbb245a7c P c8f15377f0704b5b8e6ae0757bb0156a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:51:01.274549 9810 raft_consensus.cc:3037] T 9852782292f44ea0928119ddbb245a7c P c8f15377f0704b5b8e6ae0757bb0156a [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:51:01.275305 9810 raft_consensus.cc:504] T 9852782292f44ea0928119ddbb245a7c P c8f15377f0704b5b8e6ae0757bb0156a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8f15377f0704b5b8e6ae0757bb0156a" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 37549 } } peers { permanent_uuid: "4ce5f0bda0a8421eb6ac8382f6dc7a1c" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 38085 } } peers { permanent_uuid: "17279a821fe24203b2521b6304409ca9" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 35481 } }
I20260805 22:51:01.275453 9810 leader_election.cc:288] T 9852782292f44ea0928119ddbb245a7c P c8f15377f0704b5b8e6ae0757bb0156a [CANDIDATE]: Term 1 election: Requested vote from peers 4ce5f0bda0a8421eb6ac8382f6dc7a1c (127.14.224.130:38085), 17279a821fe24203b2521b6304409ca9 (127.14.224.129:35481)
I20260805 22:51:01.275597 9519 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9852782292f44ea0928119ddbb245a7c" candidate_uuid: "c8f15377f0704b5b8e6ae0757bb0156a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ce5f0bda0a8421eb6ac8382f6dc7a1c"
I20260805 22:51:01.275624 9314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9852782292f44ea0928119ddbb245a7c" candidate_uuid: "c8f15377f0704b5b8e6ae0757bb0156a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17279a821fe24203b2521b6304409ca9"
I20260805 22:51:01.275687 9314 raft_consensus.cc:3037] T 9852782292f44ea0928119ddbb245a7c P 17279a821fe24203b2521b6304409ca9 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:51:01.275691 9519 raft_consensus.cc:3037] T 9852782292f44ea0928119ddbb245a7c P 4ce5f0bda0a8421eb6ac8382f6dc7a1c [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:51:01.276487 9314 raft_consensus.cc:2454] T 9852782292f44ea0928119ddbb245a7c P 17279a821fe24203b2521b6304409ca9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8f15377f0704b5b8e6ae0757bb0156a in term 1.
I20260805 22:51:01.276594 9519 raft_consensus.cc:2454] T 9852782292f44ea0928119ddbb245a7c P 4ce5f0bda0a8421eb6ac8382f6dc7a1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8f15377f0704b5b8e6ae0757bb0156a in term 1.
I20260805 22:51:01.276672 9610 leader_election.cc:302] T 9852782292f44ea0928119ddbb245a7c P c8f15377f0704b5b8e6ae0757bb0156a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17279a821fe24203b2521b6304409ca9, c8f15377f0704b5b8e6ae0757bb0156a; no voters:
I20260805 22:51:01.276767 9810 raft_consensus.cc:2781] T 9852782292f44ea0928119ddbb245a7c P c8f15377f0704b5b8e6ae0757bb0156a [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:51:01.276917 9810 raft_consensus.cc:686] T 9852782292f44ea0928119ddbb245a7c P c8f15377f0704b5b8e6ae0757bb0156a [term 1 LEADER]: Becoming Leader. State: Replica: c8f15377f0704b5b8e6ae0757bb0156a, State: Running, Role: LEADER
I20260805 22:51:01.277120 9810 consensus_queue.cc:237] T 9852782292f44ea0928119ddbb245a7c P c8f15377f0704b5b8e6ae0757bb0156a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8f15377f0704b5b8e6ae0757bb0156a" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 37549 } } peers { permanent_uuid: "4ce5f0bda0a8421eb6ac8382f6dc7a1c" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 38085 } } peers { permanent_uuid: "17279a821fe24203b2521b6304409ca9" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 35481 } }
I20260805 22:51:01.278059 9085 catalog_manager.cc:5495] T 9852782292f44ea0928119ddbb245a7c P c8f15377f0704b5b8e6ae0757bb0156a reported cstate change: term changed from 0 to 1, leader changed from <none> to c8f15377f0704b5b8e6ae0757bb0156a (127.14.224.131). New cstate: current_term: 1 leader_uuid: "c8f15377f0704b5b8e6ae0757bb0156a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8f15377f0704b5b8e6ae0757bb0156a" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 37549 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ce5f0bda0a8421eb6ac8382f6dc7a1c" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 38085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17279a821fe24203b2521b6304409ca9" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 35481 } health_report { overall_health: UNKNOWN } } }
W20260805 22:51:01.294863 9392 tablet.cc:2369] T 9852782292f44ea0928119ddbb245a7c P 17279a821fe24203b2521b6304409ca9: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260805 22:51:01.309809 9777 tablet.cc:2369] T 9852782292f44ea0928119ddbb245a7c P c8f15377f0704b5b8e6ae0757bb0156a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:51:01.316881 9801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:01.314605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56642 (local address 127.14.224.131:37549)
0805 22:51:01.314669 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:01.314670 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:01.314679 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:51:01.314720 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:01.314720 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:01.314738 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:01.314802 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:51:01.314906 (+ 104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:01.315395 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:01.316143 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:01.316324 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:01.316369 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:01.316516 (+ 147us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:51:01.316627 (+ 111us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:51:01.316707 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:01.316779 (+ 72us) server_negotiation.cc:299] Negotiation successful
0805 22:51:01.316797 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260805 22:51:01.318751 9314 raft_consensus.cc:1261] T 9852782292f44ea0928119ddbb245a7c P 17279a821fe24203b2521b6304409ca9 [term 1 FOLLOWER]: Refusing update from remote peer c8f15377f0704b5b8e6ae0757bb0156a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:51:01.318751 9519 raft_consensus.cc:1261] T 9852782292f44ea0928119ddbb245a7c P 4ce5f0bda0a8421eb6ac8382f6dc7a1c [term 1 FOLLOWER]: Refusing update from remote peer c8f15377f0704b5b8e6ae0757bb0156a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:51:01.319159 9810 consensus_queue.cc:1035] T 9852782292f44ea0928119ddbb245a7c P c8f15377f0704b5b8e6ae0757bb0156a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ce5f0bda0a8421eb6ac8382f6dc7a1c" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:51:01.319334 9817 consensus_queue.cc:1035] T 9852782292f44ea0928119ddbb245a7c P c8f15377f0704b5b8e6ae0757bb0156a [LEADER]: Connected to new peer: Peer: permanent_uuid: "17279a821fe24203b2521b6304409ca9" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 35481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:51:01.322932 9822 mvcc.cc:205] Tried to move back new op lower bound from 7315334190358700032 to 7315334190191947776. Current Snapshot: MvccSnapshot[applied={T|T < 7315334190358700032}]
I20260805 22:51:01.324414 9085 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53672:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:51:01.324546 9085 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53672:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:51:01.325349 9085 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cccbc3bd376243fca10f5b55b9a0aac0: Sending DeleteTablet for 3 replicas of tablet 9852782292f44ea0928119ddbb245a7c
I20260805 22:51:01.325695 9686 tablet_service.cc:1514] Processing DeleteTablet for tablet 9852782292f44ea0928119ddbb245a7c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:51:01 UTC) from {username='slave'} at 127.0.0.1:56636
I20260805 22:51:01.325752 9488 tablet_service.cc:1514] Processing DeleteTablet for tablet 9852782292f44ea0928119ddbb245a7c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:51:01 UTC) from {username='slave'} at 127.0.0.1:53922
I20260805 22:51:01.325986 9837 tablet_replica.cc:330] T 9852782292f44ea0928119ddbb245a7c P c8f15377f0704b5b8e6ae0757bb0156a: stopping tablet replica
I20260805 22:51:01.326013 9839 tablet_replica.cc:330] T 9852782292f44ea0928119ddbb245a7c P 4ce5f0bda0a8421eb6ac8382f6dc7a1c: stopping tablet replica
I20260805 22:51:01.326120 9839 raft_consensus.cc:2229] T 9852782292f44ea0928119ddbb245a7c P 4ce5f0bda0a8421eb6ac8382f6dc7a1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:51:01.326125 9837 raft_consensus.cc:2229] T 9852782292f44ea0928119ddbb245a7c P c8f15377f0704b5b8e6ae0757bb0156a [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:51:01.326229 9837 raft_consensus.cc:2258] T 9852782292f44ea0928119ddbb245a7c P c8f15377f0704b5b8e6ae0757bb0156a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:51:01.326227 9282 tablet_service.cc:1514] Processing DeleteTablet for tablet 9852782292f44ea0928119ddbb245a7c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:51:01 UTC) from {username='slave'} at 127.0.0.1:56606
I20260805 22:51:01.326295 9839 raft_consensus.cc:2258] T 9852782292f44ea0928119ddbb245a7c P 4ce5f0bda0a8421eb6ac8382f6dc7a1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:51:01.326531 9842 tablet_replica.cc:330] T 9852782292f44ea0928119ddbb245a7c P 17279a821fe24203b2521b6304409ca9: stopping tablet replica
I20260805 22:51:01.326696 9842 raft_consensus.cc:2229] T 9852782292f44ea0928119ddbb245a7c P 17279a821fe24203b2521b6304409ca9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:51:01.326800 9839 ts_tablet_manager.cc:1905] T 9852782292f44ea0928119ddbb245a7c P 4ce5f0bda0a8421eb6ac8382f6dc7a1c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:51:01.326812 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 9182
I20260805 22:51:01.326850 9842 raft_consensus.cc:2258] T 9852782292f44ea0928119ddbb245a7c P 17279a821fe24203b2521b6304409ca9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:51:01.338323 9837 ts_tablet_manager.cc:1905] T 9852782292f44ea0928119ddbb245a7c P c8f15377f0704b5b8e6ae0757bb0156a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:51:01.338608 9839 ts_tablet_manager.cc:1918] T 9852782292f44ea0928119ddbb245a7c P 4ce5f0bda0a8421eb6ac8382f6dc7a1c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:51:01.338725 9839 log.cc:1196] T 9852782292f44ea0928119ddbb245a7c P 4ce5f0bda0a8421eb6ac8382f6dc7a1c: Deleting WAL directory at /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970021300824-15234-0/minicluster-data/ts-1/wal/wals/9852782292f44ea0928119ddbb245a7c
I20260805 22:51:01.339011 9839 ts_tablet_manager.cc:1939] T 9852782292f44ea0928119ddbb245a7c P 4ce5f0bda0a8421eb6ac8382f6dc7a1c: Deleting consensus metadata
I20260805 22:51:01.339648 9067 catalog_manager.cc:4841] TS 4ce5f0bda0a8421eb6ac8382f6dc7a1c (127.14.224.130:38085): tablet 9852782292f44ea0928119ddbb245a7c (table test-table [id=9e83e7557496410caa0311a02ce3f70a]) successfully deleted
I20260805 22:51:01.341547 9837 ts_tablet_manager.cc:1918] T 9852782292f44ea0928119ddbb245a7c P c8f15377f0704b5b8e6ae0757bb0156a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:51:01.341730 9837 log.cc:1196] T 9852782292f44ea0928119ddbb245a7c P c8f15377f0704b5b8e6ae0757bb0156a: Deleting WAL directory at /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970021300824-15234-0/minicluster-data/ts-2/wal/wals/9852782292f44ea0928119ddbb245a7c
I20260805 22:51:01.342114 9837 ts_tablet_manager.cc:1939] T 9852782292f44ea0928119ddbb245a7c P c8f15377f0704b5b8e6ae0757bb0156a: Deleting consensus metadata
I20260805 22:51:01.342746 9069 catalog_manager.cc:4841] TS c8f15377f0704b5b8e6ae0757bb0156a (127.14.224.131:37549): tablet 9852782292f44ea0928119ddbb245a7c (table test-table [id=9e83e7557496410caa0311a02ce3f70a]) successfully deleted
W20260805 22:51:01.345415 9066 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.224.129:35481 (error 108)
I20260805 22:51:01.345551 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 9395
I20260805 22:51:01.367484 9795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:01.367229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.129:35481 (local address 127.0.0.1:56622)
0805 22:51:01.367335 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:01.367429 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.129:35481: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260805 22:51:01.367699 9066 catalog_manager.cc:4584] TS 17279a821fe24203b2521b6304409ca9 (127.14.224.129:35481): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9852782292f44ea0928119ddbb245a7c: Network error: Client connection negotiation failed: client connection to 127.14.224.129:35481: connect: Connection refused (error 111)
I20260805 22:51:01.371255 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 9587
I20260805 22:51:01.380265 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 9043
2026-08-05T22:51:01Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (935 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:51:01 dist-test-slave-gjrz krb5kdc[9848](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:51:01 dist-test-slave-gjrz krb5kdc[9848](info): set up 2 sockets
Aug 05 22:51:01 dist-test-slave-gjrz krb5kdc[9848](info): commencing operation
krb5kdc: starting...
W20260805 22:51:02.522266 15234 mini_kdc.cc:121] Time spent starting KDC: real 1.112s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Aug 05 22:51:02 dist-test-slave-gjrz krb5kdc[9848](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970262, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:51:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:51:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.224.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab.
Entry for principal kudu/127.14.224.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab.
I20260805 22:51:02.653831 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:46603
--webserver_interface=127.14.224.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:34235
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.224.190:46603
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:51:02.739179 9867 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:51:02.739463 9867 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:51:02.739498 9867 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:51:02.740973 9867 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:51:02.741042 9867 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:51:02.741063 9867 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:51:02.741081 9867 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:51:02.741097 9867 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:51:02.743378 9867 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:34235
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.224.190:46603
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:46603
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.224.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9867
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:51:02.743710 9867 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:51:02.743971 9867 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:51:02.749359 9880 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:51:02.749426 9867 server_base.cc:1034] running on GCE node
W20260805 22:51:02.749341 9874 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:02.749447 9876 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:51:02.749831 9867 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:51:02.750164 9867 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:51:02.751366 9867 hybrid_clock.cc:648] HybridClock initialized: now 1785970262751346 us; error 34 us; skew 500 ppm
Aug 05 22:51:02 dist-test-slave-gjrz krb5kdc[9848](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970262, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:51:02.754015 9867 init.cc:377] Logged in from keytab as kudu/127.14.224.190@KRBTEST.COM (short username kudu)
I20260805 22:51:02.754540 9867 webserver.cc:460] Webserver started at http://127.14.224.190:34267/ using document root <none> and password file <none>
I20260805 22:51:02.754761 9867 fs_manager.cc:359] Metadata directory not provided
I20260805 22:51:02.754810 9867 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:51:02.754951 9867 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:51:02.756142 9867 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/minicluster-data/master-0/data/instance:
uuid: "1ed5334d9e764f70be373100537c9330"
format_stamp: "Formatted at 2026-08-05 22:51:02 on dist-test-slave-gjrz"
server_key: "7faf2d0d179ee53e6f5e538a3d82561a"
server_key_iv: "80956319e593d621d009e88ba30cdf7e"
server_key_version: "encryptionkey@0"
I20260805 22:51:02.756501 9867 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/minicluster-data/master-0/wal/instance:
uuid: "1ed5334d9e764f70be373100537c9330"
format_stamp: "Formatted at 2026-08-05 22:51:02 on dist-test-slave-gjrz"
server_key: "7faf2d0d179ee53e6f5e538a3d82561a"
server_key_iv: "80956319e593d621d009e88ba30cdf7e"
server_key_version: "encryptionkey@0"
I20260805 22:51:02.757961 9867 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260805 22:51:02.758776 9888 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:02.758972 9867 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:51:02.759073 9867 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/minicluster-data/master-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/minicluster-data/master-0/wal
uuid: "1ed5334d9e764f70be373100537c9330"
format_stamp: "Formatted at 2026-08-05 22:51:02 on dist-test-slave-gjrz"
server_key: "7faf2d0d179ee53e6f5e538a3d82561a"
server_key_iv: "80956319e593d621d009e88ba30cdf7e"
server_key_version: "encryptionkey@0"
I20260805 22:51:02.759140 9867 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:51:02.776286 9867 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:51:02.778446 9867 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:51:02.778609 9867 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:51:02.783082 9867 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.190:46603
I20260805 22:51:02.783152 9966 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.190:46603 every 8 connection(s)
I20260805 22:51:02.783540 9867 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
I20260805 22:51:02.784498 9967 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:51:02.786962 9967 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1ed5334d9e764f70be373100537c9330: Bootstrap starting.
I20260805 22:51:02.787658 9967 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1ed5334d9e764f70be373100537c9330: Neither blocks nor log segments found. Creating new log.
I20260805 22:51:02.787943 9967 log.cc:824] T 00000000000000000000000000000000 P 1ed5334d9e764f70be373100537c9330: Log is configured to *not* fsync() on all Append() calls
I20260805 22:51:02.788815 9967 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1ed5334d9e764f70be373100537c9330: No bootstrap required, opened a new log
I20260805 22:51:02.790139 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 9867
I20260805 22:51:02.790256 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/minicluster-data/master-0/wal/instance
I20260805 22:51:02.790446 15234 external_mini_cluster.cc:1428] Setting key 558507273db4cf14457479a017a87c30
I20260805 22:51:02.790681 9967 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1ed5334d9e764f70be373100537c9330 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ed5334d9e764f70be373100537c9330" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 46603 } }
I20260805 22:51:02.791142 9967 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1ed5334d9e764f70be373100537c9330 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:51:02.791206 9967 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1ed5334d9e764f70be373100537c9330 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ed5334d9e764f70be373100537c9330, State: Initialized, Role: FOLLOWER
I20260805 22:51:02.791378 9967 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1ed5334d9e764f70be373100537c9330 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ed5334d9e764f70be373100537c9330" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 46603 } }
I20260805 22:51:02.791477 9967 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1ed5334d9e764f70be373100537c9330 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:51:02.791515 9967 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1ed5334d9e764f70be373100537c9330 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:51:02.791565 9967 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1ed5334d9e764f70be373100537c9330 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:51:02.792693 9967 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1ed5334d9e764f70be373100537c9330 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ed5334d9e764f70be373100537c9330" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 46603 } }
I20260805 22:51:02.792819 9967 leader_election.cc:302] T 00000000000000000000000000000000 P 1ed5334d9e764f70be373100537c9330 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1ed5334d9e764f70be373100537c9330; no voters:
I20260805 22:51:02.793006 9967 leader_election.cc:288] T 00000000000000000000000000000000 P 1ed5334d9e764f70be373100537c9330 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:51:02.793054 9973 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1ed5334d9e764f70be373100537c9330 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:51:02.793206 9973 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1ed5334d9e764f70be373100537c9330 [term 1 LEADER]: Becoming Leader. State: Replica: 1ed5334d9e764f70be373100537c9330, State: Running, Role: LEADER
I20260805 22:51:02.793284 9967 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1ed5334d9e764f70be373100537c9330 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:51:02.793310 9973 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1ed5334d9e764f70be373100537c9330 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ed5334d9e764f70be373100537c9330" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 46603 } }
I20260805 22:51:02.793691 9973 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ed5334d9e764f70be373100537c9330 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1ed5334d9e764f70be373100537c9330. Latest consensus state: current_term: 1 leader_uuid: "1ed5334d9e764f70be373100537c9330" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ed5334d9e764f70be373100537c9330" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 46603 } } }
I20260805 22:51:02.793787 9973 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ed5334d9e764f70be373100537c9330 [sys.catalog]: This master's current role is: LEADER
I20260805 22:51:02.793702 9977 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ed5334d9e764f70be373100537c9330 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1ed5334d9e764f70be373100537c9330" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ed5334d9e764f70be373100537c9330" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 46603 } } }
I20260805 22:51:02.793943 9977 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ed5334d9e764f70be373100537c9330 [sys.catalog]: This master's current role is: LEADER
W20260805 22:51:02.795245 9997 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1ed5334d9e764f70be373100537c9330: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260805 22:51:02.795326 9997 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260805 22:51:02.795420 9987 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:51:02.795619 9987 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:51:02.797467 9987 catalog_manager.cc:1347] Generated new cluster ID: 43a63864bcda4bfe82587a48e16dbf8e
I20260805 22:51:02.797528 9987 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 05 22:51:02 dist-test-slave-gjrz krb5kdc[9848](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970262, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:51:02.801406 9972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:02.790968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46718 (local address 127.14.224.190:46603)
0805 22:51:02.791166 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:02.791178 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:02.791216 (+ 38us) server_negotiation.cc:407] Connection header received
0805 22:51:02.791386 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:02.791394 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:02.791468 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:02.791650 (+ 182us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:02.792275 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:02.793683 (+ 1408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:02.794838 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:02.795486 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:02.795610 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:02.798273 (+ 2663us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:02.798278 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:02.798278 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:51:02.798292 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:02.799891 (+ 1599us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:02.800235 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:02.800239 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:02.800239 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:02.800351 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:02.800535 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:02.800536 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:02.800536 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:02.800787 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:02.800940 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:02.801045 (+ 105us) server_negotiation.cc:299] Negotiation successful
0805 22:51:02.801203 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":109,"threads_started":1}
I20260805 22:51:02.811053 9987 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:51:02.811676 9987 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:51:02.817373 9987 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1ed5334d9e764f70be373100537c9330: Generated new TSK 0
I20260805 22:51:02.817593 9987 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.224.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab.
Entry for principal kudu/127.14.224.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab.
I20260805 22:51:02.850008 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.129:0
--local_ip_for_outbound_sockets=127.14.224.129
--webserver_interface=127.14.224.129
--webserver_port=0
--tserver_master_addrs=127.14.224.190:46603
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab
--principal=kudu/127.14.224.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:34235
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:51:02.938370 10003 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:51:02.938609 10003 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:51:02.938637 10003 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:51:02.939936 10003 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:51:02.939993 10003 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:51:02.940023 10003 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.129
I20260805 22:51:02.941685 10003 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:34235
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab
--principal=kudu/127.14.224.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.224.129
--webserver_port=0
--tserver_master_addrs=127.14.224.190:46603
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10003
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.129
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:51:02.941967 10003 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:51:02.942224 10003 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:51:02.947420 10010 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:02.947441 10011 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:02.947420 10015 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:51:02.947672 10003 server_base.cc:1034] running on GCE node
I20260805 22:51:02.947928 10003 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:51:02.948170 10003 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:51:02.949326 10003 hybrid_clock.cc:648] HybridClock initialized: now 1785970262949310 us; error 31 us; skew 500 ppm
Aug 05 22:51:02 dist-test-slave-gjrz krb5kdc[9848](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970262, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:51:02.952026 10003 init.cc:377] Logged in from keytab as kudu/127.14.224.129@KRBTEST.COM (short username kudu)
I20260805 22:51:02.952495 10003 webserver.cc:460] Webserver started at http://127.14.224.129:42105/ using document root <none> and password file <none>
I20260805 22:51:02.952732 10003 fs_manager.cc:359] Metadata directory not provided
I20260805 22:51:02.952785 10003 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:51:02.952924 10003 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:51:02.954008 10003 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/minicluster-data/ts-0/data/instance:
uuid: "daf9f104fabf4074a6c0a1f5585a3780"
format_stamp: "Formatted at 2026-08-05 22:51:02 on dist-test-slave-gjrz"
server_key: "41f71e93a119f6ab750b8a8e5636c828"
server_key_iv: "b76b2b7007ae45377870317604c9573c"
server_key_version: "encryptionkey@0"
I20260805 22:51:02.954357 10003 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/minicluster-data/ts-0/wal/instance:
uuid: "daf9f104fabf4074a6c0a1f5585a3780"
format_stamp: "Formatted at 2026-08-05 22:51:02 on dist-test-slave-gjrz"
server_key: "41f71e93a119f6ab750b8a8e5636c828"
server_key_iv: "b76b2b7007ae45377870317604c9573c"
server_key_version: "encryptionkey@0"
I20260805 22:51:02.955780 10003 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260805 22:51:02.956593 10024 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:02.956754 10003 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260805 22:51:02.956845 10003 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/minicluster-data/ts-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/minicluster-data/ts-0/wal
uuid: "daf9f104fabf4074a6c0a1f5585a3780"
format_stamp: "Formatted at 2026-08-05 22:51:02 on dist-test-slave-gjrz"
server_key: "41f71e93a119f6ab750b8a8e5636c828"
server_key_iv: "b76b2b7007ae45377870317604c9573c"
server_key_version: "encryptionkey@0"
I20260805 22:51:02.956941 10003 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:51:02.964380 10003 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:51:02.966559 10003 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:51:02.966713 10003 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:51:02.966958 10003 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:51:02.967289 10003 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:51:02.967334 10003 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:02.967367 10003 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:51:02.967391 10003 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:02.973233 10003 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.129:35515
I20260805 22:51:02.973284 10203 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.129:35515 every 8 connection(s)
I20260805 22:51:02.973613 10003 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
I20260805 22:51:02.976188 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 10003
I20260805 22:51:02.976301 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/minicluster-data/ts-0/wal/instance
I20260805 22:51:02.976531 15234 external_mini_cluster.cc:1428] Setting key 6bdd34b98b33dc815f21a0a47c1ce202
Aug 05 22:51:02 dist-test-slave-gjrz krb5kdc[9848](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970262, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.129@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:51:02.983800 9972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:02.974387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.129:45341 (local address 127.14.224.190:46603)
0805 22:51:02.974465 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:02.974468 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:02.974650 (+ 182us) server_negotiation.cc:407] Connection header received
0805 22:51:02.975232 (+ 582us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:02.975234 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:02.975250 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:02.975329 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:02.976356 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:02.977065 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:02.978145 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:02.978420 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:02.978507 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:02.980808 (+ 2301us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:02.980810 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:02.980811 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:51:02.980819 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:02.982221 (+ 1402us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:02.982726 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:02.982727 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:02.982727 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:02.982778 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:02.983080 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:02.983081 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:02.983081 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:02.983192 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:02.983241 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:02.983644 (+ 403us) server_negotiation.cc:299] Negotiation successful
0805 22:51:02.983723 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260805 22:51:02.984081 10206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:02.974347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:46603 (local address 127.14.224.129:45341)
0805 22:51:02.974527 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:02.974567 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0805 22:51:02.975108 (+ 541us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:51:02.975419 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:51:02.975422 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:51:02.976053 (+ 631us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:51:02.976264 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:02.976270 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:02.977187 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:02.977189 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:02.978052 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:02.978055 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:02.978516 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:02.978517 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:02.978631 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:02.979171 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:51:02.979180 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:51:02.980694 (+ 1514us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:51:02.982316 (+ 1622us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:51:02.982325 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:51:02.982327 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:51:02.982650 (+ 323us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:51:02.982834 (+ 184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:51:02.982834 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:51:02.982835 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:51:02.982997 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:51:02.983252 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:51:02.983259 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:51:02.983480 (+ 221us) client_negotiation.cc:769] Sending connection context
0805 22:51:02.983611 (+ 131us) client_negotiation.cc:240] Negotiation successful
0805 22:51:02.983805 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":80,"threads_started":1}
I20260805 22:51:02.984680 10204 heartbeater.cc:347] Connected to a master server at 127.14.224.190:46603
I20260805 22:51:02.984778 10204 heartbeater.cc:464] Registering TS with master...
I20260805 22:51:02.984974 10204 heartbeater.cc:511] Master 127.14.224.190:46603 requested a full tablet report, sending...
I20260805 22:51:02.985528 9911 ts_manager.cc:194] Registered new tserver with Master: daf9f104fabf4074a6c0a1f5585a3780 (127.14.224.129:35515)
WARNING: no policy specified for kudu/127.14.224.130@KRBTEST.COM; defaulting to no policy
I20260805 22:51:02.986153 9911 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.224.129@KRBTEST.COM'} at 127.14.224.129:45341
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab.
Entry for principal kudu/127.14.224.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab.
I20260805 22:51:03.006057 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.130:0
--local_ip_for_outbound_sockets=127.14.224.130
--webserver_interface=127.14.224.130
--webserver_port=0
--tserver_master_addrs=127.14.224.190:46603
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab
--principal=kudu/127.14.224.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:34235
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:51:03.090171 10209 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:51:03.090420 10209 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:51:03.090456 10209 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:51:03.091730 10209 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:51:03.091786 10209 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:51:03.091826 10209 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.130
I20260805 22:51:03.093708 10209 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:34235
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab
--principal=kudu/127.14.224.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.224.130
--webserver_port=0
--tserver_master_addrs=127.14.224.190:46603
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10209
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.130
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:51:03.094033 10209 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:51:03.094303 10209 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:51:03.099647 10222 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:03.099677 10219 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:51:03.099733 10209 server_base.cc:1034] running on GCE node
W20260805 22:51:03.099647 10220 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:51:03.100076 10209 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:51:03.100324 10209 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:51:03.101496 10209 hybrid_clock.cc:648] HybridClock initialized: now 1785970263101479 us; error 29 us; skew 500 ppm
Aug 05 22:51:03 dist-test-slave-gjrz krb5kdc[9848](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970263, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:51:03.104132 10209 init.cc:377] Logged in from keytab as kudu/127.14.224.130@KRBTEST.COM (short username kudu)
I20260805 22:51:03.104629 10209 webserver.cc:460] Webserver started at http://127.14.224.130:35947/ using document root <none> and password file <none>
I20260805 22:51:03.104868 10209 fs_manager.cc:359] Metadata directory not provided
I20260805 22:51:03.104920 10209 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:51:03.105067 10209 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:51:03.106184 10209 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/minicluster-data/ts-1/data/instance:
uuid: "b281c862bf0545d382d461cf7c17883c"
format_stamp: "Formatted at 2026-08-05 22:51:03 on dist-test-slave-gjrz"
server_key: "d2b9de3c1b70c832a91b3a72fd6d8f29"
server_key_iv: "4210ea34a6c449a72929d29f135ab723"
server_key_version: "encryptionkey@0"
I20260805 22:51:03.106552 10209 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/minicluster-data/ts-1/wal/instance:
uuid: "b281c862bf0545d382d461cf7c17883c"
format_stamp: "Formatted at 2026-08-05 22:51:03 on dist-test-slave-gjrz"
server_key: "d2b9de3c1b70c832a91b3a72fd6d8f29"
server_key_iv: "4210ea34a6c449a72929d29f135ab723"
server_key_version: "encryptionkey@0"
I20260805 22:51:03.108023 10209 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260805 22:51:03.108780 10232 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:03.108987 10209 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:51:03.109072 10209 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/minicluster-data/ts-1/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/minicluster-data/ts-1/wal
uuid: "b281c862bf0545d382d461cf7c17883c"
format_stamp: "Formatted at 2026-08-05 22:51:03 on dist-test-slave-gjrz"
server_key: "d2b9de3c1b70c832a91b3a72fd6d8f29"
server_key_iv: "4210ea34a6c449a72929d29f135ab723"
server_key_version: "encryptionkey@0"
I20260805 22:51:03.109139 10209 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:51:03.122701 10209 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:51:03.124855 10209 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:51:03.125015 10209 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:51:03.125257 10209 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:51:03.125564 10209 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:51:03.125599 10209 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:03.125630 10209 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:51:03.125653 10209 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:03.131318 10209 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.130:41785
I20260805 22:51:03.131372 10396 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.130:41785 every 8 connection(s)
I20260805 22:51:03.131702 10209 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
I20260805 22:51:03.132102 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 10209
I20260805 22:51:03.132246 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/minicluster-data/ts-1/wal/instance
I20260805 22:51:03.132493 15234 external_mini_cluster.cc:1428] Setting key f893f416315ae21883311058d747a503
Aug 05 22:51:03 dist-test-slave-gjrz krb5kdc[9848](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970263, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.130@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.14.224.131@KRBTEST.COM; defaulting to no policy
I20260805 22:51:03.142618 9972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:03.132592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:51765 (local address 127.14.224.190:46603)
0805 22:51:03.132658 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:03.132661 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:03.132907 (+ 246us) server_negotiation.cc:407] Connection header received
0805 22:51:03.133601 (+ 694us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:03.133602 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:03.133612 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:03.133669 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:03.134951 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:03.135792 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:03.136856 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:03.137125 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:03.137193 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:03.139825 (+ 2632us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:03.139826 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:03.139827 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:51:03.139835 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:03.141199 (+ 1364us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:03.141688 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:03.141689 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:03.141689 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:03.141747 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:03.142026 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:03.142026 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:03.142026 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:03.142147 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:03.142201 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:03.142476 (+ 275us) server_negotiation.cc:299] Negotiation successful
0805 22:51:03.142546 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260805 22:51:03.142828 10399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:03.132578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:46603 (local address 127.14.224.130:51765)
0805 22:51:03.132774 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:03.132828 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0805 22:51:03.133459 (+ 631us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:51:03.133757 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:51:03.133761 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:51:03.134539 (+ 778us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:51:03.134829 (+ 290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:03.134835 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:03.135912 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:03.135913 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:03.136755 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:03.136757 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:03.137206 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:03.137206 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:03.137311 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:03.137913 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:51:03.137925 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:51:03.139686 (+ 1761us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:51:03.141292 (+ 1606us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:51:03.141302 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:51:03.141305 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:51:03.141612 (+ 307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:51:03.141805 (+ 193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:51:03.141806 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:51:03.141806 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:51:03.141966 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:51:03.142222 (+ 256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:51:03.142229 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:51:03.142365 (+ 136us) client_negotiation.cc:769] Sending connection context
0805 22:51:03.142457 (+ 92us) client_negotiation.cc:240] Negotiation successful
0805 22:51:03.142597 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":98,"threads_started":1}
I20260805 22:51:03.143375 10397 heartbeater.cc:347] Connected to a master server at 127.14.224.190:46603
I20260805 22:51:03.143476 10397 heartbeater.cc:464] Registering TS with master...
I20260805 22:51:03.143643 10397 heartbeater.cc:511] Master 127.14.224.190:46603 requested a full tablet report, sending...
I20260805 22:51:03.144161 9911 ts_manager.cc:194] Registered new tserver with Master: b281c862bf0545d382d461cf7c17883c (127.14.224.130:41785)
I20260805 22:51:03.144546 9911 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.224.130@KRBTEST.COM'} at 127.14.224.130:51765
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab.
Entry for principal kudu/127.14.224.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab.
I20260805 22:51:03.162950 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.131:0
--local_ip_for_outbound_sockets=127.14.224.131
--webserver_interface=127.14.224.131
--webserver_port=0
--tserver_master_addrs=127.14.224.190:46603
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab
--principal=kudu/127.14.224.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:34235
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:51:03.248376 10402 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:51:03.248615 10402 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:51:03.248651 10402 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:51:03.249883 10402 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:51:03.249933 10402 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:51:03.249972 10402 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.131
I20260805 22:51:03.251573 10402 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:34235
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab
--principal=kudu/127.14.224.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.224.131
--webserver_port=0
--tserver_master_addrs=127.14.224.190:46603
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10402
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.131
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:51:03.251832 10402 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:51:03.252065 10402 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260805 22:51:03.257256 10402 server_base.cc:1034] running on GCE node
W20260805 22:51:03.257237 10411 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:03.257231 10408 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:03.257237 10407 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:51:03.257665 10402 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:51:03.257908 10402 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:51:03.259083 10402 hybrid_clock.cc:648] HybridClock initialized: now 1785970263259065 us; error 29 us; skew 500 ppm
Aug 05 22:51:03 dist-test-slave-gjrz krb5kdc[9848](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970263, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:51:03.261649 10402 init.cc:377] Logged in from keytab as kudu/127.14.224.131@KRBTEST.COM (short username kudu)
I20260805 22:51:03.262141 10402 webserver.cc:460] Webserver started at http://127.14.224.131:37351/ using document root <none> and password file <none>
I20260805 22:51:03.262357 10402 fs_manager.cc:359] Metadata directory not provided
I20260805 22:51:03.262406 10402 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:51:03.262557 10402 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:51:03.263710 10402 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/minicluster-data/ts-2/data/instance:
uuid: "fba46eb3111b497085ed7593f09a0793"
format_stamp: "Formatted at 2026-08-05 22:51:03 on dist-test-slave-gjrz"
server_key: "1b6d57ac7898871794e9d8d9be565e52"
server_key_iv: "243ee4516cdbf3fcdb4a0bedb7d61f83"
server_key_version: "encryptionkey@0"
I20260805 22:51:03.264068 10402 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/minicluster-data/ts-2/wal/instance:
uuid: "fba46eb3111b497085ed7593f09a0793"
format_stamp: "Formatted at 2026-08-05 22:51:03 on dist-test-slave-gjrz"
server_key: "1b6d57ac7898871794e9d8d9be565e52"
server_key_iv: "243ee4516cdbf3fcdb4a0bedb7d61f83"
server_key_version: "encryptionkey@0"
I20260805 22:51:03.265391 10402 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260805 22:51:03.266171 10425 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:03.266371 10402 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:51:03.266485 10402 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/minicluster-data/ts-2/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/minicluster-data/ts-2/wal
uuid: "fba46eb3111b497085ed7593f09a0793"
format_stamp: "Formatted at 2026-08-05 22:51:03 on dist-test-slave-gjrz"
server_key: "1b6d57ac7898871794e9d8d9be565e52"
server_key_iv: "243ee4516cdbf3fcdb4a0bedb7d61f83"
server_key_version: "encryptionkey@0"
I20260805 22:51:03.266552 10402 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:51:03.276924 10402 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:51:03.279120 10402 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:51:03.279292 10402 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:51:03.279552 10402 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:51:03.279873 10402 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:51:03.279914 10402 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:03.279943 10402 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:51:03.279961 10402 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:03.285745 10402 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.131:35233
I20260805 22:51:03.285789 10591 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.131:35233 every 8 connection(s)
I20260805 22:51:03.286123 10402 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
I20260805 22:51:03.289192 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 10402
I20260805 22:51:03.289306 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/minicluster-data/ts-2/wal/instance
I20260805 22:51:03.289526 15234 external_mini_cluster.cc:1428] Setting key 31477d8652b2ad3dbec3f2f3947c7478
Aug 05 22:51:03 dist-test-slave-gjrz krb5kdc[9848](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970263, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.131@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:51:03.295866 9972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:03.286864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:60693 (local address 127.14.224.190:46603)
0805 22:51:03.286909 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:03.286911 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:03.287161 (+ 250us) server_negotiation.cc:407] Connection header received
0805 22:51:03.287691 (+ 530us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:03.287692 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:03.287710 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:03.287770 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:03.288750 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:03.289421 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:03.290636 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:03.290830 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:03.290884 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:03.293146 (+ 2262us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:03.293148 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:03.293148 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:51:03.293157 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:03.294522 (+ 1365us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:03.294914 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:03.294915 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:03.294915 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:03.294970 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:03.295192 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:03.295193 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:03.295193 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:03.295353 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:03.295421 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:03.295689 (+ 268us) server_negotiation.cc:299] Negotiation successful
0805 22:51:03.295773 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260805 22:51:03.296113 10594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:03.286838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:46603 (local address 127.14.224.131:60693)
0805 22:51:03.287006 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:03.287050 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0805 22:51:03.287590 (+ 540us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:51:03.287837 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:51:03.287840 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:51:03.288445 (+ 605us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:51:03.288662 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:03.288667 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:03.289529 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:03.289530 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:03.290563 (+ 1033us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:03.290567 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:03.290893 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:03.290894 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:03.290998 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:03.291523 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:51:03.291532 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:51:03.293057 (+ 1525us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:51:03.294608 (+ 1551us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:51:03.294616 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:51:03.294618 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:51:03.294843 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:51:03.295025 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:51:03.295026 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:51:03.295026 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:51:03.295136 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:51:03.295411 (+ 275us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:51:03.295419 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:51:03.295564 (+ 145us) client_negotiation.cc:769] Sending connection context
0805 22:51:03.295658 (+ 94us) client_negotiation.cc:240] Negotiation successful
0805 22:51:03.295826 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":77,"threads_started":1}
I20260805 22:51:03.296595 10592 heartbeater.cc:347] Connected to a master server at 127.14.224.190:46603
I20260805 22:51:03.296700 10592 heartbeater.cc:464] Registering TS with master...
I20260805 22:51:03.296885 10592 heartbeater.cc:511] Master 127.14.224.190:46603 requested a full tablet report, sending...
I20260805 22:51:03.297246 9911 ts_manager.cc:194] Registered new tserver with Master: fba46eb3111b497085ed7593f09a0793 (127.14.224.131:35233)
I20260805 22:51:03.297605 9911 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.224.131@KRBTEST.COM'} at 127.14.224.131:60693
I20260805 22:51:03.301618 15234 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 22:51:03.308827 9972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:03.302940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46732 (local address 127.14.224.190:46603)
0805 22:51:03.302999 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:03.303001 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:03.303058 (+ 57us) server_negotiation.cc:407] Connection header received
0805 22:51:03.303124 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:03.303125 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:03.303135 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:03.303179 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:03.303779 (+ 600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:03.304296 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:03.305065 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:03.305250 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:03.305304 (+ 54us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:03.306541 (+ 1237us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:03.306543 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:03.306543 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:51:03.306551 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:03.307655 (+ 1104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:03.308051 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:03.308052 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:03.308053 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:03.308103 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:03.308292 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:03.308292 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:03.308293 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:03.308431 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:03.308526 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:03.308669 (+ 143us) server_negotiation.cc:299] Negotiation successful
0805 22:51:03.308731 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260805 22:51:03.310297 9911 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46732:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:51:03.312182 9911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:51:03.318497 10605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:03.314323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.129:35515 (local address 127.0.0.1:34458)
0805 22:51:03.314662 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:03.314709 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0805 22:51:03.314775 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:51:03.315288 (+ 513us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:51:03.315288 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:51:03.315290 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:51:03.315333 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:03.315335 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:03.316221 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:03.316222 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:03.317472 (+ 1250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:03.317475 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:03.318163 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:03.318164 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:03.318244 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:03.318258 (+ 14us) client_negotiation.cc:769] Sending connection context
0805 22:51:03.318324 (+ 66us) client_negotiation.cc:240] Negotiation successful
0805 22:51:03.318382 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":308,"thread_start_us":71,"threads_started":1}
I20260805 22:51:03.318496 10614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:03.314326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.131:35233 (local address 127.0.0.1:44688)
0805 22:51:03.314662 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:03.314709 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0805 22:51:03.314775 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:51:03.315384 (+ 609us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:51:03.315385 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:51:03.315387 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:51:03.315418 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:03.315419 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:03.316628 (+ 1209us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:03.316629 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:03.317474 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:03.317477 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:03.318290 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:03.318291 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:03.318346 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:03.318349 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:51:03.318398 (+ 49us) client_negotiation.cc:240] Negotiation successful
0805 22:51:03.318430 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":314,"thread_start_us":63,"threads_started":1}
I20260805 22:51:03.318547 10611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:03.314485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44688 (local address 127.14.224.131:35233)
0805 22:51:03.315213 (+ 728us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:03.315217 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:03.315226 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:51:03.315291 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:03.315294 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:03.315310 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:03.315388 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:51:03.315468 (+ 80us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:03.316526 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:03.317550 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:03.318221 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:03.318294 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:03.318342 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:03.318423 (+ 81us) server_negotiation.cc:299] Negotiation successful
0805 22:51:03.318462 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":694,"thread_start_us":128,"threads_started":1}
I20260805 22:51:03.318781 10609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:03.314449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34458 (local address 127.14.224.129:35515)
0805 22:51:03.314911 (+ 462us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:03.314915 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:03.314925 (+ 10us) server_negotiation.cc:407] Connection header received
0805 22:51:03.314963 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:03.314965 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:03.314982 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:03.315072 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:51:03.315414 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:03.316123 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:03.317571 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:03.318083 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:03.318150 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:03.318212 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:03.318647 (+ 435us) server_negotiation.cc:299] Negotiation successful
0805 22:51:03.318694 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":422,"thread_start_us":99,"threads_started":1}
I20260805 22:51:03.319253 10608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:03.314548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.130:41785 (local address 127.0.0.1:50210)
0805 22:51:03.314862 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:03.314869 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0805 22:51:03.314909 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:51:03.315100 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:51:03.315103 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:51:03.315106 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:51:03.315181 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:03.315183 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:03.316519 (+ 1336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:03.316520 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:03.317569 (+ 1049us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:03.317571 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:03.318998 (+ 1427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:03.318999 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:03.319061 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:03.319066 (+ 5us) client_negotiation.cc:769] Sending connection context
0805 22:51:03.319139 (+ 73us) client_negotiation.cc:240] Negotiation successful
0805 22:51:03.319183 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":304,"thread_start_us":62,"threads_started":1}
I20260805 22:51:03.319401 10615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:03.314711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50210 (local address 127.14.224.130:41785)
0805 22:51:03.314869 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:03.314874 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:03.314908 (+ 34us) server_negotiation.cc:407] Connection header received
0805 22:51:03.314963 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:03.314965 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:03.314981 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:03.315072 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:51:03.315250 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:03.316408 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:03.317641 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:03.318445 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:03.318508 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:03.318553 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:03.319168 (+ 615us) server_negotiation.cc:299] Negotiation successful
0805 22:51:03.319215 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":77,"threads_started":1}
I20260805 22:51:03.319444 10496 tablet_service.cc:1467] Processing CreateTablet for tablet 63408abb39dd4c3dbaa04cf63814a2b1 (DEFAULT_TABLE table=test-table [id=9e4dadd2c3404a80b247ba6faa41fcb6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:51:03.319536 10095 tablet_service.cc:1467] Processing CreateTablet for tablet 63408abb39dd4c3dbaa04cf63814a2b1 (DEFAULT_TABLE table=test-table [id=9e4dadd2c3404a80b247ba6faa41fcb6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:51:03.319864 10496 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63408abb39dd4c3dbaa04cf63814a2b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:51:03.319888 10095 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63408abb39dd4c3dbaa04cf63814a2b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:51:03.320029 10306 tablet_service.cc:1467] Processing CreateTablet for tablet 63408abb39dd4c3dbaa04cf63814a2b1 (DEFAULT_TABLE table=test-table [id=9e4dadd2c3404a80b247ba6faa41fcb6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:51:03.320335 10306 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63408abb39dd4c3dbaa04cf63814a2b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:51:03.322533 10620 tablet_bootstrap.cc:492] T 63408abb39dd4c3dbaa04cf63814a2b1 P daf9f104fabf4074a6c0a1f5585a3780: Bootstrap starting.
I20260805 22:51:03.323381 10620 tablet_bootstrap.cc:654] T 63408abb39dd4c3dbaa04cf63814a2b1 P daf9f104fabf4074a6c0a1f5585a3780: Neither blocks nor log segments found. Creating new log.
I20260805 22:51:03.323385 10622 tablet_bootstrap.cc:492] T 63408abb39dd4c3dbaa04cf63814a2b1 P fba46eb3111b497085ed7593f09a0793: Bootstrap starting.
I20260805 22:51:03.323589 10623 tablet_bootstrap.cc:492] T 63408abb39dd4c3dbaa04cf63814a2b1 P b281c862bf0545d382d461cf7c17883c: Bootstrap starting.
I20260805 22:51:03.324054 10622 tablet_bootstrap.cc:654] T 63408abb39dd4c3dbaa04cf63814a2b1 P fba46eb3111b497085ed7593f09a0793: Neither blocks nor log segments found. Creating new log.
I20260805 22:51:03.324167 10620 log.cc:824] T 63408abb39dd4c3dbaa04cf63814a2b1 P daf9f104fabf4074a6c0a1f5585a3780: Log is configured to *not* fsync() on all Append() calls
I20260805 22:51:03.324232 10623 tablet_bootstrap.cc:654] T 63408abb39dd4c3dbaa04cf63814a2b1 P b281c862bf0545d382d461cf7c17883c: Neither blocks nor log segments found. Creating new log.
I20260805 22:51:03.324569 10622 log.cc:824] T 63408abb39dd4c3dbaa04cf63814a2b1 P fba46eb3111b497085ed7593f09a0793: Log is configured to *not* fsync() on all Append() calls
I20260805 22:51:03.324750 10623 log.cc:824] T 63408abb39dd4c3dbaa04cf63814a2b1 P b281c862bf0545d382d461cf7c17883c: Log is configured to *not* fsync() on all Append() calls
I20260805 22:51:03.325107 10620 tablet_bootstrap.cc:492] T 63408abb39dd4c3dbaa04cf63814a2b1 P daf9f104fabf4074a6c0a1f5585a3780: No bootstrap required, opened a new log
I20260805 22:51:03.325187 10620 ts_tablet_manager.cc:1397] T 63408abb39dd4c3dbaa04cf63814a2b1 P daf9f104fabf4074a6c0a1f5585a3780: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260805 22:51:03.325485 10623 tablet_bootstrap.cc:492] T 63408abb39dd4c3dbaa04cf63814a2b1 P b281c862bf0545d382d461cf7c17883c: No bootstrap required, opened a new log
I20260805 22:51:03.325546 10623 ts_tablet_manager.cc:1397] T 63408abb39dd4c3dbaa04cf63814a2b1 P b281c862bf0545d382d461cf7c17883c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260805 22:51:03.326740 10620 raft_consensus.cc:348] T 63408abb39dd4c3dbaa04cf63814a2b1 P daf9f104fabf4074a6c0a1f5585a3780 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fba46eb3111b497085ed7593f09a0793" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 35233 } } peers { permanent_uuid: "daf9f104fabf4074a6c0a1f5585a3780" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 35515 } } peers { permanent_uuid: "b281c862bf0545d382d461cf7c17883c" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41785 } }
I20260805 22:51:03.326896 10620 raft_consensus.cc:374] T 63408abb39dd4c3dbaa04cf63814a2b1 P daf9f104fabf4074a6c0a1f5585a3780 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:51:03.326920 10620 raft_consensus.cc:729] T 63408abb39dd4c3dbaa04cf63814a2b1 P daf9f104fabf4074a6c0a1f5585a3780 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: daf9f104fabf4074a6c0a1f5585a3780, State: Initialized, Role: FOLLOWER
I20260805 22:51:03.326893 10623 raft_consensus.cc:348] T 63408abb39dd4c3dbaa04cf63814a2b1 P b281c862bf0545d382d461cf7c17883c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fba46eb3111b497085ed7593f09a0793" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 35233 } } peers { permanent_uuid: "daf9f104fabf4074a6c0a1f5585a3780" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 35515 } } peers { permanent_uuid: "b281c862bf0545d382d461cf7c17883c" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41785 } }
I20260805 22:51:03.327028 10620 consensus_queue.cc:260] T 63408abb39dd4c3dbaa04cf63814a2b1 P daf9f104fabf4074a6c0a1f5585a3780 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fba46eb3111b497085ed7593f09a0793" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 35233 } } peers { permanent_uuid: "daf9f104fabf4074a6c0a1f5585a3780" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 35515 } } peers { permanent_uuid: "b281c862bf0545d382d461cf7c17883c" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41785 } }
I20260805 22:51:03.327070 10623 raft_consensus.cc:374] T 63408abb39dd4c3dbaa04cf63814a2b1 P b281c862bf0545d382d461cf7c17883c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:51:03.327111 10623 raft_consensus.cc:729] T 63408abb39dd4c3dbaa04cf63814a2b1 P b281c862bf0545d382d461cf7c17883c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b281c862bf0545d382d461cf7c17883c, State: Initialized, Role: FOLLOWER
I20260805 22:51:03.327226 10623 consensus_queue.cc:260] T 63408abb39dd4c3dbaa04cf63814a2b1 P b281c862bf0545d382d461cf7c17883c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fba46eb3111b497085ed7593f09a0793" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 35233 } } peers { permanent_uuid: "daf9f104fabf4074a6c0a1f5585a3780" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 35515 } } peers { permanent_uuid: "b281c862bf0545d382d461cf7c17883c" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41785 } }
I20260805 22:51:03.327342 10620 ts_tablet_manager.cc:1428] T 63408abb39dd4c3dbaa04cf63814a2b1 P daf9f104fabf4074a6c0a1f5585a3780: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260805 22:51:03.327462 10204 heartbeater.cc:503] Master 127.14.224.190:46603 was elected leader, sending a full tablet report...
I20260805 22:51:03.327541 10623 ts_tablet_manager.cc:1428] T 63408abb39dd4c3dbaa04cf63814a2b1 P b281c862bf0545d382d461cf7c17883c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260805 22:51:03.327739 10397 heartbeater.cc:503] Master 127.14.224.190:46603 was elected leader, sending a full tablet report...
I20260805 22:51:03.327898 10622 tablet_bootstrap.cc:492] T 63408abb39dd4c3dbaa04cf63814a2b1 P fba46eb3111b497085ed7593f09a0793: No bootstrap required, opened a new log
I20260805 22:51:03.327970 10622 ts_tablet_manager.cc:1397] T 63408abb39dd4c3dbaa04cf63814a2b1 P fba46eb3111b497085ed7593f09a0793: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260805 22:51:03.329778 10622 raft_consensus.cc:348] T 63408abb39dd4c3dbaa04cf63814a2b1 P fba46eb3111b497085ed7593f09a0793 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fba46eb3111b497085ed7593f09a0793" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 35233 } } peers { permanent_uuid: "daf9f104fabf4074a6c0a1f5585a3780" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 35515 } } peers { permanent_uuid: "b281c862bf0545d382d461cf7c17883c" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41785 } }
I20260805 22:51:03.329931 10622 raft_consensus.cc:374] T 63408abb39dd4c3dbaa04cf63814a2b1 P fba46eb3111b497085ed7593f09a0793 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:51:03.329952 10622 raft_consensus.cc:729] T 63408abb39dd4c3dbaa04cf63814a2b1 P fba46eb3111b497085ed7593f09a0793 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fba46eb3111b497085ed7593f09a0793, State: Initialized, Role: FOLLOWER
I20260805 22:51:03.330041 10622 consensus_queue.cc:260] T 63408abb39dd4c3dbaa04cf63814a2b1 P fba46eb3111b497085ed7593f09a0793 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fba46eb3111b497085ed7593f09a0793" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 35233 } } peers { permanent_uuid: "daf9f104fabf4074a6c0a1f5585a3780" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 35515 } } peers { permanent_uuid: "b281c862bf0545d382d461cf7c17883c" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41785 } }
I20260805 22:51:03.330281 10622 ts_tablet_manager.cc:1428] T 63408abb39dd4c3dbaa04cf63814a2b1 P fba46eb3111b497085ed7593f09a0793: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260805 22:51:03.330338 10592 heartbeater.cc:503] Master 127.14.224.190:46603 was elected leader, sending a full tablet report...
I20260805 22:51:03.334519 10635 raft_consensus.cc:482] T 63408abb39dd4c3dbaa04cf63814a2b1 P b281c862bf0545d382d461cf7c17883c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:51:03.334613 10635 raft_consensus.cc:504] T 63408abb39dd4c3dbaa04cf63814a2b1 P b281c862bf0545d382d461cf7c17883c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fba46eb3111b497085ed7593f09a0793" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 35233 } } peers { permanent_uuid: "daf9f104fabf4074a6c0a1f5585a3780" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 35515 } } peers { permanent_uuid: "b281c862bf0545d382d461cf7c17883c" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41785 } }
I20260805 22:51:03.334901 10635 leader_election.cc:288] T 63408abb39dd4c3dbaa04cf63814a2b1 P b281c862bf0545d382d461cf7c17883c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fba46eb3111b497085ed7593f09a0793 (127.14.224.131:35233), daf9f104fabf4074a6c0a1f5585a3780 (127.14.224.129:35515)
I20260805 22:51:03.338925 10611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:03.335156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:53577 (local address 127.14.224.131:35233)
0805 22:51:03.335219 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:03.335221 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:03.335321 (+ 100us) server_negotiation.cc:407] Connection header received
0805 22:51:03.335458 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:03.335459 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:03.335468 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:03.335528 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:51:03.335644 (+ 116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:03.336380 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:03.337946 (+ 1566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:03.338541 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:03.338622 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:03.338629 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:03.338830 (+ 201us) server_negotiation.cc:299] Negotiation successful
0805 22:51:03.338874 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260805 22:51:03.338907 10609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:03.335304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:49397 (local address 127.14.224.129:35515)
0805 22:51:03.335352 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:03.335354 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:03.335362 (+ 8us) server_negotiation.cc:407] Connection header received
0805 22:51:03.335391 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:03.335392 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:03.335402 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:03.335464 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:51:03.335637 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:03.336391 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:03.337932 (+ 1541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:03.338527 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:03.338606 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:03.338617 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:03.338792 (+ 175us) server_negotiation.cc:299] Negotiation successful
0805 22:51:03.338838 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260805 22:51:03.338918 10399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:03.335065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.129:35515 (local address 127.14.224.130:49397)
0805 22:51:03.335117 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:03.335128 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:51:03.335167 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:51:03.335477 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:51:03.335478 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:51:03.335480 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:51:03.335553 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:03.335555 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:03.336489 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:03.336490 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:03.337822 (+ 1332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:03.337826 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:03.338633 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:03.338635 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:03.338721 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:03.338725 (+ 4us) client_negotiation.cc:769] Sending connection context
0805 22:51:03.338783 (+ 58us) client_negotiation.cc:240] Negotiation successful
0805 22:51:03.338830 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33,"mutex_wait_us":63}
I20260805 22:51:03.339346 10637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:03.335068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.131:35233 (local address 127.14.224.130:53577)
0805 22:51:03.335249 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:03.335258 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0805 22:51:03.335329 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:51:03.335531 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:51:03.335532 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:51:03.335534 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:51:03.335587 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:03.335588 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:03.336489 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:03.336490 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:03.337822 (+ 1332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:03.337826 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:03.338667 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:03.338669 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:03.338745 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:03.338749 (+ 4us) client_negotiation.cc:769] Sending connection context
0805 22:51:03.339188 (+ 439us) client_negotiation.cc:240] Negotiation successful
0805 22:51:03.339238 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"mutex_wait_us":56,"thread_start_us":116,"threads_started":1}
I20260805 22:51:03.339368 10132 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63408abb39dd4c3dbaa04cf63814a2b1" candidate_uuid: "b281c862bf0545d382d461cf7c17883c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "daf9f104fabf4074a6c0a1f5585a3780" is_pre_election: true
I20260805 22:51:03.339560 10132 raft_consensus.cc:2454] T 63408abb39dd4c3dbaa04cf63814a2b1 P daf9f104fabf4074a6c0a1f5585a3780 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b281c862bf0545d382d461cf7c17883c in term 0.
I20260805 22:51:03.339658 10525 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63408abb39dd4c3dbaa04cf63814a2b1" candidate_uuid: "b281c862bf0545d382d461cf7c17883c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fba46eb3111b497085ed7593f09a0793" is_pre_election: true
I20260805 22:51:03.339807 10525 raft_consensus.cc:2454] T 63408abb39dd4c3dbaa04cf63814a2b1 P fba46eb3111b497085ed7593f09a0793 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b281c862bf0545d382d461cf7c17883c in term 0.
I20260805 22:51:03.339823 10241 leader_election.cc:302] T 63408abb39dd4c3dbaa04cf63814a2b1 P b281c862bf0545d382d461cf7c17883c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b281c862bf0545d382d461cf7c17883c, daf9f104fabf4074a6c0a1f5585a3780; no voters:
I20260805 22:51:03.339943 10635 raft_consensus.cc:2781] T 63408abb39dd4c3dbaa04cf63814a2b1 P b281c862bf0545d382d461cf7c17883c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:51:03.340027 10635 raft_consensus.cc:482] T 63408abb39dd4c3dbaa04cf63814a2b1 P b281c862bf0545d382d461cf7c17883c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:51:03.340054 10635 raft_consensus.cc:3037] T 63408abb39dd4c3dbaa04cf63814a2b1 P b281c862bf0545d382d461cf7c17883c [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:51:03.340765 10635 raft_consensus.cc:504] T 63408abb39dd4c3dbaa04cf63814a2b1 P b281c862bf0545d382d461cf7c17883c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fba46eb3111b497085ed7593f09a0793" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 35233 } } peers { permanent_uuid: "daf9f104fabf4074a6c0a1f5585a3780" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 35515 } } peers { permanent_uuid: "b281c862bf0545d382d461cf7c17883c" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41785 } }
I20260805 22:51:03.340896 10635 leader_election.cc:288] T 63408abb39dd4c3dbaa04cf63814a2b1 P b281c862bf0545d382d461cf7c17883c [CANDIDATE]: Term 1 election: Requested vote from peers fba46eb3111b497085ed7593f09a0793 (127.14.224.131:35233), daf9f104fabf4074a6c0a1f5585a3780 (127.14.224.129:35515)
I20260805 22:51:03.341054 10525 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63408abb39dd4c3dbaa04cf63814a2b1" candidate_uuid: "b281c862bf0545d382d461cf7c17883c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fba46eb3111b497085ed7593f09a0793"
I20260805 22:51:03.341137 10525 raft_consensus.cc:3037] T 63408abb39dd4c3dbaa04cf63814a2b1 P fba46eb3111b497085ed7593f09a0793 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:51:03.341820 10525 raft_consensus.cc:2454] T 63408abb39dd4c3dbaa04cf63814a2b1 P fba46eb3111b497085ed7593f09a0793 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b281c862bf0545d382d461cf7c17883c in term 1.
I20260805 22:51:03.341948 10132 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63408abb39dd4c3dbaa04cf63814a2b1" candidate_uuid: "b281c862bf0545d382d461cf7c17883c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "daf9f104fabf4074a6c0a1f5585a3780"
I20260805 22:51:03.342052 10234 leader_election.cc:302] T 63408abb39dd4c3dbaa04cf63814a2b1 P b281c862bf0545d382d461cf7c17883c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b281c862bf0545d382d461cf7c17883c, fba46eb3111b497085ed7593f09a0793; no voters:
I20260805 22:51:03.342041 10132 raft_consensus.cc:3037] T 63408abb39dd4c3dbaa04cf63814a2b1 P daf9f104fabf4074a6c0a1f5585a3780 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:51:03.342140 10635 raft_consensus.cc:2781] T 63408abb39dd4c3dbaa04cf63814a2b1 P b281c862bf0545d382d461cf7c17883c [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:51:03.342324 10635 raft_consensus.cc:686] T 63408abb39dd4c3dbaa04cf63814a2b1 P b281c862bf0545d382d461cf7c17883c [term 1 LEADER]: Becoming Leader. State: Replica: b281c862bf0545d382d461cf7c17883c, State: Running, Role: LEADER
I20260805 22:51:03.342422 10635 consensus_queue.cc:237] T 63408abb39dd4c3dbaa04cf63814a2b1 P b281c862bf0545d382d461cf7c17883c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fba46eb3111b497085ed7593f09a0793" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 35233 } } peers { permanent_uuid: "daf9f104fabf4074a6c0a1f5585a3780" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 35515 } } peers { permanent_uuid: "b281c862bf0545d382d461cf7c17883c" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41785 } }
I20260805 22:51:03.342891 10132 raft_consensus.cc:2454] T 63408abb39dd4c3dbaa04cf63814a2b1 P daf9f104fabf4074a6c0a1f5585a3780 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b281c862bf0545d382d461cf7c17883c in term 1.
I20260805 22:51:03.343462 9911 catalog_manager.cc:5495] T 63408abb39dd4c3dbaa04cf63814a2b1 P b281c862bf0545d382d461cf7c17883c reported cstate change: term changed from 0 to 1, leader changed from <none> to b281c862bf0545d382d461cf7c17883c (127.14.224.130). New cstate: current_term: 1 leader_uuid: "b281c862bf0545d382d461cf7c17883c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fba46eb3111b497085ed7593f09a0793" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 35233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "daf9f104fabf4074a6c0a1f5585a3780" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 35515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b281c862bf0545d382d461cf7c17883c" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 41785 } health_report { overall_health: HEALTHY } } }
I20260805 22:51:03.349372 10615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:03.347147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50226 (local address 127.14.224.130:41785)
0805 22:51:03.347191 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:03.347193 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:03.347227 (+ 34us) server_negotiation.cc:407] Connection header received
0805 22:51:03.347330 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:03.347331 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:03.347352 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:03.347412 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:51:03.347526 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:03.347987 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:03.348753 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:03.348944 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:03.349001 (+ 57us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:03.349108 (+ 107us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:51:03.349197 (+ 89us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:51:03.349263 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:03.349300 (+ 37us) server_negotiation.cc:299] Negotiation successful
0805 22:51:03.349310 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260805 22:51:03.351234 10132 raft_consensus.cc:1261] T 63408abb39dd4c3dbaa04cf63814a2b1 P daf9f104fabf4074a6c0a1f5585a3780 [term 1 FOLLOWER]: Refusing update from remote peer b281c862bf0545d382d461cf7c17883c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:51:03.351234 10525 raft_consensus.cc:1261] T 63408abb39dd4c3dbaa04cf63814a2b1 P fba46eb3111b497085ed7593f09a0793 [term 1 FOLLOWER]: Refusing update from remote peer b281c862bf0545d382d461cf7c17883c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:51:03.351658 10638 consensus_queue.cc:1035] T 63408abb39dd4c3dbaa04cf63814a2b1 P b281c862bf0545d382d461cf7c17883c [LEADER]: Connected to new peer: Peer: permanent_uuid: "daf9f104fabf4074a6c0a1f5585a3780" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 35515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:51:03.351780 10635 consensus_queue.cc:1035] T 63408abb39dd4c3dbaa04cf63814a2b1 P b281c862bf0545d382d461cf7c17883c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fba46eb3111b497085ed7593f09a0793" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 35233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:51:03.356815 9911 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46732:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:51:03.356925 9911 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46732:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:51:03.357681 9911 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1ed5334d9e764f70be373100537c9330: Sending DeleteTablet for 3 replicas of tablet 63408abb39dd4c3dbaa04cf63814a2b1
I20260805 22:51:03.358096 10496 tablet_service.cc:1514] Processing DeleteTablet for tablet 63408abb39dd4c3dbaa04cf63814a2b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:51:03 UTC) from {username='kudu', principal='kudu/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:44688
I20260805 22:51:03.358122 10095 tablet_service.cc:1514] Processing DeleteTablet for tablet 63408abb39dd4c3dbaa04cf63814a2b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:51:03 UTC) from {username='kudu', principal='kudu/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:34458
I20260805 22:51:03.358331 10306 tablet_service.cc:1514] Processing DeleteTablet for tablet 63408abb39dd4c3dbaa04cf63814a2b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:51:03 UTC) from {username='kudu', principal='kudu/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:50210
I20260805 22:51:03.358417 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 10003
I20260805 22:51:03.375450 10660 tablet_replica.cc:330] T 63408abb39dd4c3dbaa04cf63814a2b1 P b281c862bf0545d382d461cf7c17883c: stopping tablet replica
I20260805 22:51:03.375623 10660 raft_consensus.cc:2229] T 63408abb39dd4c3dbaa04cf63814a2b1 P b281c862bf0545d382d461cf7c17883c [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:51:03.375761 10660 raft_consensus.cc:2258] T 63408abb39dd4c3dbaa04cf63814a2b1 P b281c862bf0545d382d461cf7c17883c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:51:03.375936 10656 tablet_replica.cc:330] T 63408abb39dd4c3dbaa04cf63814a2b1 P fba46eb3111b497085ed7593f09a0793: stopping tablet replica
I20260805 22:51:03.376061 10656 raft_consensus.cc:2229] T 63408abb39dd4c3dbaa04cf63814a2b1 P fba46eb3111b497085ed7593f09a0793 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:51:03.376181 10656 raft_consensus.cc:2258] T 63408abb39dd4c3dbaa04cf63814a2b1 P fba46eb3111b497085ed7593f09a0793 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:51:03.376863 10660 ts_tablet_manager.cc:1905] T 63408abb39dd4c3dbaa04cf63814a2b1 P b281c862bf0545d382d461cf7c17883c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:51:03.378391 10656 ts_tablet_manager.cc:1905] T 63408abb39dd4c3dbaa04cf63814a2b1 P fba46eb3111b497085ed7593f09a0793: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:51:03.379734 10656 ts_tablet_manager.cc:1918] T 63408abb39dd4c3dbaa04cf63814a2b1 P fba46eb3111b497085ed7593f09a0793: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:51:03.379817 10656 log.cc:1196] T 63408abb39dd4c3dbaa04cf63814a2b1 P fba46eb3111b497085ed7593f09a0793: Deleting WAL directory at /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/minicluster-data/ts-2/wal/wals/63408abb39dd4c3dbaa04cf63814a2b1
I20260805 22:51:03.380074 10656 ts_tablet_manager.cc:1939] T 63408abb39dd4c3dbaa04cf63814a2b1 P fba46eb3111b497085ed7593f09a0793: Deleting consensus metadata
I20260805 22:51:03.380518 10660 ts_tablet_manager.cc:1918] T 63408abb39dd4c3dbaa04cf63814a2b1 P b281c862bf0545d382d461cf7c17883c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:51:03.380601 10660 log.cc:1196] T 63408abb39dd4c3dbaa04cf63814a2b1 P b281c862bf0545d382d461cf7c17883c: Deleting WAL directory at /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970021300824-15234-0/minicluster-data/ts-1/wal/wals/63408abb39dd4c3dbaa04cf63814a2b1
I20260805 22:51:03.380615 9890 catalog_manager.cc:4841] TS fba46eb3111b497085ed7593f09a0793 (127.14.224.131:35233): tablet 63408abb39dd4c3dbaa04cf63814a2b1 (table test-table [id=9e4dadd2c3404a80b247ba6faa41fcb6]) successfully deleted
I20260805 22:51:03.380864 10660 ts_tablet_manager.cc:1939] T 63408abb39dd4c3dbaa04cf63814a2b1 P b281c862bf0545d382d461cf7c17883c: Deleting consensus metadata
I20260805 22:51:03.381261 9890 catalog_manager.cc:4841] TS b281c862bf0545d382d461cf7c17883c (127.14.224.130:41785): tablet 63408abb39dd4c3dbaa04cf63814a2b1 (table test-table [id=9e4dadd2c3404a80b247ba6faa41fcb6]) successfully deleted
W20260805 22:51:03.381577 9892 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.224.129:35515 (error 108)
I20260805 22:51:03.381804 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 10209
I20260805 22:51:03.388760 10608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:03.388564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.129:35515 (local address 127.0.0.1:34464)
0805 22:51:03.388627 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:03.388711 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.129:35515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260805 22:51:03.392519 9892 catalog_manager.cc:4584] TS daf9f104fabf4074a6c0a1f5585a3780 (127.14.224.129:35515): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 63408abb39dd4c3dbaa04cf63814a2b1: Network error: Client connection negotiation failed: client connection to 127.14.224.129:35515: connect: Connection refused (error 111)
I20260805 22:51:03.396565 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 10402
I20260805 22:51:03.407392 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 9867
2026-08-05T22:51:03Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2022 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-05T22:51:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:51:03Z Disabled control of system clock
I20260805 22:51:03.441622 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970021300824-15234-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970021300824-15234-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970021300824-15234-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:46529
--webserver_interface=127.14.224.190
--webserver_port=0
--builtin_ntp_servers=127.14.224.148:38473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.224.190:46529
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260805 22:51:03.527354 10666 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:51:03.527609 10666 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:51:03.527632 10666 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:51:03.528859 10666 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:51:03.528903 10666 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:51:03.528913 10666 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:51:03.528925 10666 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:51:03.528936 10666 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:51:03.530316 10666 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:38473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970021300824-15234-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970021300824-15234-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.224.190:46529
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:46529
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.224.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10666
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970021300824-15234-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:51:03.530540 10666 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:51:03.530798 10666 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260805 22:51:03.535912 10666 server_base.cc:1034] running on GCE node
W20260805 22:51:03.535864 10676 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:03.535876 10677 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:03.535883 10679 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:51:03.536485 10666 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:51:03.536795 10666 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:51:03.538005 10666 hybrid_clock.cc:648] HybridClock initialized: now 1785970263537988 us; error 29 us; skew 500 ppm
I20260805 22:51:03.539295 10666 webserver.cc:460] Webserver started at http://127.14.224.190:42331/ using document root <none> and password file <none>
I20260805 22:51:03.539531 10666 fs_manager.cc:359] Metadata directory not provided
I20260805 22:51:03.539582 10666 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:51:03.539714 10666 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:51:03.540800 10666 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970021300824-15234-0/minicluster-data/master-0/data/instance:
uuid: "581b8688def94c1d9757f3ebeefca087"
format_stamp: "Formatted at 2026-08-05 22:51:03 on dist-test-slave-gjrz"
server_key: "ae9d901061d40e6a39d9b3c43a2385c9"
server_key_iv: "7891dc64cf9ea2ce9214118cd5978bb2"
server_key_version: "encryptionkey@0"
I20260805 22:51:03.541216 10666 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970021300824-15234-0/minicluster-data/master-0/wal/instance:
uuid: "581b8688def94c1d9757f3ebeefca087"
format_stamp: "Formatted at 2026-08-05 22:51:03 on dist-test-slave-gjrz"
server_key: "ae9d901061d40e6a39d9b3c43a2385c9"
server_key_iv: "7891dc64cf9ea2ce9214118cd5978bb2"
server_key_version: "encryptionkey@0"
I20260805 22:51:03.542514 10666 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260805 22:51:03.543241 10688 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:03.543414 10666 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260805 22:51:03.543501 10666 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970021300824-15234-0/minicluster-data/master-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970021300824-15234-0/minicluster-data/master-0/wal
uuid: "581b8688def94c1d9757f3ebeefca087"
format_stamp: "Formatted at 2026-08-05 22:51:03 on dist-test-slave-gjrz"
server_key: "ae9d901061d40e6a39d9b3c43a2385c9"
server_key_iv: "7891dc64cf9ea2ce9214118cd5978bb2"
server_key_version: "encryptionkey@0"
I20260805 22:51:03.543572 10666 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970021300824-15234-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970021300824-15234-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970021300824-15234-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:51:03.564647 10666 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:51:03.565003 10666 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:51:03.565145 10666 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:51:03.569178 10666 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.190:46529
I20260805 22:51:03.569267 10770 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.190:46529 every 8 connection(s)
I20260805 22:51:03.569604 10666 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
I20260805 22:51:03.570698 10772 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:51:03.573171 10772 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 581b8688def94c1d9757f3ebeefca087: Bootstrap starting.
I20260805 22:51:03.573755 10772 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 581b8688def94c1d9757f3ebeefca087: Neither blocks nor log segments found. Creating new log.
I20260805 22:51:03.574008 10772 log.cc:824] T 00000000000000000000000000000000 P 581b8688def94c1d9757f3ebeefca087: Log is configured to *not* fsync() on all Append() calls
I20260805 22:51:03.574704 10772 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 581b8688def94c1d9757f3ebeefca087: No bootstrap required, opened a new log
I20260805 22:51:03.576390 10772 raft_consensus.cc:348] T 00000000000000000000000000000000 P 581b8688def94c1d9757f3ebeefca087 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "581b8688def94c1d9757f3ebeefca087" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 46529 } }
I20260805 22:51:03.576555 10772 raft_consensus.cc:374] T 00000000000000000000000000000000 P 581b8688def94c1d9757f3ebeefca087 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:51:03.576586 10772 raft_consensus.cc:729] T 00000000000000000000000000000000 P 581b8688def94c1d9757f3ebeefca087 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 581b8688def94c1d9757f3ebeefca087, State: Initialized, Role: FOLLOWER
I20260805 22:51:03.576705 10772 consensus_queue.cc:260] T 00000000000000000000000000000000 P 581b8688def94c1d9757f3ebeefca087 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "581b8688def94c1d9757f3ebeefca087" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 46529 } }
I20260805 22:51:03.576784 10772 raft_consensus.cc:388] T 00000000000000000000000000000000 P 581b8688def94c1d9757f3ebeefca087 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:51:03.576813 10772 raft_consensus.cc:482] T 00000000000000000000000000000000 P 581b8688def94c1d9757f3ebeefca087 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:51:03.576848 10772 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 581b8688def94c1d9757f3ebeefca087 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:51:03.577160 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 10666
I20260805 22:51:03.577268 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970021300824-15234-0/minicluster-data/master-0/wal/instance
I20260805 22:51:03.577400 10772 raft_consensus.cc:504] T 00000000000000000000000000000000 P 581b8688def94c1d9757f3ebeefca087 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "581b8688def94c1d9757f3ebeefca087" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 46529 } }
I20260805 22:51:03.577443 15234 external_mini_cluster.cc:1428] Setting key 84b7ba3a4bfe244013f399ee1009afe3
I20260805 22:51:03.577497 10772 leader_election.cc:302] T 00000000000000000000000000000000 P 581b8688def94c1d9757f3ebeefca087 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 581b8688def94c1d9757f3ebeefca087; no voters:
I20260805 22:51:03.577696 10772 leader_election.cc:288] T 00000000000000000000000000000000 P 581b8688def94c1d9757f3ebeefca087 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:51:03.577769 10777 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 581b8688def94c1d9757f3ebeefca087 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:51:03.577936 10777 raft_consensus.cc:686] T 00000000000000000000000000000000 P 581b8688def94c1d9757f3ebeefca087 [term 1 LEADER]: Becoming Leader. State: Replica: 581b8688def94c1d9757f3ebeefca087, State: Running, Role: LEADER
I20260805 22:51:03.577965 10772 sys_catalog.cc:564] T 00000000000000000000000000000000 P 581b8688def94c1d9757f3ebeefca087 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:51:03.578037 10777 consensus_queue.cc:237] T 00000000000000000000000000000000 P 581b8688def94c1d9757f3ebeefca087 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "581b8688def94c1d9757f3ebeefca087" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 46529 } }
I20260805 22:51:03.578382 10777 sys_catalog.cc:455] T 00000000000000000000000000000000 P 581b8688def94c1d9757f3ebeefca087 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 581b8688def94c1d9757f3ebeefca087. Latest consensus state: current_term: 1 leader_uuid: "581b8688def94c1d9757f3ebeefca087" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "581b8688def94c1d9757f3ebeefca087" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 46529 } } }
I20260805 22:51:03.578460 10777 sys_catalog.cc:458] T 00000000000000000000000000000000 P 581b8688def94c1d9757f3ebeefca087 [sys.catalog]: This master's current role is: LEADER
I20260805 22:51:03.578648 10779 sys_catalog.cc:455] T 00000000000000000000000000000000 P 581b8688def94c1d9757f3ebeefca087 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "581b8688def94c1d9757f3ebeefca087" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "581b8688def94c1d9757f3ebeefca087" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 46529 } } }
I20260805 22:51:03.578786 10779 sys_catalog.cc:458] T 00000000000000000000000000000000 P 581b8688def94c1d9757f3ebeefca087 [sys.catalog]: This master's current role is: LEADER
I20260805 22:51:03.578995 10790 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:51:03.579531 10790 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:51:03.581120 10790 catalog_manager.cc:1347] Generated new cluster ID: 4fbea5bb338f45a39c6a4798028283cb
I20260805 22:51:03.581174 10790 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:51:03.584890 10790 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:51:03.585343 10786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:03.577998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51716 (local address 127.14.224.190:46529)
0805 22:51:03.578450 (+ 452us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:03.578551 (+ 101us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:03.578650 (+ 99us) server_negotiation.cc:407] Connection header received
0805 22:51:03.579038 (+ 388us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:03.579045 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:03.579122 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:03.579620 (+ 498us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:03.579734 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:03.581865 (+ 2131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:03.582963 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:03.583625 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:03.583752 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:03.584471 (+ 719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:03.584476 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:03.584476 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:51:03.584713 (+ 237us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:03.584758 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:51:03.584774 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:03.584841 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:03.585109 (+ 268us) server_negotiation.cc:299] Negotiation successful
0805 22:51:03.585178 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":325,"thread_start_us":78,"threads_started":1}
I20260805 22:51:03.585544 10790 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:51:03.591653 10790 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 581b8688def94c1d9757f3ebeefca087: Generated new TSK 0
I20260805 22:51:03.591866 10790 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:51:03.597038 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970021300824-15234-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970021300824-15234-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970021300824-15234-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.129:0
--local_ip_for_outbound_sockets=127.14.224.129
--webserver_interface=127.14.224.129
--webserver_port=0
--tserver_master_addrs=127.14.224.190:46529
--builtin_ntp_servers=127.14.224.148:38473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260805 22:51:03.681951 10820 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:51:03.682175 10820 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:51:03.682199 10820 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:51:03.683502 10820 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:51:03.683552 10820 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:51:03.683586 10820 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.129
I20260805 22:51:03.685034 10820 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:38473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970021300824-15234-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970021300824-15234-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.224.129
--webserver_port=0
--tserver_master_addrs=127.14.224.190:46529
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10820
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.129
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970021300824-15234-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:51:03.685292 10820 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:51:03.685608 10820 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:51:03.690596 10831 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:03.690697 10833 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:03.690596 10829 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:51:03.690958 10820 server_base.cc:1034] running on GCE node
I20260805 22:51:03.691160 10820 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:51:03.691452 10820 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:51:03.692631 10820 hybrid_clock.cc:648] HybridClock initialized: now 1785970263692613 us; error 36 us; skew 500 ppm
I20260805 22:51:03.693902 10820 webserver.cc:460] Webserver started at http://127.14.224.129:36229/ using document root <none> and password file <none>
I20260805 22:51:03.694145 10820 fs_manager.cc:359] Metadata directory not provided
I20260805 22:51:03.694192 10820 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:51:03.694319 10820 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:51:03.695467 10820 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970021300824-15234-0/minicluster-data/ts-0/data/instance:
uuid: "04a35cb5cfcd45de9b483f05482c730b"
format_stamp: "Formatted at 2026-08-05 22:51:03 on dist-test-slave-gjrz"
server_key: "dd427e0d1310c5f8be06fa6f04c5d175"
server_key_iv: "9daadfe042edcebe7ee2a9856b69769b"
server_key_version: "encryptionkey@0"
I20260805 22:51:03.695820 10820 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970021300824-15234-0/minicluster-data/ts-0/wal/instance:
uuid: "04a35cb5cfcd45de9b483f05482c730b"
format_stamp: "Formatted at 2026-08-05 22:51:03 on dist-test-slave-gjrz"
server_key: "dd427e0d1310c5f8be06fa6f04c5d175"
server_key_iv: "9daadfe042edcebe7ee2a9856b69769b"
server_key_version: "encryptionkey@0"
I20260805 22:51:03.697111 10820 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260805 22:51:03.697844 10843 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:03.697996 10820 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260805 22:51:03.698084 10820 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970021300824-15234-0/minicluster-data/ts-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970021300824-15234-0/minicluster-data/ts-0/wal
uuid: "04a35cb5cfcd45de9b483f05482c730b"
format_stamp: "Formatted at 2026-08-05 22:51:03 on dist-test-slave-gjrz"
server_key: "dd427e0d1310c5f8be06fa6f04c5d175"
server_key_iv: "9daadfe042edcebe7ee2a9856b69769b"
server_key_version: "encryptionkey@0"
I20260805 22:51:03.698145 10820 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970021300824-15234-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970021300824-15234-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970021300824-15234-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:51:03.712508 10820 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:51:03.712854 10820 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:51:03.712996 10820 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:51:03.713229 10820 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:51:03.713567 10820 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:51:03.713608 10820 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:03.713639 10820 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:51:03.713661 10820 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:03.719386 10820 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.129:36997
I20260805 22:51:03.719437 11002 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.129:36997 every 8 connection(s)
I20260805 22:51:03.719805 10820 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
I20260805 22:51:03.723111 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 10820
I20260805 22:51:03.723207 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970021300824-15234-0/minicluster-data/ts-0/wal/instance
I20260805 22:51:03.723405 15234 external_mini_cluster.cc:1428] Setting key f7685427393aefd2942cd0452eeffb5f
I20260805 22:51:03.724407 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970021300824-15234-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970021300824-15234-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970021300824-15234-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.130:0
--local_ip_for_outbound_sockets=127.14.224.130
--webserver_interface=127.14.224.130
--webserver_port=0
--tserver_master_addrs=127.14.224.190:46529
--builtin_ntp_servers=127.14.224.148:38473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260805 22:51:03.725528 10786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:03.720563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.129:53605 (local address 127.14.224.190:46529)
0805 22:51:03.720632 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:03.720634 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:03.720849 (+ 215us) server_negotiation.cc:407] Connection header received
0805 22:51:03.721392 (+ 543us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:03.721393 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:03.721405 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:03.721470 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:03.722185 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:03.722724 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:03.723862 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:03.724165 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:03.724222 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:03.725129 (+ 907us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:03.725130 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:03.725130 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:51:03.725135 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:03.725151 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:51:03.725155 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:03.725199 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:03.725423 (+ 224us) server_negotiation.cc:299] Negotiation successful
0805 22:51:03.725459 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260805 22:51:03.725749 11007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:03.720494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:46529 (local address 127.14.224.129:53605)
0805 22:51:03.720728 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:03.720765 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0805 22:51:03.721275 (+ 510us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:51:03.721535 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:51:03.721538 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:51:03.721547 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:51:03.722082 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:03.722087 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:03.722820 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:03.722821 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:03.723790 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:03.723793 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:03.724256 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:03.724257 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:03.724420 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:03.724959 (+ 539us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 22:51:03.724959 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:51:03.725010 (+ 51us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 22:51:03.725041 (+ 31us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:51:03.725263 (+ 222us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:51:03.725273 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:51:03.725276 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:51:03.725373 (+ 97us) client_negotiation.cc:240] Negotiation successful
0805 22:51:03.725507 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":84,"threads_started":1}
I20260805 22:51:03.726364 11003 heartbeater.cc:347] Connected to a master server at 127.14.224.190:46529
I20260805 22:51:03.726457 11003 heartbeater.cc:464] Registering TS with master...
I20260805 22:51:03.726655 11003 heartbeater.cc:511] Master 127.14.224.190:46529 requested a full tablet report, sending...
I20260805 22:51:03.727214 10717 ts_manager.cc:194] Registered new tserver with Master: 04a35cb5cfcd45de9b483f05482c730b (127.14.224.129:36997)
I20260805 22:51:03.728091 10717 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.224.129:53605
W20260805 22:51:03.811378 11012 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:51:03.811611 11012 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:51:03.811635 11012 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:51:03.812863 11012 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:51:03.812908 11012 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:51:03.812935 11012 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.130
I20260805 22:51:03.814352 11012 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:38473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970021300824-15234-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970021300824-15234-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.224.130
--webserver_port=0
--tserver_master_addrs=127.14.224.190:46529
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11012
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.130
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970021300824-15234-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:51:03.814586 11012 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:51:03.814919 11012 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:51:03.820109 11025 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:03.820132 11022 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:03.820351 11021 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:51:03.820374 11012 server_base.cc:1034] running on GCE node
I20260805 22:51:03.820607 11012 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:51:03.820886 11012 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:51:03.822074 11012 hybrid_clock.cc:648] HybridClock initialized: now 1785970263821987 us; error 99 us; skew 500 ppm
I20260805 22:51:03.823726 11012 webserver.cc:460] Webserver started at http://127.14.224.130:33257/ using document root <none> and password file <none>
I20260805 22:51:03.824005 11012 fs_manager.cc:359] Metadata directory not provided
I20260805 22:51:03.824061 11012 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:51:03.824193 11012 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:51:03.825342 11012 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970021300824-15234-0/minicluster-data/ts-1/data/instance:
uuid: "7e43bf3cfe5d49f3b8b479c742dbd756"
format_stamp: "Formatted at 2026-08-05 22:51:03 on dist-test-slave-gjrz"
server_key: "578ce08efd6061be606ece2d7cd0967d"
server_key_iv: "a9f8d787371ec2bddbf883f7acac5582"
server_key_version: "encryptionkey@0"
I20260805 22:51:03.825829 11012 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970021300824-15234-0/minicluster-data/ts-1/wal/instance:
uuid: "7e43bf3cfe5d49f3b8b479c742dbd756"
format_stamp: "Formatted at 2026-08-05 22:51:03 on dist-test-slave-gjrz"
server_key: "578ce08efd6061be606ece2d7cd0967d"
server_key_iv: "a9f8d787371ec2bddbf883f7acac5582"
server_key_version: "encryptionkey@0"
I20260805 22:51:03.827347 11012 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260805 22:51:03.828162 11034 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:03.828365 11012 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:51:03.828471 11012 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970021300824-15234-0/minicluster-data/ts-1/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970021300824-15234-0/minicluster-data/ts-1/wal
uuid: "7e43bf3cfe5d49f3b8b479c742dbd756"
format_stamp: "Formatted at 2026-08-05 22:51:03 on dist-test-slave-gjrz"
server_key: "578ce08efd6061be606ece2d7cd0967d"
server_key_iv: "a9f8d787371ec2bddbf883f7acac5582"
server_key_version: "encryptionkey@0"
I20260805 22:51:03.828544 11012 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970021300824-15234-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970021300824-15234-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970021300824-15234-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:51:03.844465 11012 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:51:03.844764 11012 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:51:03.844866 11012 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:51:03.845079 11012 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:51:03.845377 11012 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:51:03.845407 11012 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:03.845428 11012 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:51:03.845444 11012 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:03.851215 11012 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.130:40317
I20260805 22:51:03.851300 11194 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.130:40317 every 8 connection(s)
I20260805 22:51:03.851629 11012 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
I20260805 22:51:03.856747 10786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:03.852406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:35467 (local address 127.14.224.190:46529)
0805 22:51:03.852453 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:03.852455 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:03.852698 (+ 243us) server_negotiation.cc:407] Connection header received
0805 22:51:03.853222 (+ 524us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:03.853224 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:03.853240 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:03.853311 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:03.853980 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:03.854491 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:03.855501 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:03.855698 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:03.855756 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:03.856517 (+ 761us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:03.856518 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:03.856518 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:51:03.856524 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:03.856540 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:51:03.856544 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:03.856584 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:03.856647 (+ 63us) server_negotiation.cc:299] Negotiation successful
0805 22:51:03.856681 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260805 22:51:03.856925 11198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:03.852386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:46529 (local address 127.14.224.130:35467)
0805 22:51:03.852578 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:03.852623 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0805 22:51:03.853111 (+ 488us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:51:03.853369 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:51:03.853372 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:51:03.853381 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:51:03.853890 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:03.853895 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:03.854565 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:03.854566 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:03.855424 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:03.855428 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:03.855765 (+ 337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:03.855765 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:03.855876 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:03.856382 (+ 506us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 22:51:03.856383 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:51:03.856416 (+ 33us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 22:51:03.856441 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:51:03.856590 (+ 149us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:51:03.856593 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:51:03.856596 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:51:03.856644 (+ 48us) client_negotiation.cc:240] Negotiation successful
0805 22:51:03.856729 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":78,"threads_started":1}
I20260805 22:51:03.857594 11196 heartbeater.cc:347] Connected to a master server at 127.14.224.190:46529
I20260805 22:51:03.857723 11196 heartbeater.cc:464] Registering TS with master...
I20260805 22:51:03.857996 11196 heartbeater.cc:511] Master 127.14.224.190:46529 requested a full tablet report, sending...
I20260805 22:51:03.861536 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 11012
I20260805 22:51:03.861640 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970021300824-15234-0/minicluster-data/ts-1/wal/instance
I20260805 22:51:03.861835 15234 external_mini_cluster.cc:1428] Setting key 7da6caa4d74a4b944a44e40756fabc57
I20260805 22:51:03.862993 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970021300824-15234-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970021300824-15234-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970021300824-15234-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.131:0
--local_ip_for_outbound_sockets=127.14.224.131
--webserver_interface=127.14.224.131
--webserver_port=0
--tserver_master_addrs=127.14.224.190:46529
--builtin_ntp_servers=127.14.224.148:38473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260805 22:51:03.863879 10717 ts_manager.cc:194] Registered new tserver with Master: 7e43bf3cfe5d49f3b8b479c742dbd756 (127.14.224.130:40317)
I20260805 22:51:03.864328 10717 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.224.130:35467
W20260805 22:51:03.948135 11200 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:51:03.948386 11200 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:51:03.948414 11200 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:51:03.949704 11200 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:51:03.949753 11200 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:51:03.949781 11200 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.131
I20260805 22:51:03.951334 11200 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:38473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970021300824-15234-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970021300824-15234-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.224.131
--webserver_port=0
--tserver_master_addrs=127.14.224.190:46529
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11200
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.131
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970021300824-15234-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:51:03.951614 11200 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:51:03.951941 11200 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:51:03.957041 11207 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:03.957050 11209 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:51:03.957141 11200 server_base.cc:1034] running on GCE node
W20260805 22:51:03.957050 11206 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:51:03.957535 11200 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:51:03.957787 11200 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:51:03.958931 11200 hybrid_clock.cc:648] HybridClock initialized: now 1785970263958918 us; error 27 us; skew 500 ppm
I20260805 22:51:03.960336 11200 webserver.cc:460] Webserver started at http://127.14.224.131:44125/ using document root <none> and password file <none>
I20260805 22:51:03.960613 11200 fs_manager.cc:359] Metadata directory not provided
I20260805 22:51:03.960664 11200 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:51:03.960798 11200 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:51:03.961903 11200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970021300824-15234-0/minicluster-data/ts-2/data/instance:
uuid: "dcc30ef8dfd74308adfb7828e6d7f168"
format_stamp: "Formatted at 2026-08-05 22:51:03 on dist-test-slave-gjrz"
server_key: "bb2b92050dadc46aedd4d57075dc7b43"
server_key_iv: "4a7c085e4fa953ffd06d3804236b063e"
server_key_version: "encryptionkey@0"
I20260805 22:51:03.962231 11200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970021300824-15234-0/minicluster-data/ts-2/wal/instance:
uuid: "dcc30ef8dfd74308adfb7828e6d7f168"
format_stamp: "Formatted at 2026-08-05 22:51:03 on dist-test-slave-gjrz"
server_key: "bb2b92050dadc46aedd4d57075dc7b43"
server_key_iv: "4a7c085e4fa953ffd06d3804236b063e"
server_key_version: "encryptionkey@0"
I20260805 22:51:03.963577 11200 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260805 22:51:03.964406 11216 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:03.964608 11200 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:51:03.964699 11200 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970021300824-15234-0/minicluster-data/ts-2/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970021300824-15234-0/minicluster-data/ts-2/wal
uuid: "dcc30ef8dfd74308adfb7828e6d7f168"
format_stamp: "Formatted at 2026-08-05 22:51:03 on dist-test-slave-gjrz"
server_key: "bb2b92050dadc46aedd4d57075dc7b43"
server_key_iv: "4a7c085e4fa953ffd06d3804236b063e"
server_key_version: "encryptionkey@0"
I20260805 22:51:03.964762 11200 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970021300824-15234-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970021300824-15234-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970021300824-15234-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:51:03.974339 11200 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:51:03.974640 11200 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:51:03.974747 11200 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:51:03.974943 11200 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:51:03.975315 11200 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:51:03.975364 11200 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:03.975389 11200 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:51:03.975412 11200 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:03.981148 11200 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.131:44961
I20260805 22:51:03.981215 11385 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.131:44961 every 8 connection(s)
I20260805 22:51:03.981529 11200 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
I20260805 22:51:03.986647 10786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:03.982271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:37659 (local address 127.14.224.190:46529)
0805 22:51:03.982327 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:03.982329 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:03.982552 (+ 223us) server_negotiation.cc:407] Connection header received
0805 22:51:03.983086 (+ 534us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:03.983087 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:03.983098 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:03.983151 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:03.983912 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:03.984424 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:03.985416 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:03.985608 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:03.985657 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:03.986427 (+ 770us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:03.986429 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:03.986429 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:51:03.986434 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:03.986448 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:51:03.986452 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:03.986492 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:03.986557 (+ 65us) server_negotiation.cc:299] Negotiation successful
0805 22:51:03.986581 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260805 22:51:03.986850 11390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:03.982246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:46529 (local address 127.14.224.131:37659)
0805 22:51:03.982426 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:03.982465 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0805 22:51:03.982985 (+ 520us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:51:03.983209 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:51:03.983213 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:51:03.983222 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:51:03.983816 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:03.983821 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:03.984509 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:03.984510 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:03.985338 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:03.985341 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:03.985670 (+ 329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:03.985670 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:03.985779 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:03.986298 (+ 519us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 22:51:03.986298 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:51:03.986327 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 22:51:03.986352 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:51:03.986500 (+ 148us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:51:03.986503 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:51:03.986505 (+ 2us) client_negotiation.cc:769] Sending connection context
0805 22:51:03.986553 (+ 48us) client_negotiation.cc:240] Negotiation successful
0805 22:51:03.986633 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":86,"threads_started":1}
I20260805 22:51:03.987375 11387 heartbeater.cc:347] Connected to a master server at 127.14.224.190:46529
I20260805 22:51:03.987483 11387 heartbeater.cc:464] Registering TS with master...
I20260805 22:51:03.987681 11387 heartbeater.cc:511] Master 127.14.224.190:46529 requested a full tablet report, sending...
I20260805 22:51:03.988081 10717 ts_manager.cc:194] Registered new tserver with Master: dcc30ef8dfd74308adfb7828e6d7f168 (127.14.224.131:44961)
I20260805 22:51:03.988428 10717 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.224.131:37659
I20260805 22:51:03.989259 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 11200
I20260805 22:51:03.989357 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970021300824-15234-0/minicluster-data/ts-2/wal/instance
I20260805 22:51:03.989547 15234 external_mini_cluster.cc:1428] Setting key 9101b82f2787ee40c7feff5a5ff65169
I20260805 22:51:03.990367 15234 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 22:51:03.994324 10786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:03.991723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51718 (local address 127.14.224.190:46529)
0805 22:51:03.991776 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:03.991778 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:03.991875 (+ 97us) server_negotiation.cc:407] Connection header received
0805 22:51:03.991930 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:03.991931 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:03.991939 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:03.991982 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:03.992118 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:03.992585 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:03.993357 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:03.993527 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:03.993573 (+ 46us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:03.994132 (+ 559us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:03.994133 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:03.994134 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:51:03.994138 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:03.994151 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:51:03.994155 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:03.994216 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:03.994256 (+ 40us) server_negotiation.cc:299] Negotiation successful
0805 22:51:03.994266 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260805 22:51:03.996001 10717 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51718:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:51:03.997565 10717 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:51:04.004310 11403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:04.000150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43716 (local address 127.14.224.129:36997)
0805 22:51:04.000374 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:04.000380 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:04.000391 (+ 11us) server_negotiation.cc:407] Connection header received
0805 22:51:04.000424 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:04.000426 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:04.000438 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:04.000517 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:51:04.000814 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:04.002041 (+ 1227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:04.003123 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:04.003868 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:04.003957 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:04.004057 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:04.004174 (+ 117us) server_negotiation.cc:299] Negotiation successful
0805 22:51:04.004219 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":188,"thread_start_us":111,"threads_started":1}
I20260805 22:51:04.004299 11405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:04.000259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.131:44961 (local address 127.0.0.1:36586)
0805 22:51:04.000395 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:04.000405 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0805 22:51:04.000448 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:51:04.000856 (+ 408us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:51:04.000857 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:51:04.000859 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:51:04.000894 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:04.000895 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:04.001985 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:04.001986 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:04.003249 (+ 1263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:04.003252 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:04.003990 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:04.003991 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:04.004058 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:04.004077 (+ 19us) client_negotiation.cc:769] Sending connection context
0805 22:51:04.004125 (+ 48us) client_negotiation.cc:240] Negotiation successful
0805 22:51:04.004186 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":68,"threads_started":1}
I20260805 22:51:04.004299 11402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:04.000045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.129:36997 (local address 127.0.0.1:43716)
0805 22:51:04.000185 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:04.000193 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0805 22:51:04.000231 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:51:04.000613 (+ 382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:51:04.000617 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:51:04.000620 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:51:04.000699 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:04.000701 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:04.002139 (+ 1438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:04.002140 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:04.003045 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:04.003048 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:04.003968 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:04.003969 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:04.004058 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:04.004077 (+ 19us) client_negotiation.cc:769] Sending connection context
0805 22:51:04.004150 (+ 73us) client_negotiation.cc:240] Negotiation successful
0805 22:51:04.004187 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"mutex_wait_us":5,"thread_start_us":97,"threads_started":1}
I20260805 22:51:04.004663 11399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:03.999811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.130:40317 (local address 127.0.0.1:57782)
0805 22:51:03.999950 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:03.999991 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0805 22:51:04.000056 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:51:04.000880 (+ 824us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:51:04.000882 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:51:04.000885 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:51:04.000930 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:04.000931 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:04.002241 (+ 1310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:04.002242 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:04.003349 (+ 1107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:04.003352 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:04.004245 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:04.004247 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:04.004311 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:04.004316 (+ 5us) client_negotiation.cc:769] Sending connection context
0805 22:51:04.004345 (+ 29us) client_negotiation.cc:240] Negotiation successful
0805 22:51:04.004593 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":74,"threads_started":1}
I20260805 22:51:04.005014 11401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:03.999929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57782 (local address 127.14.224.130:40317)
0805 22:51:04.000571 (+ 642us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:04.000575 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:04.000585 (+ 10us) server_negotiation.cc:407] Connection header received
0805 22:51:04.000616 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:04.000617 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:04.000630 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:04.000758 (+ 128us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:51:04.001027 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:04.002167 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:04.003454 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:04.004149 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:04.004791 (+ 642us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:04.004889 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:04.004915 (+ 26us) server_negotiation.cc:299] Negotiation successful
0805 22:51:04.004953 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":600,"thread_start_us":113,"threads_started":1}
I20260805 22:51:04.005203 10914 tablet_service.cc:1467] Processing CreateTablet for tablet 00177193f4304422864e4b8de75977bb (DEFAULT_TABLE table=test-table [id=89abee297fe94ccab05b41b5210d9bff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:51:04.005638 10914 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00177193f4304422864e4b8de75977bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:51:04.005641 11101 tablet_service.cc:1467] Processing CreateTablet for tablet 00177193f4304422864e4b8de75977bb (DEFAULT_TABLE table=test-table [id=89abee297fe94ccab05b41b5210d9bff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:51:04.005986 11101 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00177193f4304422864e4b8de75977bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:51:04.007408 11406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:04.000365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36586 (local address 127.14.224.131:44961)
0805 22:51:04.000543 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:04.000547 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:04.000556 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:51:04.000598 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:04.000600 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:04.000614 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:04.000975 (+ 361us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:51:04.001040 (+ 65us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:04.001902 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:04.003376 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:04.003895 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:04.004856 (+ 961us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:04.004968 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:04.004995 (+ 27us) server_negotiation.cc:299] Negotiation successful
0805 22:51:04.005036 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":93,"threads_started":1}
I20260805 22:51:04.008070 11289 tablet_service.cc:1467] Processing CreateTablet for tablet 00177193f4304422864e4b8de75977bb (DEFAULT_TABLE table=test-table [id=89abee297fe94ccab05b41b5210d9bff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:51:04.008431 11289 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00177193f4304422864e4b8de75977bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:51:04.009271 11409 tablet_bootstrap.cc:492] T 00177193f4304422864e4b8de75977bb P 7e43bf3cfe5d49f3b8b479c742dbd756: Bootstrap starting.
I20260805 22:51:04.009985 11409 tablet_bootstrap.cc:654] T 00177193f4304422864e4b8de75977bb P 7e43bf3cfe5d49f3b8b479c742dbd756: Neither blocks nor log segments found. Creating new log.
I20260805 22:51:04.010304 11409 log.cc:824] T 00177193f4304422864e4b8de75977bb P 7e43bf3cfe5d49f3b8b479c742dbd756: Log is configured to *not* fsync() on all Append() calls
I20260805 22:51:04.010692 11407 tablet_bootstrap.cc:492] T 00177193f4304422864e4b8de75977bb P 04a35cb5cfcd45de9b483f05482c730b: Bootstrap starting.
I20260805 22:51:04.011099 11409 tablet_bootstrap.cc:492] T 00177193f4304422864e4b8de75977bb P 7e43bf3cfe5d49f3b8b479c742dbd756: No bootstrap required, opened a new log
I20260805 22:51:04.011148 11409 ts_tablet_manager.cc:1397] T 00177193f4304422864e4b8de75977bb P 7e43bf3cfe5d49f3b8b479c742dbd756: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260805 22:51:04.011386 11407 tablet_bootstrap.cc:654] T 00177193f4304422864e4b8de75977bb P 04a35cb5cfcd45de9b483f05482c730b: Neither blocks nor log segments found. Creating new log.
I20260805 22:51:04.011721 11407 log.cc:824] T 00177193f4304422864e4b8de75977bb P 04a35cb5cfcd45de9b483f05482c730b: Log is configured to *not* fsync() on all Append() calls
I20260805 22:51:04.012061 11412 tablet_bootstrap.cc:492] T 00177193f4304422864e4b8de75977bb P dcc30ef8dfd74308adfb7828e6d7f168: Bootstrap starting.
I20260805 22:51:04.012473 11407 tablet_bootstrap.cc:492] T 00177193f4304422864e4b8de75977bb P 04a35cb5cfcd45de9b483f05482c730b: No bootstrap required, opened a new log
I20260805 22:51:04.012555 11407 ts_tablet_manager.cc:1397] T 00177193f4304422864e4b8de75977bb P 04a35cb5cfcd45de9b483f05482c730b: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260805 22:51:04.012707 11412 tablet_bootstrap.cc:654] T 00177193f4304422864e4b8de75977bb P dcc30ef8dfd74308adfb7828e6d7f168: Neither blocks nor log segments found. Creating new log.
I20260805 22:51:04.013020 11412 log.cc:824] T 00177193f4304422864e4b8de75977bb P dcc30ef8dfd74308adfb7828e6d7f168: Log is configured to *not* fsync() on all Append() calls
I20260805 22:51:04.013392 11409 raft_consensus.cc:348] T 00177193f4304422864e4b8de75977bb P 7e43bf3cfe5d49f3b8b479c742dbd756 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e43bf3cfe5d49f3b8b479c742dbd756" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40317 } } peers { permanent_uuid: "04a35cb5cfcd45de9b483f05482c730b" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 36997 } } peers { permanent_uuid: "dcc30ef8dfd74308adfb7828e6d7f168" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 44961 } }
I20260805 22:51:04.013576 11409 raft_consensus.cc:374] T 00177193f4304422864e4b8de75977bb P 7e43bf3cfe5d49f3b8b479c742dbd756 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:51:04.013620 11409 raft_consensus.cc:729] T 00177193f4304422864e4b8de75977bb P 7e43bf3cfe5d49f3b8b479c742dbd756 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e43bf3cfe5d49f3b8b479c742dbd756, State: Initialized, Role: FOLLOWER
I20260805 22:51:04.013772 11409 consensus_queue.cc:260] T 00177193f4304422864e4b8de75977bb P 7e43bf3cfe5d49f3b8b479c742dbd756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e43bf3cfe5d49f3b8b479c742dbd756" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40317 } } peers { permanent_uuid: "04a35cb5cfcd45de9b483f05482c730b" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 36997 } } peers { permanent_uuid: "dcc30ef8dfd74308adfb7828e6d7f168" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 44961 } }
I20260805 22:51:04.013850 11412 tablet_bootstrap.cc:492] T 00177193f4304422864e4b8de75977bb P dcc30ef8dfd74308adfb7828e6d7f168: No bootstrap required, opened a new log
I20260805 22:51:04.013921 11412 ts_tablet_manager.cc:1397] T 00177193f4304422864e4b8de75977bb P dcc30ef8dfd74308adfb7828e6d7f168: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260805 22:51:04.014041 11409 ts_tablet_manager.cc:1428] T 00177193f4304422864e4b8de75977bb P 7e43bf3cfe5d49f3b8b479c742dbd756: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260805 22:51:04.014173 11196 heartbeater.cc:503] Master 127.14.224.190:46529 was elected leader, sending a full tablet report...
I20260805 22:51:04.015051 11407 raft_consensus.cc:348] T 00177193f4304422864e4b8de75977bb P 04a35cb5cfcd45de9b483f05482c730b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e43bf3cfe5d49f3b8b479c742dbd756" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40317 } } peers { permanent_uuid: "04a35cb5cfcd45de9b483f05482c730b" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 36997 } } peers { permanent_uuid: "dcc30ef8dfd74308adfb7828e6d7f168" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 44961 } }
I20260805 22:51:04.015223 11407 raft_consensus.cc:374] T 00177193f4304422864e4b8de75977bb P 04a35cb5cfcd45de9b483f05482c730b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:51:04.015303 11407 raft_consensus.cc:729] T 00177193f4304422864e4b8de75977bb P 04a35cb5cfcd45de9b483f05482c730b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04a35cb5cfcd45de9b483f05482c730b, State: Initialized, Role: FOLLOWER
I20260805 22:51:04.015429 11407 consensus_queue.cc:260] T 00177193f4304422864e4b8de75977bb P 04a35cb5cfcd45de9b483f05482c730b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e43bf3cfe5d49f3b8b479c742dbd756" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40317 } } peers { permanent_uuid: "04a35cb5cfcd45de9b483f05482c730b" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 36997 } } peers { permanent_uuid: "dcc30ef8dfd74308adfb7828e6d7f168" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 44961 } }
I20260805 22:51:04.015697 11407 ts_tablet_manager.cc:1428] T 00177193f4304422864e4b8de75977bb P 04a35cb5cfcd45de9b483f05482c730b: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260805 22:51:04.015726 11003 heartbeater.cc:503] Master 127.14.224.190:46529 was elected leader, sending a full tablet report...
I20260805 22:51:04.016335 11412 raft_consensus.cc:348] T 00177193f4304422864e4b8de75977bb P dcc30ef8dfd74308adfb7828e6d7f168 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e43bf3cfe5d49f3b8b479c742dbd756" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40317 } } peers { permanent_uuid: "04a35cb5cfcd45de9b483f05482c730b" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 36997 } } peers { permanent_uuid: "dcc30ef8dfd74308adfb7828e6d7f168" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 44961 } }
I20260805 22:51:04.016503 11412 raft_consensus.cc:374] T 00177193f4304422864e4b8de75977bb P dcc30ef8dfd74308adfb7828e6d7f168 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:51:04.016554 11412 raft_consensus.cc:729] T 00177193f4304422864e4b8de75977bb P dcc30ef8dfd74308adfb7828e6d7f168 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcc30ef8dfd74308adfb7828e6d7f168, State: Initialized, Role: FOLLOWER
I20260805 22:51:04.016700 11412 consensus_queue.cc:260] T 00177193f4304422864e4b8de75977bb P dcc30ef8dfd74308adfb7828e6d7f168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e43bf3cfe5d49f3b8b479c742dbd756" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40317 } } peers { permanent_uuid: "04a35cb5cfcd45de9b483f05482c730b" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 36997 } } peers { permanent_uuid: "dcc30ef8dfd74308adfb7828e6d7f168" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 44961 } }
I20260805 22:51:04.016921 11412 ts_tablet_manager.cc:1428] T 00177193f4304422864e4b8de75977bb P dcc30ef8dfd74308adfb7828e6d7f168: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260805 22:51:04.017004 11387 heartbeater.cc:503] Master 127.14.224.190:46529 was elected leader, sending a full tablet report...
W20260805 22:51:04.102171 11197 tablet.cc:2369] T 00177193f4304422864e4b8de75977bb P 7e43bf3cfe5d49f3b8b479c742dbd756: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:51:04.172096 11418 raft_consensus.cc:482] T 00177193f4304422864e4b8de75977bb P 04a35cb5cfcd45de9b483f05482c730b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:51:04.172235 11418 raft_consensus.cc:504] T 00177193f4304422864e4b8de75977bb P 04a35cb5cfcd45de9b483f05482c730b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e43bf3cfe5d49f3b8b479c742dbd756" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40317 } } peers { permanent_uuid: "04a35cb5cfcd45de9b483f05482c730b" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 36997 } } peers { permanent_uuid: "dcc30ef8dfd74308adfb7828e6d7f168" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 44961 } }
I20260805 22:51:04.172559 11418 leader_election.cc:288] T 00177193f4304422864e4b8de75977bb P 04a35cb5cfcd45de9b483f05482c730b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e43bf3cfe5d49f3b8b479c742dbd756 (127.14.224.130:40317), dcc30ef8dfd74308adfb7828e6d7f168 (127.14.224.131:44961)
I20260805 22:51:04.175520 11406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:04.172958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.129:43193 (local address 127.14.224.131:44961)
0805 22:51:04.173002 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:04.173004 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:04.173121 (+ 117us) server_negotiation.cc:407] Connection header received
0805 22:51:04.173168 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:04.173169 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:04.173177 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:04.173239 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:51:04.173388 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:04.173873 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:04.174788 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:04.175145 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:04.175207 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:04.175216 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:04.175408 (+ 192us) server_negotiation.cc:299] Negotiation successful
0805 22:51:04.175451 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260805 22:51:04.175547 11401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:04.172843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.129:37141 (local address 127.14.224.130:40317)
0805 22:51:04.172928 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:04.172930 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:04.172940 (+ 10us) server_negotiation.cc:407] Connection header received
0805 22:51:04.172975 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:04.172976 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:04.172985 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:04.173036 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:51:04.173247 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:04.173715 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:04.174800 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:04.175191 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:04.175258 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:04.175295 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:04.175429 (+ 134us) server_negotiation.cc:299] Negotiation successful
0805 22:51:04.175473 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260805 22:51:04.175557 11007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:04.172757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.130:40317 (local address 127.14.224.129:37141)
0805 22:51:04.172824 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:04.172839 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0805 22:51:04.172912 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:51:04.173093 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:51:04.173094 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:51:04.173096 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:51:04.173166 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:04.173169 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:04.173802 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:04.173804 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:04.174676 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:04.174680 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:04.175301 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:04.175302 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:04.175365 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:04.175368 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:51:04.175416 (+ 48us) client_negotiation.cc:240] Negotiation successful
0805 22:51:04.175461 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
I20260805 22:51:04.175572 11421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:04.172873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.131:44961 (local address 127.14.224.129:43193)
0805 22:51:04.173055 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:04.173063 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0805 22:51:04.173113 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:51:04.173255 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:51:04.173256 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:51:04.173259 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:51:04.173326 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:04.173328 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:04.173955 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:04.173956 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:04.174700 (+ 744us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:04.174702 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:04.175222 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:04.175223 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:04.175343 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:04.175346 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:51:04.175394 (+ 48us) client_negotiation.cc:240] Negotiation successful
0805 22:51:04.175436 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":110,"threads_started":1}
I20260805 22:51:04.175969 11134 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00177193f4304422864e4b8de75977bb" candidate_uuid: "04a35cb5cfcd45de9b483f05482c730b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e43bf3cfe5d49f3b8b479c742dbd756" is_pre_election: true
I20260805 22:51:04.175969 11318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00177193f4304422864e4b8de75977bb" candidate_uuid: "04a35cb5cfcd45de9b483f05482c730b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc30ef8dfd74308adfb7828e6d7f168" is_pre_election: true
I20260805 22:51:04.176151 11318 raft_consensus.cc:2454] T 00177193f4304422864e4b8de75977bb P dcc30ef8dfd74308adfb7828e6d7f168 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04a35cb5cfcd45de9b483f05482c730b in term 0.
I20260805 22:51:04.176151 11134 raft_consensus.cc:2454] T 00177193f4304422864e4b8de75977bb P 7e43bf3cfe5d49f3b8b479c742dbd756 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04a35cb5cfcd45de9b483f05482c730b in term 0.
I20260805 22:51:04.176419 10845 leader_election.cc:302] T 00177193f4304422864e4b8de75977bb P 04a35cb5cfcd45de9b483f05482c730b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04a35cb5cfcd45de9b483f05482c730b, 7e43bf3cfe5d49f3b8b479c742dbd756; no voters:
I20260805 22:51:04.176545 11418 raft_consensus.cc:2781] T 00177193f4304422864e4b8de75977bb P 04a35cb5cfcd45de9b483f05482c730b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:51:04.176606 11418 raft_consensus.cc:482] T 00177193f4304422864e4b8de75977bb P 04a35cb5cfcd45de9b483f05482c730b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:51:04.176640 11418 raft_consensus.cc:3037] T 00177193f4304422864e4b8de75977bb P 04a35cb5cfcd45de9b483f05482c730b [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:51:04.177357 11418 raft_consensus.cc:504] T 00177193f4304422864e4b8de75977bb P 04a35cb5cfcd45de9b483f05482c730b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e43bf3cfe5d49f3b8b479c742dbd756" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40317 } } peers { permanent_uuid: "04a35cb5cfcd45de9b483f05482c730b" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 36997 } } peers { permanent_uuid: "dcc30ef8dfd74308adfb7828e6d7f168" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 44961 } }
I20260805 22:51:04.177495 11418 leader_election.cc:288] T 00177193f4304422864e4b8de75977bb P 04a35cb5cfcd45de9b483f05482c730b [CANDIDATE]: Term 1 election: Requested vote from peers 7e43bf3cfe5d49f3b8b479c742dbd756 (127.14.224.130:40317), dcc30ef8dfd74308adfb7828e6d7f168 (127.14.224.131:44961)
I20260805 22:51:04.177649 11134 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00177193f4304422864e4b8de75977bb" candidate_uuid: "04a35cb5cfcd45de9b483f05482c730b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e43bf3cfe5d49f3b8b479c742dbd756"
I20260805 22:51:04.177675 11318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00177193f4304422864e4b8de75977bb" candidate_uuid: "04a35cb5cfcd45de9b483f05482c730b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc30ef8dfd74308adfb7828e6d7f168"
I20260805 22:51:04.177734 11134 raft_consensus.cc:3037] T 00177193f4304422864e4b8de75977bb P 7e43bf3cfe5d49f3b8b479c742dbd756 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:51:04.177743 11318 raft_consensus.cc:3037] T 00177193f4304422864e4b8de75977bb P dcc30ef8dfd74308adfb7828e6d7f168 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:51:04.178647 11134 raft_consensus.cc:2454] T 00177193f4304422864e4b8de75977bb P 7e43bf3cfe5d49f3b8b479c742dbd756 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04a35cb5cfcd45de9b483f05482c730b in term 1.
I20260805 22:51:04.178650 11318 raft_consensus.cc:2454] T 00177193f4304422864e4b8de75977bb P dcc30ef8dfd74308adfb7828e6d7f168 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04a35cb5cfcd45de9b483f05482c730b in term 1.
I20260805 22:51:04.178828 10845 leader_election.cc:302] T 00177193f4304422864e4b8de75977bb P 04a35cb5cfcd45de9b483f05482c730b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04a35cb5cfcd45de9b483f05482c730b, dcc30ef8dfd74308adfb7828e6d7f168; no voters:
I20260805 22:51:04.178929 11418 raft_consensus.cc:2781] T 00177193f4304422864e4b8de75977bb P 04a35cb5cfcd45de9b483f05482c730b [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:51:04.179081 11418 raft_consensus.cc:686] T 00177193f4304422864e4b8de75977bb P 04a35cb5cfcd45de9b483f05482c730b [term 1 LEADER]: Becoming Leader. State: Replica: 04a35cb5cfcd45de9b483f05482c730b, State: Running, Role: LEADER
I20260805 22:51:04.179176 11418 consensus_queue.cc:237] T 00177193f4304422864e4b8de75977bb P 04a35cb5cfcd45de9b483f05482c730b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e43bf3cfe5d49f3b8b479c742dbd756" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40317 } } peers { permanent_uuid: "04a35cb5cfcd45de9b483f05482c730b" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 36997 } } peers { permanent_uuid: "dcc30ef8dfd74308adfb7828e6d7f168" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 44961 } }
I20260805 22:51:04.180063 10717 catalog_manager.cc:5495] T 00177193f4304422864e4b8de75977bb P 04a35cb5cfcd45de9b483f05482c730b reported cstate change: term changed from 0 to 1, leader changed from <none> to 04a35cb5cfcd45de9b483f05482c730b (127.14.224.129). New cstate: current_term: 1 leader_uuid: "04a35cb5cfcd45de9b483f05482c730b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e43bf3cfe5d49f3b8b479c742dbd756" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04a35cb5cfcd45de9b483f05482c730b" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 36997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc30ef8dfd74308adfb7828e6d7f168" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 44961 } health_report { overall_health: UNKNOWN } } }
I20260805 22:51:04.185454 11403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:04.183339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43730 (local address 127.14.224.129:36997)
0805 22:51:04.183390 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:04.183392 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:04.183402 (+ 10us) server_negotiation.cc:407] Connection header received
0805 22:51:04.183439 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:04.183440 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:04.183457 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:04.183518 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:51:04.183619 (+ 101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:04.184067 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:04.184806 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:04.184980 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:04.185022 (+ 42us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:04.185166 (+ 144us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:51:04.185256 (+ 90us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:51:04.185326 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:04.185346 (+ 20us) server_negotiation.cc:299] Negotiation successful
0805 22:51:04.185355 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260805 22:51:04.187345 11318 raft_consensus.cc:1261] T 00177193f4304422864e4b8de75977bb P dcc30ef8dfd74308adfb7828e6d7f168 [term 1 FOLLOWER]: Refusing update from remote peer 04a35cb5cfcd45de9b483f05482c730b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:51:04.187348 11134 raft_consensus.cc:1261] T 00177193f4304422864e4b8de75977bb P 7e43bf3cfe5d49f3b8b479c742dbd756 [term 1 FOLLOWER]: Refusing update from remote peer 04a35cb5cfcd45de9b483f05482c730b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:51:04.187701 11418 consensus_queue.cc:1035] T 00177193f4304422864e4b8de75977bb P 04a35cb5cfcd45de9b483f05482c730b [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc30ef8dfd74308adfb7828e6d7f168" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 44961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:51:04.187858 11422 consensus_queue.cc:1035] T 00177193f4304422864e4b8de75977bb P 04a35cb5cfcd45de9b483f05482c730b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e43bf3cfe5d49f3b8b479c742dbd756" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 40317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:51:04.190373 11428 mvcc.cc:205] Tried to move back new op lower bound from 7315334202108370944 to 7315334202078609408. Current Snapshot: MvccSnapshot[applied={T|T < 7315334202108370944}]
I20260805 22:51:04.190778 11429 mvcc.cc:205] Tried to move back new op lower bound from 7315334202108370944 to 7315334202078609408. Current Snapshot: MvccSnapshot[applied={T|T < 7315334202108370944}]
I20260805 22:51:04.191695 11430 mvcc.cc:205] Tried to move back new op lower bound from 7315334202108370944 to 7315334202078609408. Current Snapshot: MvccSnapshot[applied={T|T < 7315334202108370944 or (T in {7315334202108370944})}]
I20260805 22:51:04.193342 10717 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51718:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:51:04.193434 10717 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51718:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:51:04.194152 10717 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 581b8688def94c1d9757f3ebeefca087: Sending DeleteTablet for 3 replicas of tablet 00177193f4304422864e4b8de75977bb
I20260805 22:51:04.194607 11101 tablet_service.cc:1514] Processing DeleteTablet for tablet 00177193f4304422864e4b8de75977bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:51:04 UTC) from {username='slave'} at 127.0.0.1:57782
I20260805 22:51:04.194753 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 10820
I20260805 22:51:04.194850 10914 tablet_service.cc:1514] Processing DeleteTablet for tablet 00177193f4304422864e4b8de75977bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:51:04 UTC) from {username='slave'} at 127.0.0.1:43716
I20260805 22:51:04.194908 11440 tablet_replica.cc:330] T 00177193f4304422864e4b8de75977bb P 7e43bf3cfe5d49f3b8b479c742dbd756: stopping tablet replica
I20260805 22:51:04.195122 11440 raft_consensus.cc:2229] T 00177193f4304422864e4b8de75977bb P 7e43bf3cfe5d49f3b8b479c742dbd756 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:51:04.195308 11440 raft_consensus.cc:2258] T 00177193f4304422864e4b8de75977bb P 7e43bf3cfe5d49f3b8b479c742dbd756 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:51:04.201613 11440 ts_tablet_manager.cc:1905] T 00177193f4304422864e4b8de75977bb P 7e43bf3cfe5d49f3b8b479c742dbd756: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:51:04.201714 11289 tablet_service.cc:1514] Processing DeleteTablet for tablet 00177193f4304422864e4b8de75977bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:51:04 UTC) from {username='slave'} at 127.0.0.1:36586
I20260805 22:51:04.204267 11441 tablet_replica.cc:330] T 00177193f4304422864e4b8de75977bb P dcc30ef8dfd74308adfb7828e6d7f168: stopping tablet replica
I20260805 22:51:04.204438 11441 raft_consensus.cc:2229] T 00177193f4304422864e4b8de75977bb P dcc30ef8dfd74308adfb7828e6d7f168 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:51:04.204623 11441 raft_consensus.cc:2258] T 00177193f4304422864e4b8de75977bb P dcc30ef8dfd74308adfb7828e6d7f168 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:51:04.205808 11440 ts_tablet_manager.cc:1918] T 00177193f4304422864e4b8de75977bb P 7e43bf3cfe5d49f3b8b479c742dbd756: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:51:04.205905 11440 log.cc:1196] T 00177193f4304422864e4b8de75977bb P 7e43bf3cfe5d49f3b8b479c742dbd756: Deleting WAL directory at /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970021300824-15234-0/minicluster-data/ts-1/wal/wals/00177193f4304422864e4b8de75977bb
I20260805 22:51:04.206118 11441 ts_tablet_manager.cc:1905] T 00177193f4304422864e4b8de75977bb P dcc30ef8dfd74308adfb7828e6d7f168: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:51:04.206178 11440 ts_tablet_manager.cc:1939] T 00177193f4304422864e4b8de75977bb P 7e43bf3cfe5d49f3b8b479c742dbd756: Deleting consensus metadata
I20260805 22:51:04.206687 10691 catalog_manager.cc:4841] TS 7e43bf3cfe5d49f3b8b479c742dbd756 (127.14.224.130:40317): tablet 00177193f4304422864e4b8de75977bb (table test-table [id=89abee297fe94ccab05b41b5210d9bff]) successfully deleted
I20260805 22:51:04.207715 11441 ts_tablet_manager.cc:1918] T 00177193f4304422864e4b8de75977bb P dcc30ef8dfd74308adfb7828e6d7f168: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:51:04.207792 11441 log.cc:1196] T 00177193f4304422864e4b8de75977bb P dcc30ef8dfd74308adfb7828e6d7f168: Deleting WAL directory at /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970021300824-15234-0/minicluster-data/ts-2/wal/wals/00177193f4304422864e4b8de75977bb
I20260805 22:51:04.207981 11441 ts_tablet_manager.cc:1939] T 00177193f4304422864e4b8de75977bb P dcc30ef8dfd74308adfb7828e6d7f168: Deleting consensus metadata
I20260805 22:51:04.208411 10691 catalog_manager.cc:4841] TS dcc30ef8dfd74308adfb7828e6d7f168 (127.14.224.131:44961): tablet 00177193f4304422864e4b8de75977bb (table test-table [id=89abee297fe94ccab05b41b5210d9bff]) successfully deleted
W20260805 22:51:04.211203 10691 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.224.129:36997 (error 108)
I20260805 22:51:04.211428 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 11012
I20260805 22:51:04.217396 11405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:04.217204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.129:36997 (local address 127.0.0.1:43742)
0805 22:51:04.217283 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:04.217354 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.129:36997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260805 22:51:04.217566 10691 catalog_manager.cc:4584] TS 04a35cb5cfcd45de9b483f05482c730b (127.14.224.129:36997): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 00177193f4304422864e4b8de75977bb: Network error: Client connection negotiation failed: client connection to 127.14.224.129:36997: connect: Connection refused (error 111)
I20260805 22:51:04.220968 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 11200
I20260805 22:51:04.239492 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 10666
2026-08-05T22:51:04Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (835 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:51:04 dist-test-slave-gjrz krb5kdc[11446](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:51:04 dist-test-slave-gjrz krb5kdc[11446](info): set up 2 sockets
Aug 05 22:51:04 dist-test-slave-gjrz krb5kdc[11446](info): commencing operation
krb5kdc: starting...
W20260805 22:51:05.378005 15234 mini_kdc.cc:121] Time spent starting KDC: real 1.109s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Aug 05 22:51:05 dist-test-slave-gjrz krb5kdc[11446](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970265, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:51:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:51:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.224.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab.
Entry for principal kudu/127.14.224.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab.
I20260805 22:51:05.509795 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:46757
--webserver_interface=127.14.224.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:35421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.224.190:46757
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:51:05.593875 11465 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:51:05.594110 11465 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:51:05.594142 11465 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:51:05.595382 11465 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:51:05.595429 11465 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:51:05.595449 11465 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:51:05.595465 11465 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:51:05.595481 11465 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:51:05.597064 11465 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:35421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.224.190:46757
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:46757
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.224.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11465
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:51:05.597334 11465 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:51:05.597566 11465 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:51:05.602588 11476 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:05.602605 11473 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:05.602591 11472 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:51:05.602626 11465 server_base.cc:1034] running on GCE node
I20260805 22:51:05.603044 11465 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:51:05.603377 11465 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:51:05.604557 11465 hybrid_clock.cc:648] HybridClock initialized: now 1785970265604540 us; error 30 us; skew 500 ppm
Aug 05 22:51:05 dist-test-slave-gjrz krb5kdc[11446](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970265, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:51:05.607173 11465 init.cc:377] Logged in from keytab as kudu/127.14.224.190@KRBTEST.COM (short username kudu)
I20260805 22:51:05.607676 11465 webserver.cc:460] Webserver started at http://127.14.224.190:33657/ using document root <none> and password file <none>
I20260805 22:51:05.607890 11465 fs_manager.cc:359] Metadata directory not provided
I20260805 22:51:05.607941 11465 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:51:05.608081 11465 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:51:05.609160 11465 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/minicluster-data/master-0/data/instance:
uuid: "5de8e047befa4591b6296b819db6413a"
format_stamp: "Formatted at 2026-08-05 22:51:05 on dist-test-slave-gjrz"
server_key: "182ec50125d7aa7e64fa7521fd00a614"
server_key_iv: "30324a054a67cdbce6affa8690852b19"
server_key_version: "encryptionkey@0"
I20260805 22:51:05.609503 11465 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/minicluster-data/master-0/wal/instance:
uuid: "5de8e047befa4591b6296b819db6413a"
format_stamp: "Formatted at 2026-08-05 22:51:05 on dist-test-slave-gjrz"
server_key: "182ec50125d7aa7e64fa7521fd00a614"
server_key_iv: "30324a054a67cdbce6affa8690852b19"
server_key_version: "encryptionkey@0"
I20260805 22:51:05.610821 11465 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260805 22:51:05.611634 11485 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:05.611779 11465 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:05.611867 11465 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/minicluster-data/master-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/minicluster-data/master-0/wal
uuid: "5de8e047befa4591b6296b819db6413a"
format_stamp: "Formatted at 2026-08-05 22:51:05 on dist-test-slave-gjrz"
server_key: "182ec50125d7aa7e64fa7521fd00a614"
server_key_iv: "30324a054a67cdbce6affa8690852b19"
server_key_version: "encryptionkey@0"
I20260805 22:51:05.611933 11465 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:51:05.623978 11465 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:51:05.626039 11465 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:51:05.626186 11465 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:51:05.630278 11465 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.190:46757
I20260805 22:51:05.630317 11561 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.190:46757 every 8 connection(s)
I20260805 22:51:05.630676 11465 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
I20260805 22:51:05.631592 11562 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:51:05.633999 11562 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5de8e047befa4591b6296b819db6413a: Bootstrap starting.
I20260805 22:51:05.634589 11562 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5de8e047befa4591b6296b819db6413a: Neither blocks nor log segments found. Creating new log.
I20260805 22:51:05.634848 11562 log.cc:824] T 00000000000000000000000000000000 P 5de8e047befa4591b6296b819db6413a: Log is configured to *not* fsync() on all Append() calls
I20260805 22:51:05.635488 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 11465
I20260805 22:51:05.635614 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/minicluster-data/master-0/wal/instance
I20260805 22:51:05.635670 11562 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5de8e047befa4591b6296b819db6413a: No bootstrap required, opened a new log
I20260805 22:51:05.635835 15234 external_mini_cluster.cc:1428] Setting key 3204ef2b0ffd80544ed05f0bd72a8c3e
I20260805 22:51:05.638001 11562 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5de8e047befa4591b6296b819db6413a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5de8e047befa4591b6296b819db6413a" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 46757 } }
I20260805 22:51:05.638188 11562 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5de8e047befa4591b6296b819db6413a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:51:05.638234 11562 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5de8e047befa4591b6296b819db6413a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5de8e047befa4591b6296b819db6413a, State: Initialized, Role: FOLLOWER
I20260805 22:51:05.638365 11562 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5de8e047befa4591b6296b819db6413a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5de8e047befa4591b6296b819db6413a" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 46757 } }
I20260805 22:51:05.638445 11562 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5de8e047befa4591b6296b819db6413a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:51:05.638478 11562 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5de8e047befa4591b6296b819db6413a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:51:05.638528 11562 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5de8e047befa4591b6296b819db6413a [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:51:05.639127 11562 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5de8e047befa4591b6296b819db6413a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5de8e047befa4591b6296b819db6413a" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 46757 } }
I20260805 22:51:05.639233 11562 leader_election.cc:302] T 00000000000000000000000000000000 P 5de8e047befa4591b6296b819db6413a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5de8e047befa4591b6296b819db6413a; no voters:
I20260805 22:51:05.639441 11562 leader_election.cc:288] T 00000000000000000000000000000000 P 5de8e047befa4591b6296b819db6413a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:51:05.639540 11567 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5de8e047befa4591b6296b819db6413a [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:51:05.639735 11567 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5de8e047befa4591b6296b819db6413a [term 1 LEADER]: Becoming Leader. State: Replica: 5de8e047befa4591b6296b819db6413a, State: Running, Role: LEADER
I20260805 22:51:05.639863 11567 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5de8e047befa4591b6296b819db6413a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5de8e047befa4591b6296b819db6413a" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 46757 } }
I20260805 22:51:05.639735 11562 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5de8e047befa4591b6296b819db6413a [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:51:05.640265 11568 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5de8e047befa4591b6296b819db6413a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5de8e047befa4591b6296b819db6413a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5de8e047befa4591b6296b819db6413a" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 46757 } } }
I20260805 22:51:05.640317 11571 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5de8e047befa4591b6296b819db6413a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5de8e047befa4591b6296b819db6413a. Latest consensus state: current_term: 1 leader_uuid: "5de8e047befa4591b6296b819db6413a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5de8e047befa4591b6296b819db6413a" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 46757 } } }
I20260805 22:51:05.640353 11568 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5de8e047befa4591b6296b819db6413a [sys.catalog]: This master's current role is: LEADER
I20260805 22:51:05.640362 11571 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5de8e047befa4591b6296b819db6413a [sys.catalog]: This master's current role is: LEADER
I20260805 22:51:05.640563 11573 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:51:05.641120 11573 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:51:05.642786 11573 catalog_manager.cc:1347] Generated new cluster ID: caf3241734824a71accfb751ff91ae63
I20260805 22:51:05.642841 11573 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 05 22:51:05 dist-test-slave-gjrz krb5kdc[11446](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970265, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:51:05.647605 11566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:05.636368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58374 (local address 127.14.224.190:46757)
0805 22:51:05.636558 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:05.636567 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:05.636593 (+ 26us) server_negotiation.cc:407] Connection header received
0805 22:51:05.637009 (+ 416us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:05.637016 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:05.637065 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:05.637176 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:05.637971 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:05.639230 (+ 1259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:05.640317 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:05.640963 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:05.641047 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:05.643899 (+ 2852us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:05.643904 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:05.643904 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:51:05.643916 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:05.645889 (+ 1973us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:05.646278 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:05.646281 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:05.646282 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:05.646400 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:05.646586 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:05.646586 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:05.646587 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:05.646920 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:05.647094 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:05.647176 (+ 82us) server_negotiation.cc:299] Negotiation successful
0805 22:51:05.647361 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":78,"threads_started":1}
I20260805 22:51:05.655507 11573 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:51:05.656294 11573 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:51:05.669059 11573 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5de8e047befa4591b6296b819db6413a: Generated new TSK 0
I20260805 22:51:05.669343 11573 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.224.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab.
Entry for principal kudu/127.14.224.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab.
I20260805 22:51:05.711236 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.129:0
--local_ip_for_outbound_sockets=127.14.224.129
--webserver_interface=127.14.224.129
--webserver_port=0
--tserver_master_addrs=127.14.224.190:46757
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab
--principal=kudu/127.14.224.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:35421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:51:05.803148 11600 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:51:05.803418 11600 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:51:05.803447 11600 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:51:05.804689 11600 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:51:05.804740 11600 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:51:05.804766 11600 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.129
I20260805 22:51:05.806280 11600 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:35421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.129.keytab
--principal=kudu/127.14.224.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.224.129
--webserver_port=0
--tserver_master_addrs=127.14.224.190:46757
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11600
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.129
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:51:05.806522 11600 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:51:05.806759 11600 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:51:05.812242 11606 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:05.812258 11605 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:05.812252 11609 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:51:05.812331 11600 server_base.cc:1034] running on GCE node
I20260805 22:51:05.812656 11600 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:51:05.812893 11600 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:51:05.814081 11600 hybrid_clock.cc:648] HybridClock initialized: now 1785970265814061 us; error 29 us; skew 500 ppm
Aug 05 22:51:05 dist-test-slave-gjrz krb5kdc[11446](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970265, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:51:05.816697 11600 init.cc:377] Logged in from keytab as kudu/127.14.224.129@KRBTEST.COM (short username kudu)
I20260805 22:51:05.817174 11600 webserver.cc:460] Webserver started at http://127.14.224.129:41827/ using document root <none> and password file <none>
I20260805 22:51:05.817382 11600 fs_manager.cc:359] Metadata directory not provided
I20260805 22:51:05.817431 11600 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:51:05.817575 11600 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:51:05.818646 11600 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/minicluster-data/ts-0/data/instance:
uuid: "cfa325f3df15438685ad195a3a193802"
format_stamp: "Formatted at 2026-08-05 22:51:05 on dist-test-slave-gjrz"
server_key: "d00335385a3e00f3e11623f00f29a73e"
server_key_iv: "64368e4a28c7908902985c2fbc1c10dc"
server_key_version: "encryptionkey@0"
I20260805 22:51:05.818992 11600 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/minicluster-data/ts-0/wal/instance:
uuid: "cfa325f3df15438685ad195a3a193802"
format_stamp: "Formatted at 2026-08-05 22:51:05 on dist-test-slave-gjrz"
server_key: "d00335385a3e00f3e11623f00f29a73e"
server_key_iv: "64368e4a28c7908902985c2fbc1c10dc"
server_key_version: "encryptionkey@0"
I20260805 22:51:05.820350 11600 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260805 22:51:05.821177 11619 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:05.821640 11600 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:51:05.821738 11600 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/minicluster-data/ts-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/minicluster-data/ts-0/wal
uuid: "cfa325f3df15438685ad195a3a193802"
format_stamp: "Formatted at 2026-08-05 22:51:05 on dist-test-slave-gjrz"
server_key: "d00335385a3e00f3e11623f00f29a73e"
server_key_iv: "64368e4a28c7908902985c2fbc1c10dc"
server_key_version: "encryptionkey@0"
I20260805 22:51:05.821806 11600 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:51:05.846617 11600 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:51:05.848732 11600 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:51:05.848882 11600 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:51:05.849128 11600 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:51:05.849447 11600 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:51:05.849483 11600 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:05.849511 11600 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:51:05.849532 11600 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:05.855441 11600 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.129:35969
I20260805 22:51:05.855501 11786 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.129:35969 every 8 connection(s)
I20260805 22:51:05.855858 11600 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
I20260805 22:51:05.858356 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 11600
I20260805 22:51:05.858470 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/minicluster-data/ts-0/wal/instance
I20260805 22:51:05.858651 15234 external_mini_cluster.cc:1428] Setting key fa291f1270142ad9cb3c09da25038d14
Aug 05 22:51:05 dist-test-slave-gjrz krb5kdc[11446](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970265, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.129@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:51:05.865512 11566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:05.856689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.129:34529 (local address 127.14.224.190:46757)
0805 22:51:05.856770 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:05.856772 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:05.856933 (+ 161us) server_negotiation.cc:407] Connection header received
0805 22:51:05.857464 (+ 531us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:05.857465 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:05.857478 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:05.857533 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:05.858598 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:05.859145 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:05.860187 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:05.860408 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:05.860466 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:05.862835 (+ 2369us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:05.862837 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:05.862837 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:51:05.862845 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:05.864136 (+ 1291us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:05.864555 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:05.864557 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:05.864557 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:05.864623 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:05.864860 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:05.864861 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:05.864861 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:05.864979 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:05.865037 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:05.865319 (+ 282us) server_negotiation.cc:299] Negotiation successful
0805 22:51:05.865418 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260805 22:51:05.865691 11790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:05.856612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:46757 (local address 127.14.224.129:34529)
0805 22:51:05.856807 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:05.856849 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0805 22:51:05.857356 (+ 507us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:51:05.857616 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:51:05.857620 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:51:05.858228 (+ 608us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:51:05.858439 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:05.858444 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:05.859242 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:05.859243 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:05.860097 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:05.860100 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:05.860486 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:05.860487 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:05.860616 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:05.861127 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:51:05.861136 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:51:05.862736 (+ 1600us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:51:05.864222 (+ 1486us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:51:05.864232 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:51:05.864234 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:51:05.864481 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:51:05.864682 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:51:05.864682 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:51:05.864683 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:51:05.864799 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:51:05.865035 (+ 236us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:51:05.865043 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:51:05.865195 (+ 152us) client_negotiation.cc:769] Sending connection context
0805 22:51:05.865289 (+ 94us) client_negotiation.cc:240] Negotiation successful
0805 22:51:05.865460 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":100,"threads_started":1}
I20260805 22:51:05.866223 11787 heartbeater.cc:347] Connected to a master server at 127.14.224.190:46757
I20260805 22:51:05.866348 11787 heartbeater.cc:464] Registering TS with master...
I20260805 22:51:05.866576 11787 heartbeater.cc:511] Master 127.14.224.190:46757 requested a full tablet report, sending...
I20260805 22:51:05.867295 11511 ts_manager.cc:194] Registered new tserver with Master: cfa325f3df15438685ad195a3a193802 (127.14.224.129:35969)
WARNING: no policy specified for kudu/127.14.224.130@KRBTEST.COM; defaulting to no policy
I20260805 22:51:05.867995 11511 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.224.129@KRBTEST.COM'} at 127.14.224.129:34529
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab.
Entry for principal kudu/127.14.224.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab.
I20260805 22:51:05.888497 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.130:0
--local_ip_for_outbound_sockets=127.14.224.130
--webserver_interface=127.14.224.130
--webserver_port=0
--tserver_master_addrs=127.14.224.190:46757
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab
--principal=kudu/127.14.224.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:35421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:51:05.987519 11794 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:51:05.987764 11794 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:51:05.987792 11794 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:51:05.989091 11794 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:51:05.989153 11794 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:51:05.989182 11794 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.130
I20260805 22:51:05.990854 11794 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:35421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.130.keytab
--principal=kudu/127.14.224.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.224.130
--webserver_port=0
--tserver_master_addrs=127.14.224.190:46757
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11794
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.130
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:51:05.991129 11794 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:51:05.991416 11794 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:51:05.996551 11808 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:05.996604 11804 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:05.996560 11802 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:51:05.996825 11794 server_base.cc:1034] running on GCE node
I20260805 22:51:05.997013 11794 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:51:05.997255 11794 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:51:05.998450 11794 hybrid_clock.cc:648] HybridClock initialized: now 1785970265998433 us; error 32 us; skew 500 ppm
Aug 05 22:51:05 dist-test-slave-gjrz krb5kdc[11446](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970265, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:51:06.001298 11794 init.cc:377] Logged in from keytab as kudu/127.14.224.130@KRBTEST.COM (short username kudu)
I20260805 22:51:06.001799 11794 webserver.cc:460] Webserver started at http://127.14.224.130:42191/ using document root <none> and password file <none>
I20260805 22:51:06.002077 11794 fs_manager.cc:359] Metadata directory not provided
I20260805 22:51:06.002130 11794 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:51:06.002259 11794 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:51:06.003410 11794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/minicluster-data/ts-1/data/instance:
uuid: "402bf8cdd4b14ead84b7ec2b3479d426"
format_stamp: "Formatted at 2026-08-05 22:51:05 on dist-test-slave-gjrz"
server_key: "385231733924fc2cfca2880a57d1ba79"
server_key_iv: "32903359c6ed34559afcddd99057e1d2"
server_key_version: "encryptionkey@0"
I20260805 22:51:06.003752 11794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/minicluster-data/ts-1/wal/instance:
uuid: "402bf8cdd4b14ead84b7ec2b3479d426"
format_stamp: "Formatted at 2026-08-05 22:51:05 on dist-test-slave-gjrz"
server_key: "385231733924fc2cfca2880a57d1ba79"
server_key_iv: "32903359c6ed34559afcddd99057e1d2"
server_key_version: "encryptionkey@0"
I20260805 22:51:06.005125 11794 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260805 22:51:06.005878 11819 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:06.006104 11794 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:51:06.006203 11794 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/minicluster-data/ts-1/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/minicluster-data/ts-1/wal
uuid: "402bf8cdd4b14ead84b7ec2b3479d426"
format_stamp: "Formatted at 2026-08-05 22:51:05 on dist-test-slave-gjrz"
server_key: "385231733924fc2cfca2880a57d1ba79"
server_key_iv: "32903359c6ed34559afcddd99057e1d2"
server_key_version: "encryptionkey@0"
I20260805 22:51:06.006271 11794 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:51:06.020124 11794 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:51:06.022369 11794 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:51:06.022518 11794 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:51:06.022763 11794 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:51:06.023095 11794 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:51:06.023132 11794 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:06.023164 11794 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:51:06.023193 11794 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:06.029193 11794 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.130:35751
I20260805 22:51:06.029264 11969 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.130:35751 every 8 connection(s)
I20260805 22:51:06.029589 11794 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
I20260805 22:51:06.034898 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 11794
I20260805 22:51:06.035072 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/minicluster-data/ts-1/wal/instance
I20260805 22:51:06.035346 15234 external_mini_cluster.cc:1428] Setting key 12781b59130ed606d688a2207dfb9053
Aug 05 22:51:06 dist-test-slave-gjrz krb5kdc[11446](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970265, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.130@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:51:06.039994 11566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:06.030385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:49183 (local address 127.14.224.190:46757)
0805 22:51:06.030441 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:06.030443 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:06.030714 (+ 271us) server_negotiation.cc:407] Connection header received
0805 22:51:06.031235 (+ 521us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:06.031237 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:06.031249 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:06.031343 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:06.032388 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:06.032943 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:06.033956 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:06.034166 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:06.034232 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:06.036887 (+ 2655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:06.036889 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:06.036889 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:51:06.036898 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:06.038335 (+ 1437us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:06.038890 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:06.038892 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:06.038892 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:06.038967 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:06.039247 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:06.039249 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:06.039249 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:06.039418 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:06.039483 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:06.039807 (+ 324us) server_negotiation.cc:299] Negotiation successful
0805 22:51:06.039898 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260805 22:51:06.040287 11974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:06.030349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:46757 (local address 127.14.224.130:49183)
0805 22:51:06.030541 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:06.030602 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0805 22:51:06.031104 (+ 502us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:51:06.031487 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:51:06.031491 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:51:06.032087 (+ 596us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:51:06.032288 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:06.032292 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:06.033022 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:06.033023 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:06.033854 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:06.033857 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:06.034247 (+ 390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:06.034248 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:06.034363 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:06.034959 (+ 596us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:51:06.034970 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:51:06.036781 (+ 1811us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:51:06.038430 (+ 1649us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:51:06.038440 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:51:06.038443 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:51:06.038809 (+ 366us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:51:06.039042 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:51:06.039043 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:51:06.039043 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:51:06.039177 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:51:06.039483 (+ 306us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:51:06.039491 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:51:06.039680 (+ 189us) client_negotiation.cc:769] Sending connection context
0805 22:51:06.039776 (+ 96us) client_negotiation.cc:240] Negotiation successful
0805 22:51:06.039963 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":95,"threads_started":1}
I20260805 22:51:06.040863 11971 heartbeater.cc:347] Connected to a master server at 127.14.224.190:46757
I20260805 22:51:06.040963 11971 heartbeater.cc:464] Registering TS with master...
I20260805 22:51:06.041162 11971 heartbeater.cc:511] Master 127.14.224.190:46757 requested a full tablet report, sending...
I20260805 22:51:06.041579 11511 ts_manager.cc:194] Registered new tserver with Master: 402bf8cdd4b14ead84b7ec2b3479d426 (127.14.224.130:35751)
I20260805 22:51:06.041949 11511 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.224.130@KRBTEST.COM'} at 127.14.224.130:49183
WARNING: no policy specified for kudu/127.14.224.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab.
Entry for principal kudu/127.14.224.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab.
I20260805 22:51:06.067239 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.131:0
--local_ip_for_outbound_sockets=127.14.224.131
--webserver_interface=127.14.224.131
--webserver_port=0
--tserver_master_addrs=127.14.224.190:46757
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab
--principal=kudu/127.14.224.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:35421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:51:06.153311 11978 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:51:06.153560 11978 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:51:06.153596 11978 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:51:06.154858 11978 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:51:06.154913 11978 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:51:06.154951 11978 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.131
I20260805 22:51:06.156620 11978 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:35421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.131.keytab
--principal=kudu/127.14.224.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.224.131
--webserver_port=0
--tserver_master_addrs=127.14.224.190:46757
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11978
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.131
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:51:06.156899 11978 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:51:06.157152 11978 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:51:06.162496 11986 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:51:06.162619 11978 server_base.cc:1034] running on GCE node
W20260805 22:51:06.162566 11983 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:06.162734 11984 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:51:06.163034 11978 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:51:06.163472 11978 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:51:06.164649 11978 hybrid_clock.cc:648] HybridClock initialized: now 1785970266164629 us; error 40 us; skew 500 ppm
Aug 05 22:51:06 dist-test-slave-gjrz krb5kdc[11446](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970266, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:51:06.167667 11978 init.cc:377] Logged in from keytab as kudu/127.14.224.131@KRBTEST.COM (short username kudu)
I20260805 22:51:06.168175 11978 webserver.cc:460] Webserver started at http://127.14.224.131:37641/ using document root <none> and password file <none>
I20260805 22:51:06.168370 11978 fs_manager.cc:359] Metadata directory not provided
I20260805 22:51:06.168411 11978 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:51:06.168529 11978 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:51:06.169636 11978 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/minicluster-data/ts-2/data/instance:
uuid: "ab7b5aca2c994fa8ac2046e841629a81"
format_stamp: "Formatted at 2026-08-05 22:51:06 on dist-test-slave-gjrz"
server_key: "1c8cd58a4c72f8bad8f23b34a8f42ccc"
server_key_iv: "5ba98731d2aeda6c08359aef47d2104a"
server_key_version: "encryptionkey@0"
I20260805 22:51:06.169970 11978 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/minicluster-data/ts-2/wal/instance:
uuid: "ab7b5aca2c994fa8ac2046e841629a81"
format_stamp: "Formatted at 2026-08-05 22:51:06 on dist-test-slave-gjrz"
server_key: "1c8cd58a4c72f8bad8f23b34a8f42ccc"
server_key_iv: "5ba98731d2aeda6c08359aef47d2104a"
server_key_version: "encryptionkey@0"
I20260805 22:51:06.171331 11978 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260805 22:51:06.172120 12001 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:06.172286 11978 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:51:06.172380 11978 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/minicluster-data/ts-2/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/minicluster-data/ts-2/wal
uuid: "ab7b5aca2c994fa8ac2046e841629a81"
format_stamp: "Formatted at 2026-08-05 22:51:06 on dist-test-slave-gjrz"
server_key: "1c8cd58a4c72f8bad8f23b34a8f42ccc"
server_key_iv: "5ba98731d2aeda6c08359aef47d2104a"
server_key_version: "encryptionkey@0"
I20260805 22:51:06.172473 11978 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:51:06.183735 11978 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:51:06.185756 11978 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:51:06.185896 11978 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:51:06.186149 11978 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:51:06.186473 11978 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:51:06.186509 11978 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:06.186533 11978 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:51:06.186556 11978 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:06.192302 11978 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.131:46759
I20260805 22:51:06.192360 12162 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.131:46759 every 8 connection(s)
I20260805 22:51:06.192687 11978 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
I20260805 22:51:06.193513 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 11978
I20260805 22:51:06.193629 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/minicluster-data/ts-2/wal/instance
I20260805 22:51:06.193859 15234 external_mini_cluster.cc:1428] Setting key 36a6ffa06658d290f2d8111e82de06e6
Aug 05 22:51:06 dist-test-slave-gjrz krb5kdc[11446](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970266, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.131@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:51:06.202868 11566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:06.193512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:40197 (local address 127.14.224.190:46757)
0805 22:51:06.193583 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:06.193585 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:06.193840 (+ 255us) server_negotiation.cc:407] Connection header received
0805 22:51:06.194474 (+ 634us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:06.194475 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:06.194488 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:06.194548 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:06.195802 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:06.196387 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:06.197439 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:06.197642 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:06.197701 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:06.200126 (+ 2425us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:06.200128 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:06.200128 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:51:06.200136 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:06.201403 (+ 1267us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:06.201849 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:06.201851 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:06.201851 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:06.201955 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:06.202203 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:06.202203 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:06.202204 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:06.202320 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:06.202371 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:06.202705 (+ 334us) server_negotiation.cc:299] Negotiation successful
0805 22:51:06.202787 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260805 22:51:06.203025 12166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:06.193444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:46757 (local address 127.14.224.131:40197)
0805 22:51:06.193684 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:06.193738 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0805 22:51:06.194370 (+ 632us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:51:06.194624 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:51:06.194629 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:51:06.195303 (+ 674us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:51:06.195532 (+ 229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:06.195538 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:06.196487 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:06.196488 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:06.197343 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:06.197346 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:06.197720 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:06.197722 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:06.197861 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:06.198390 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:51:06.198400 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:51:06.199983 (+ 1583us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:51:06.201499 (+ 1516us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:51:06.201507 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:51:06.201510 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:51:06.201754 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:51:06.202018 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:51:06.202019 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:51:06.202019 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:51:06.202152 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:51:06.202396 (+ 244us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:51:06.202403 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:51:06.202569 (+ 166us) client_negotiation.cc:769] Sending connection context
0805 22:51:06.202668 (+ 99us) client_negotiation.cc:240] Negotiation successful
0805 22:51:06.202810 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":82,"threads_started":1}
I20260805 22:51:06.203557 12163 heartbeater.cc:347] Connected to a master server at 127.14.224.190:46757
I20260805 22:51:06.203677 12163 heartbeater.cc:464] Registering TS with master...
I20260805 22:51:06.203876 12163 heartbeater.cc:511] Master 127.14.224.190:46757 requested a full tablet report, sending...
I20260805 22:51:06.204279 11511 ts_manager.cc:194] Registered new tserver with Master: ab7b5aca2c994fa8ac2046e841629a81 (127.14.224.131:46759)
I20260805 22:51:06.204685 11511 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.224.131@KRBTEST.COM'} at 127.14.224.131:40197
I20260805 22:51:06.205578 15234 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 22:51:06.212858 11566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:06.206822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58378 (local address 127.14.224.190:46757)
0805 22:51:06.206885 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:06.206887 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:06.206995 (+ 108us) server_negotiation.cc:407] Connection header received
0805 22:51:06.207067 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:06.207067 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:06.207078 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:06.207116 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:06.207704 (+ 588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:06.208194 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:06.208906 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:06.209106 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:06.209162 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:06.210357 (+ 1195us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:06.210359 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:06.210359 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:51:06.210367 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:06.211717 (+ 1350us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:06.212080 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:06.212081 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:06.212082 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:06.212139 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:06.212307 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:06.212308 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:06.212308 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:06.212474 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:06.212566 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:06.212677 (+ 111us) server_negotiation.cc:299] Negotiation successful
0805 22:51:06.212763 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260805 22:51:06.214481 11511 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58378:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:51:06.216187 11511 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:51:06.222807 12179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:06.218554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.130:35751 (local address 127.0.0.1:37070)
0805 22:51:06.219000 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:06.219035 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0805 22:51:06.219087 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:51:06.219243 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:51:06.219244 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:51:06.219246 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:51:06.219344 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:06.219346 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:06.220391 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:06.220393 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:06.221759 (+ 1366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:06.221763 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:06.222456 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:06.222457 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:06.222547 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:06.222564 (+ 17us) client_negotiation.cc:769] Sending connection context
0805 22:51:06.222648 (+ 84us) client_negotiation.cc:240] Negotiation successful
0805 22:51:06.222714 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":430,"mutex_wait_us":43,"thread_start_us":89,"threads_started":1}
I20260805 22:51:06.222826 12183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:06.218735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37070 (local address 127.14.224.130:35751)
0805 22:51:06.218952 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:06.218958 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:06.219090 (+ 132us) server_negotiation.cc:407] Connection header received
0805 22:51:06.219154 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:06.219157 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:06.219172 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:06.219239 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:51:06.219472 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:06.220278 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:06.221843 (+ 1565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:06.222374 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:06.222439 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:06.222489 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:06.222685 (+ 196us) server_negotiation.cc:299] Negotiation successful
0805 22:51:06.222734 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":187,"thread_start_us":102,"threads_started":1}
I20260805 22:51:06.223522 12176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:06.218548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.131:46759 (local address 127.0.0.1:48204)
0805 22:51:06.218729 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:06.218775 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0805 22:51:06.218849 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:51:06.219175 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:51:06.219178 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:51:06.219181 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:51:06.219286 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:06.219289 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:06.220692 (+ 1403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:06.220693 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:06.221760 (+ 1067us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:06.221763 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:06.223230 (+ 1467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:06.223231 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:06.223327 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:06.223332 (+ 5us) client_negotiation.cc:769] Sending connection context
0805 22:51:06.223388 (+ 56us) client_negotiation.cc:240] Negotiation successful
0805 22:51:06.223441 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"mutex_wait_us":3,"thread_start_us":67,"threads_started":1}
I20260805 22:51:06.223560 12181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:06.218723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48204 (local address 127.14.224.131:46759)
0805 22:51:06.218886 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:06.218891 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:06.218923 (+ 32us) server_negotiation.cc:407] Connection header received
0805 22:51:06.218966 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:06.218969 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:06.218987 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:06.219064 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:51:06.219373 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:06.220570 (+ 1197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:06.222525 (+ 1955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:06.223143 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:06.223217 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:06.223301 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:06.223421 (+ 120us) server_negotiation.cc:299] Negotiation successful
0805 22:51:06.223474 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":94,"threads_started":1}
I20260805 22:51:06.223908 12177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:06.218554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.129:35969 (local address 127.0.0.1:54582)
0805 22:51:06.218950 (+ 396us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:06.218958 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0805 22:51:06.218996 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:51:06.219310 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:51:06.219311 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:51:06.219313 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:51:06.219349 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:06.219351 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:06.221863 (+ 2512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:06.221864 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:06.222632 (+ 768us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:06.222635 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:06.223665 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:06.223666 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:06.223732 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:06.223737 (+ 5us) client_negotiation.cc:769] Sending connection context
0805 22:51:06.223793 (+ 56us) client_negotiation.cc:240] Negotiation successful
0805 22:51:06.223842 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":381,"thread_start_us":97,"threads_started":1}
I20260805 22:51:06.223960 12184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:06.218916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54582 (local address 127.14.224.129:35969)
0805 22:51:06.219134 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:06.219138 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:06.219147 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:51:06.219183 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:06.219186 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:06.219199 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:06.219425 (+ 226us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:51:06.219507 (+ 82us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:06.220587 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:06.222725 (+ 2138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:06.223483 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:06.223566 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:06.223626 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:06.223830 (+ 204us) server_negotiation.cc:299] Negotiation successful
0805 22:51:06.223881 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":187,"thread_start_us":104,"threads_started":1}
I20260805 22:51:06.224135 11877 tablet_service.cc:1467] Processing CreateTablet for tablet 041916bcb2504cc284464f7c68644e5d (DEFAULT_TABLE table=test-table [id=f68cb6319bb148d68901f0df8f3ac286]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:51:06.224516 11877 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 041916bcb2504cc284464f7c68644e5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:51:06.224591 12068 tablet_service.cc:1467] Processing CreateTablet for tablet 041916bcb2504cc284464f7c68644e5d (DEFAULT_TABLE table=test-table [id=f68cb6319bb148d68901f0df8f3ac286]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:51:06.224623 11688 tablet_service.cc:1467] Processing CreateTablet for tablet 041916bcb2504cc284464f7c68644e5d (DEFAULT_TABLE table=test-table [id=f68cb6319bb148d68901f0df8f3ac286]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:51:06.224925 11688 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 041916bcb2504cc284464f7c68644e5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:51:06.224926 12068 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 041916bcb2504cc284464f7c68644e5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:51:06.227183 12185 tablet_bootstrap.cc:492] T 041916bcb2504cc284464f7c68644e5d P 402bf8cdd4b14ead84b7ec2b3479d426: Bootstrap starting.
I20260805 22:51:06.228091 12185 tablet_bootstrap.cc:654] T 041916bcb2504cc284464f7c68644e5d P 402bf8cdd4b14ead84b7ec2b3479d426: Neither blocks nor log segments found. Creating new log.
I20260805 22:51:06.228365 12189 tablet_bootstrap.cc:492] T 041916bcb2504cc284464f7c68644e5d P cfa325f3df15438685ad195a3a193802: Bootstrap starting.
I20260805 22:51:06.228673 12185 log.cc:824] T 041916bcb2504cc284464f7c68644e5d P 402bf8cdd4b14ead84b7ec2b3479d426: Log is configured to *not* fsync() on all Append() calls
I20260805 22:51:06.229060 12189 tablet_bootstrap.cc:654] T 041916bcb2504cc284464f7c68644e5d P cfa325f3df15438685ad195a3a193802: Neither blocks nor log segments found. Creating new log.
I20260805 22:51:06.229096 12190 tablet_bootstrap.cc:492] T 041916bcb2504cc284464f7c68644e5d P ab7b5aca2c994fa8ac2046e841629a81: Bootstrap starting.
I20260805 22:51:06.229431 12185 tablet_bootstrap.cc:492] T 041916bcb2504cc284464f7c68644e5d P 402bf8cdd4b14ead84b7ec2b3479d426: No bootstrap required, opened a new log
I20260805 22:51:06.229501 12185 ts_tablet_manager.cc:1397] T 041916bcb2504cc284464f7c68644e5d P 402bf8cdd4b14ead84b7ec2b3479d426: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260805 22:51:06.229655 12189 log.cc:824] T 041916bcb2504cc284464f7c68644e5d P cfa325f3df15438685ad195a3a193802: Log is configured to *not* fsync() on all Append() calls
I20260805 22:51:06.229720 12190 tablet_bootstrap.cc:654] T 041916bcb2504cc284464f7c68644e5d P ab7b5aca2c994fa8ac2046e841629a81: Neither blocks nor log segments found. Creating new log.
I20260805 22:51:06.230234 12190 log.cc:824] T 041916bcb2504cc284464f7c68644e5d P ab7b5aca2c994fa8ac2046e841629a81: Log is configured to *not* fsync() on all Append() calls
I20260805 22:51:06.230520 12189 tablet_bootstrap.cc:492] T 041916bcb2504cc284464f7c68644e5d P cfa325f3df15438685ad195a3a193802: No bootstrap required, opened a new log
I20260805 22:51:06.230590 12189 ts_tablet_manager.cc:1397] T 041916bcb2504cc284464f7c68644e5d P cfa325f3df15438685ad195a3a193802: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260805 22:51:06.230989 12190 tablet_bootstrap.cc:492] T 041916bcb2504cc284464f7c68644e5d P ab7b5aca2c994fa8ac2046e841629a81: No bootstrap required, opened a new log
I20260805 22:51:06.231065 12190 ts_tablet_manager.cc:1397] T 041916bcb2504cc284464f7c68644e5d P ab7b5aca2c994fa8ac2046e841629a81: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260805 22:51:06.231379 12185 raft_consensus.cc:348] T 041916bcb2504cc284464f7c68644e5d P 402bf8cdd4b14ead84b7ec2b3479d426 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfa325f3df15438685ad195a3a193802" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 35969 } } peers { permanent_uuid: "ab7b5aca2c994fa8ac2046e841629a81" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46759 } } peers { permanent_uuid: "402bf8cdd4b14ead84b7ec2b3479d426" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 35751 } }
I20260805 22:51:06.231544 12185 raft_consensus.cc:374] T 041916bcb2504cc284464f7c68644e5d P 402bf8cdd4b14ead84b7ec2b3479d426 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:51:06.231580 12185 raft_consensus.cc:729] T 041916bcb2504cc284464f7c68644e5d P 402bf8cdd4b14ead84b7ec2b3479d426 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 402bf8cdd4b14ead84b7ec2b3479d426, State: Initialized, Role: FOLLOWER
I20260805 22:51:06.231719 12185 consensus_queue.cc:260] T 041916bcb2504cc284464f7c68644e5d P 402bf8cdd4b14ead84b7ec2b3479d426 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfa325f3df15438685ad195a3a193802" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 35969 } } peers { permanent_uuid: "ab7b5aca2c994fa8ac2046e841629a81" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46759 } } peers { permanent_uuid: "402bf8cdd4b14ead84b7ec2b3479d426" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 35751 } }
I20260805 22:51:06.232002 12185 ts_tablet_manager.cc:1428] T 041916bcb2504cc284464f7c68644e5d P 402bf8cdd4b14ead84b7ec2b3479d426: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260805 22:51:06.232128 11971 heartbeater.cc:503] Master 127.14.224.190:46757 was elected leader, sending a full tablet report...
I20260805 22:51:06.232596 12189 raft_consensus.cc:348] T 041916bcb2504cc284464f7c68644e5d P cfa325f3df15438685ad195a3a193802 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfa325f3df15438685ad195a3a193802" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 35969 } } peers { permanent_uuid: "ab7b5aca2c994fa8ac2046e841629a81" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46759 } } peers { permanent_uuid: "402bf8cdd4b14ead84b7ec2b3479d426" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 35751 } }
I20260805 22:51:06.232790 12189 raft_consensus.cc:374] T 041916bcb2504cc284464f7c68644e5d P cfa325f3df15438685ad195a3a193802 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:51:06.232824 12189 raft_consensus.cc:729] T 041916bcb2504cc284464f7c68644e5d P cfa325f3df15438685ad195a3a193802 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfa325f3df15438685ad195a3a193802, State: Initialized, Role: FOLLOWER
I20260805 22:51:06.232946 12189 consensus_queue.cc:260] T 041916bcb2504cc284464f7c68644e5d P cfa325f3df15438685ad195a3a193802 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfa325f3df15438685ad195a3a193802" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 35969 } } peers { permanent_uuid: "ab7b5aca2c994fa8ac2046e841629a81" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46759 } } peers { permanent_uuid: "402bf8cdd4b14ead84b7ec2b3479d426" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 35751 } }
I20260805 22:51:06.232996 12190 raft_consensus.cc:348] T 041916bcb2504cc284464f7c68644e5d P ab7b5aca2c994fa8ac2046e841629a81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfa325f3df15438685ad195a3a193802" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 35969 } } peers { permanent_uuid: "ab7b5aca2c994fa8ac2046e841629a81" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46759 } } peers { permanent_uuid: "402bf8cdd4b14ead84b7ec2b3479d426" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 35751 } }
I20260805 22:51:06.233167 12190 raft_consensus.cc:374] T 041916bcb2504cc284464f7c68644e5d P ab7b5aca2c994fa8ac2046e841629a81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:51:06.233210 12190 raft_consensus.cc:729] T 041916bcb2504cc284464f7c68644e5d P ab7b5aca2c994fa8ac2046e841629a81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab7b5aca2c994fa8ac2046e841629a81, State: Initialized, Role: FOLLOWER
I20260805 22:51:06.233268 12189 ts_tablet_manager.cc:1428] T 041916bcb2504cc284464f7c68644e5d P cfa325f3df15438685ad195a3a193802: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260805 22:51:06.233309 11787 heartbeater.cc:503] Master 127.14.224.190:46757 was elected leader, sending a full tablet report...
I20260805 22:51:06.233327 12190 consensus_queue.cc:260] T 041916bcb2504cc284464f7c68644e5d P ab7b5aca2c994fa8ac2046e841629a81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfa325f3df15438685ad195a3a193802" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 35969 } } peers { permanent_uuid: "ab7b5aca2c994fa8ac2046e841629a81" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46759 } } peers { permanent_uuid: "402bf8cdd4b14ead84b7ec2b3479d426" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 35751 } }
I20260805 22:51:06.233599 12190 ts_tablet_manager.cc:1428] T 041916bcb2504cc284464f7c68644e5d P ab7b5aca2c994fa8ac2046e841629a81: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260805 22:51:06.233649 12163 heartbeater.cc:503] Master 127.14.224.190:46757 was elected leader, sending a full tablet report...
W20260805 22:51:06.280230 11972 tablet.cc:2369] T 041916bcb2504cc284464f7c68644e5d P 402bf8cdd4b14ead84b7ec2b3479d426: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260805 22:51:06.356688 11788 tablet.cc:2369] T 041916bcb2504cc284464f7c68644e5d P cfa325f3df15438685ad195a3a193802: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:51:06.399178 12195 raft_consensus.cc:482] T 041916bcb2504cc284464f7c68644e5d P 402bf8cdd4b14ead84b7ec2b3479d426 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:51:06.399351 12195 raft_consensus.cc:504] T 041916bcb2504cc284464f7c68644e5d P 402bf8cdd4b14ead84b7ec2b3479d426 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfa325f3df15438685ad195a3a193802" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 35969 } } peers { permanent_uuid: "ab7b5aca2c994fa8ac2046e841629a81" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46759 } } peers { permanent_uuid: "402bf8cdd4b14ead84b7ec2b3479d426" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 35751 } }
I20260805 22:51:06.399791 12195 leader_election.cc:288] T 041916bcb2504cc284464f7c68644e5d P 402bf8cdd4b14ead84b7ec2b3479d426 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfa325f3df15438685ad195a3a193802 (127.14.224.129:35969), ab7b5aca2c994fa8ac2046e841629a81 (127.14.224.131:46759)
I20260805 22:51:06.402501 11974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:06.400004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.129:35969 (local address 127.14.224.130:50315)
0805 22:51:06.400070 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:06.400082 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:51:06.400137 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:51:06.400273 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:51:06.400274 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:51:06.400276 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:51:06.400345 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:06.400347 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:06.400947 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:06.400948 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:06.401693 (+ 745us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:06.401695 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:06.402230 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:06.402231 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:06.402311 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:06.402315 (+ 4us) client_negotiation.cc:769] Sending connection context
0805 22:51:06.402370 (+ 55us) client_negotiation.cc:240] Negotiation successful
0805 22:51:06.402415 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260805 22:51:06.402519 12184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:06.400068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:50315 (local address 127.14.224.129:35969)
0805 22:51:06.400113 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:06.400115 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:06.400126 (+ 11us) server_negotiation.cc:407] Connection header received
0805 22:51:06.400210 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:06.400211 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:06.400220 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:06.400264 (+ 44us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:51:06.400402 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:06.400872 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:06.401782 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:06.402159 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:06.402222 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:06.402233 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:06.402401 (+ 168us) server_negotiation.cc:299] Negotiation successful
0805 22:51:06.402462 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260805 22:51:06.402655 12198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:06.400012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.131:46759 (local address 127.14.224.130:57603)
0805 22:51:06.400284 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:06.400294 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0805 22:51:06.400354 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:51:06.400461 (+ 107us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:51:06.400461 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:51:06.400463 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:51:06.400541 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:06.400543 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:06.401133 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:06.401133 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:06.401872 (+ 739us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:06.401887 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:06.402432 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:06.402433 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:06.402500 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:06.402503 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:51:06.402551 (+ 48us) client_negotiation.cc:240] Negotiation successful
0805 22:51:06.402587 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"mutex_wait_us":85,"thread_start_us":126,"threads_started":1}
I20260805 22:51:06.402667 12181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:06.400122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:57603 (local address 127.14.224.131:46759)
0805 22:51:06.400169 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:06.400171 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:06.400362 (+ 191us) server_negotiation.cc:407] Connection header received
0805 22:51:06.400402 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:06.400403 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:06.400412 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:06.400459 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:51:06.400601 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:06.401059 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:06.401976 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:06.402353 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:06.402419 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:06.402427 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:06.402567 (+ 140us) server_negotiation.cc:299] Negotiation successful
0805 22:51:06.402607 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260805 22:51:06.403043 12096 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "041916bcb2504cc284464f7c68644e5d" candidate_uuid: "402bf8cdd4b14ead84b7ec2b3479d426" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab7b5aca2c994fa8ac2046e841629a81" is_pre_election: true
I20260805 22:51:06.403033 11718 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "041916bcb2504cc284464f7c68644e5d" candidate_uuid: "402bf8cdd4b14ead84b7ec2b3479d426" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfa325f3df15438685ad195a3a193802" is_pre_election: true
I20260805 22:51:06.403191 11718 raft_consensus.cc:2454] T 041916bcb2504cc284464f7c68644e5d P cfa325f3df15438685ad195a3a193802 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 402bf8cdd4b14ead84b7ec2b3479d426 in term 0.
I20260805 22:51:06.403189 12096 raft_consensus.cc:2454] T 041916bcb2504cc284464f7c68644e5d P ab7b5aca2c994fa8ac2046e841629a81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 402bf8cdd4b14ead84b7ec2b3479d426 in term 0.
I20260805 22:51:06.403450 11822 leader_election.cc:302] T 041916bcb2504cc284464f7c68644e5d P 402bf8cdd4b14ead84b7ec2b3479d426 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 402bf8cdd4b14ead84b7ec2b3479d426, ab7b5aca2c994fa8ac2046e841629a81; no voters:
I20260805 22:51:06.403610 12195 raft_consensus.cc:2781] T 041916bcb2504cc284464f7c68644e5d P 402bf8cdd4b14ead84b7ec2b3479d426 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:51:06.403672 12195 raft_consensus.cc:482] T 041916bcb2504cc284464f7c68644e5d P 402bf8cdd4b14ead84b7ec2b3479d426 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:51:06.403688 12195 raft_consensus.cc:3037] T 041916bcb2504cc284464f7c68644e5d P 402bf8cdd4b14ead84b7ec2b3479d426 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:51:06.404412 12195 raft_consensus.cc:504] T 041916bcb2504cc284464f7c68644e5d P 402bf8cdd4b14ead84b7ec2b3479d426 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfa325f3df15438685ad195a3a193802" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 35969 } } peers { permanent_uuid: "ab7b5aca2c994fa8ac2046e841629a81" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46759 } } peers { permanent_uuid: "402bf8cdd4b14ead84b7ec2b3479d426" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 35751 } }
I20260805 22:51:06.404556 12195 leader_election.cc:288] T 041916bcb2504cc284464f7c68644e5d P 402bf8cdd4b14ead84b7ec2b3479d426 [CANDIDATE]: Term 1 election: Requested vote from peers cfa325f3df15438685ad195a3a193802 (127.14.224.129:35969), ab7b5aca2c994fa8ac2046e841629a81 (127.14.224.131:46759)
I20260805 22:51:06.404745 11718 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "041916bcb2504cc284464f7c68644e5d" candidate_uuid: "402bf8cdd4b14ead84b7ec2b3479d426" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfa325f3df15438685ad195a3a193802"
I20260805 22:51:06.404785 12096 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "041916bcb2504cc284464f7c68644e5d" candidate_uuid: "402bf8cdd4b14ead84b7ec2b3479d426" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab7b5aca2c994fa8ac2046e841629a81"
I20260805 22:51:06.404850 11718 raft_consensus.cc:3037] T 041916bcb2504cc284464f7c68644e5d P cfa325f3df15438685ad195a3a193802 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:51:06.404865 12096 raft_consensus.cc:3037] T 041916bcb2504cc284464f7c68644e5d P ab7b5aca2c994fa8ac2046e841629a81 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:51:06.405616 12096 raft_consensus.cc:2454] T 041916bcb2504cc284464f7c68644e5d P ab7b5aca2c994fa8ac2046e841629a81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 402bf8cdd4b14ead84b7ec2b3479d426 in term 1.
I20260805 22:51:06.405660 11718 raft_consensus.cc:2454] T 041916bcb2504cc284464f7c68644e5d P cfa325f3df15438685ad195a3a193802 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 402bf8cdd4b14ead84b7ec2b3479d426 in term 1.
I20260805 22:51:06.405788 11822 leader_election.cc:302] T 041916bcb2504cc284464f7c68644e5d P 402bf8cdd4b14ead84b7ec2b3479d426 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 402bf8cdd4b14ead84b7ec2b3479d426, ab7b5aca2c994fa8ac2046e841629a81; no voters:
I20260805 22:51:06.405892 12195 raft_consensus.cc:2781] T 041916bcb2504cc284464f7c68644e5d P 402bf8cdd4b14ead84b7ec2b3479d426 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:51:06.406040 12195 raft_consensus.cc:686] T 041916bcb2504cc284464f7c68644e5d P 402bf8cdd4b14ead84b7ec2b3479d426 [term 1 LEADER]: Becoming Leader. State: Replica: 402bf8cdd4b14ead84b7ec2b3479d426, State: Running, Role: LEADER
I20260805 22:51:06.406132 12195 consensus_queue.cc:237] T 041916bcb2504cc284464f7c68644e5d P 402bf8cdd4b14ead84b7ec2b3479d426 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfa325f3df15438685ad195a3a193802" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 35969 } } peers { permanent_uuid: "ab7b5aca2c994fa8ac2046e841629a81" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46759 } } peers { permanent_uuid: "402bf8cdd4b14ead84b7ec2b3479d426" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 35751 } }
I20260805 22:51:06.407071 11506 catalog_manager.cc:5495] T 041916bcb2504cc284464f7c68644e5d P 402bf8cdd4b14ead84b7ec2b3479d426 reported cstate change: term changed from 0 to 1, leader changed from <none> to 402bf8cdd4b14ead84b7ec2b3479d426 (127.14.224.130). New cstate: current_term: 1 leader_uuid: "402bf8cdd4b14ead84b7ec2b3479d426" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfa325f3df15438685ad195a3a193802" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 35969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab7b5aca2c994fa8ac2046e841629a81" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "402bf8cdd4b14ead84b7ec2b3479d426" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 35751 } health_report { overall_health: HEALTHY } } }
W20260805 22:51:06.443305 12164 tablet.cc:2369] T 041916bcb2504cc284464f7c68644e5d P ab7b5aca2c994fa8ac2046e841629a81: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:51:06.455346 12183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:06.452864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37080 (local address 127.14.224.130:35751)
0805 22:51:06.452945 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:06.452947 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:06.452954 (+ 7us) server_negotiation.cc:407] Connection header received
0805 22:51:06.452994 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:06.452994 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:06.453014 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:06.453115 (+ 101us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:51:06.453288 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:06.453770 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:06.454582 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:06.454793 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:06.454858 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:06.455008 (+ 150us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:51:06.455118 (+ 110us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:51:06.455174 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:06.455187 (+ 13us) server_negotiation.cc:299] Negotiation successful
0805 22:51:06.455207 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260805 22:51:06.457259 11718 raft_consensus.cc:1261] T 041916bcb2504cc284464f7c68644e5d P cfa325f3df15438685ad195a3a193802 [term 1 FOLLOWER]: Refusing update from remote peer 402bf8cdd4b14ead84b7ec2b3479d426: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:51:06.457259 12096 raft_consensus.cc:1261] T 041916bcb2504cc284464f7c68644e5d P ab7b5aca2c994fa8ac2046e841629a81 [term 1 FOLLOWER]: Refusing update from remote peer 402bf8cdd4b14ead84b7ec2b3479d426: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:51:06.457643 12195 consensus_queue.cc:1035] T 041916bcb2504cc284464f7c68644e5d P 402bf8cdd4b14ead84b7ec2b3479d426 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfa325f3df15438685ad195a3a193802" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 35969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:51:06.457801 12199 consensus_queue.cc:1035] T 041916bcb2504cc284464f7c68644e5d P 402bf8cdd4b14ead84b7ec2b3479d426 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab7b5aca2c994fa8ac2046e841629a81" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 46759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:51:06.460630 12204 mvcc.cc:205] Tried to move back new op lower bound from 7315334211406249984 to 7315334211200053248. Current Snapshot: MvccSnapshot[applied={T|T < 7315334211406249984}]
I20260805 22:51:06.461231 12205 mvcc.cc:205] Tried to move back new op lower bound from 7315334211406249984 to 7315334211200053248. Current Snapshot: MvccSnapshot[applied={T|T < 7315334211406249984}]
I20260805 22:51:06.462986 11509 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58378:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:51:06.463112 11509 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58378:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:51:06.463974 11509 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5de8e047befa4591b6296b819db6413a: Sending DeleteTablet for 3 replicas of tablet 041916bcb2504cc284464f7c68644e5d
I20260805 22:51:06.464335 12068 tablet_service.cc:1514] Processing DeleteTablet for tablet 041916bcb2504cc284464f7c68644e5d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:51:06 UTC) from {username='kudu', principal='kudu/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:48204
I20260805 22:51:06.464414 11877 tablet_service.cc:1514] Processing DeleteTablet for tablet 041916bcb2504cc284464f7c68644e5d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:51:06 UTC) from {username='kudu', principal='kudu/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:37070
I20260805 22:51:06.464439 11688 tablet_service.cc:1514] Processing DeleteTablet for tablet 041916bcb2504cc284464f7c68644e5d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:51:06 UTC) from {username='kudu', principal='kudu/127.14.224.190@KRBTEST.COM'} at 127.0.0.1:54582
I20260805 22:51:06.464619 12216 tablet_replica.cc:330] T 041916bcb2504cc284464f7c68644e5d P ab7b5aca2c994fa8ac2046e841629a81: stopping tablet replica
I20260805 22:51:06.464625 12217 tablet_replica.cc:330] T 041916bcb2504cc284464f7c68644e5d P 402bf8cdd4b14ead84b7ec2b3479d426: stopping tablet replica
I20260805 22:51:06.464665 12219 tablet_replica.cc:330] T 041916bcb2504cc284464f7c68644e5d P cfa325f3df15438685ad195a3a193802: stopping tablet replica
I20260805 22:51:06.464725 12217 raft_consensus.cc:2229] T 041916bcb2504cc284464f7c68644e5d P 402bf8cdd4b14ead84b7ec2b3479d426 [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:51:06.464727 12216 raft_consensus.cc:2229] T 041916bcb2504cc284464f7c68644e5d P ab7b5aca2c994fa8ac2046e841629a81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:51:06.464747 12219 raft_consensus.cc:2229] T 041916bcb2504cc284464f7c68644e5d P cfa325f3df15438685ad195a3a193802 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:51:06.464841 12216 raft_consensus.cc:2258] T 041916bcb2504cc284464f7c68644e5d P ab7b5aca2c994fa8ac2046e841629a81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:51:06.464871 12219 raft_consensus.cc:2258] T 041916bcb2504cc284464f7c68644e5d P cfa325f3df15438685ad195a3a193802 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:51:06.464921 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 11600
I20260805 22:51:06.464869 12217 raft_consensus.cc:2258] T 041916bcb2504cc284464f7c68644e5d P 402bf8cdd4b14ead84b7ec2b3479d426 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:51:06.465688 12217 ts_tablet_manager.cc:1905] T 041916bcb2504cc284464f7c68644e5d P 402bf8cdd4b14ead84b7ec2b3479d426: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:51:06.466028 12216 ts_tablet_manager.cc:1905] T 041916bcb2504cc284464f7c68644e5d P ab7b5aca2c994fa8ac2046e841629a81: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:51:06.467796 12216 ts_tablet_manager.cc:1918] T 041916bcb2504cc284464f7c68644e5d P ab7b5aca2c994fa8ac2046e841629a81: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:51:06.467830 12217 ts_tablet_manager.cc:1918] T 041916bcb2504cc284464f7c68644e5d P 402bf8cdd4b14ead84b7ec2b3479d426: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:51:06.467871 12216 log.cc:1196] T 041916bcb2504cc284464f7c68644e5d P ab7b5aca2c994fa8ac2046e841629a81: Deleting WAL directory at /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/minicluster-data/ts-2/wal/wals/041916bcb2504cc284464f7c68644e5d
I20260805 22:51:06.467912 12217 log.cc:1196] T 041916bcb2504cc284464f7c68644e5d P 402bf8cdd4b14ead84b7ec2b3479d426: Deleting WAL directory at /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970021300824-15234-0/minicluster-data/ts-1/wal/wals/041916bcb2504cc284464f7c68644e5d
I20260805 22:51:06.468132 12216 ts_tablet_manager.cc:1939] T 041916bcb2504cc284464f7c68644e5d P ab7b5aca2c994fa8ac2046e841629a81: Deleting consensus metadata
I20260805 22:51:06.468233 12217 ts_tablet_manager.cc:1939] T 041916bcb2504cc284464f7c68644e5d P 402bf8cdd4b14ead84b7ec2b3479d426: Deleting consensus metadata
I20260805 22:51:06.468567 11489 catalog_manager.cc:4841] TS ab7b5aca2c994fa8ac2046e841629a81 (127.14.224.131:46759): tablet 041916bcb2504cc284464f7c68644e5d (table test-table [id=f68cb6319bb148d68901f0df8f3ac286]) successfully deleted
I20260805 22:51:06.468724 11488 catalog_manager.cc:4841] TS 402bf8cdd4b14ead84b7ec2b3479d426 (127.14.224.130:35751): tablet 041916bcb2504cc284464f7c68644e5d (table test-table [id=f68cb6319bb148d68901f0df8f3ac286]) successfully deleted
W20260805 22:51:06.488986 11490 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.224.129:35969 (error 108)
I20260805 22:51:06.489157 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 11794
I20260805 22:51:06.498505 12177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:06.498319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.129:35969 (local address 127.0.0.1:54590)
0805 22:51:06.498380 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:06.498452 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.129:35969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260805 22:51:06.498719 11490 catalog_manager.cc:4584] TS cfa325f3df15438685ad195a3a193802 (127.14.224.129:35969): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 041916bcb2504cc284464f7c68644e5d: Network error: Client connection negotiation failed: client connection to 127.14.224.129:35969: connect: Connection refused (error 111)
I20260805 22:51:06.502483 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 11978
I20260805 22:51:06.517056 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 11465
2026-08-05T22:51:06Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2275 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-05T22:51:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:51:06Z Disabled control of system clock
I20260805 22:51:06.552487 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970021300824-15234-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970021300824-15234-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970021300824-15234-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:46165
--webserver_interface=127.14.224.190
--webserver_port=0
--builtin_ntp_servers=127.14.224.148:38667
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.224.190:46165
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260805 22:51:06.636451 12225 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:51:06.636706 12225 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:51:06.636729 12225 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:51:06.638010 12225 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:51:06.638067 12225 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:51:06.638078 12225 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:51:06.638088 12225 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:51:06.638101 12225 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:51:06.639555 12225 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:38667
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970021300824-15234-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970021300824-15234-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.224.190:46165
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:46165
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.224.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12225
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970021300824-15234-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:51:06.639793 12225 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:51:06.640152 12225 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:51:06.645185 12235 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:06.645324 12240 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:51:06.645355 12225 server_base.cc:1034] running on GCE node
W20260805 22:51:06.645191 12236 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:51:06.645707 12225 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:51:06.646005 12225 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:51:06.647115 12225 hybrid_clock.cc:648] HybridClock initialized: now 1785970266647097 us; error 37 us; skew 500 ppm
I20260805 22:51:06.648379 12225 webserver.cc:460] Webserver started at http://127.14.224.190:43035/ using document root <none> and password file <none>
I20260805 22:51:06.648644 12225 fs_manager.cc:359] Metadata directory not provided
I20260805 22:51:06.648693 12225 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:51:06.648828 12225 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:51:06.649917 12225 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970021300824-15234-0/minicluster-data/master-0/data/instance:
uuid: "c8cf66f5d13e4d189093383e397db0d8"
format_stamp: "Formatted at 2026-08-05 22:51:06 on dist-test-slave-gjrz"
server_key: "1a1321cb7ea7f7e5c5757c9232426014"
server_key_iv: "5aa60849b8b4e2f6c0a11ac7c592a68e"
server_key_version: "encryptionkey@0"
I20260805 22:51:06.650270 12225 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970021300824-15234-0/minicluster-data/master-0/wal/instance:
uuid: "c8cf66f5d13e4d189093383e397db0d8"
format_stamp: "Formatted at 2026-08-05 22:51:06 on dist-test-slave-gjrz"
server_key: "1a1321cb7ea7f7e5c5757c9232426014"
server_key_iv: "5aa60849b8b4e2f6c0a11ac7c592a68e"
server_key_version: "encryptionkey@0"
I20260805 22:51:06.651575 12225 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260805 22:51:06.652287 12248 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:06.652467 12225 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260805 22:51:06.652573 12225 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970021300824-15234-0/minicluster-data/master-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970021300824-15234-0/minicluster-data/master-0/wal
uuid: "c8cf66f5d13e4d189093383e397db0d8"
format_stamp: "Formatted at 2026-08-05 22:51:06 on dist-test-slave-gjrz"
server_key: "1a1321cb7ea7f7e5c5757c9232426014"
server_key_iv: "5aa60849b8b4e2f6c0a11ac7c592a68e"
server_key_version: "encryptionkey@0"
I20260805 22:51:06.652649 12225 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970021300824-15234-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970021300824-15234-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970021300824-15234-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:51:06.677910 12225 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:51:06.678277 12225 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:51:06.678426 12225 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:51:06.682392 12225 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.190:46165
I20260805 22:51:06.682435 12325 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.190:46165 every 8 connection(s)
I20260805 22:51:06.682793 12225 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
I20260805 22:51:06.683899 12326 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:51:06.686378 12326 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c8cf66f5d13e4d189093383e397db0d8: Bootstrap starting.
I20260805 22:51:06.686955 12326 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c8cf66f5d13e4d189093383e397db0d8: Neither blocks nor log segments found. Creating new log.
I20260805 22:51:06.687218 12326 log.cc:824] T 00000000000000000000000000000000 P c8cf66f5d13e4d189093383e397db0d8: Log is configured to *not* fsync() on all Append() calls
I20260805 22:51:06.687819 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 12225
I20260805 22:51:06.687915 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970021300824-15234-0/minicluster-data/master-0/wal/instance
I20260805 22:51:06.688050 12326 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c8cf66f5d13e4d189093383e397db0d8: No bootstrap required, opened a new log
I20260805 22:51:06.688125 15234 external_mini_cluster.cc:1428] Setting key 30390be1548dddcfef5f56b818684a3e
I20260805 22:51:06.690043 12326 raft_consensus.cc:348] T 00000000000000000000000000000000 P c8cf66f5d13e4d189093383e397db0d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8cf66f5d13e4d189093383e397db0d8" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 46165 } }
I20260805 22:51:06.690244 12326 raft_consensus.cc:374] T 00000000000000000000000000000000 P c8cf66f5d13e4d189093383e397db0d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:51:06.690282 12326 raft_consensus.cc:729] T 00000000000000000000000000000000 P c8cf66f5d13e4d189093383e397db0d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8cf66f5d13e4d189093383e397db0d8, State: Initialized, Role: FOLLOWER
I20260805 22:51:06.690450 12326 consensus_queue.cc:260] T 00000000000000000000000000000000 P c8cf66f5d13e4d189093383e397db0d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8cf66f5d13e4d189093383e397db0d8" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 46165 } }
I20260805 22:51:06.690533 12326 raft_consensus.cc:388] T 00000000000000000000000000000000 P c8cf66f5d13e4d189093383e397db0d8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:51:06.690557 12326 raft_consensus.cc:482] T 00000000000000000000000000000000 P c8cf66f5d13e4d189093383e397db0d8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:51:06.690601 12326 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c8cf66f5d13e4d189093383e397db0d8 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:51:06.691201 12326 raft_consensus.cc:504] T 00000000000000000000000000000000 P c8cf66f5d13e4d189093383e397db0d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8cf66f5d13e4d189093383e397db0d8" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 46165 } }
I20260805 22:51:06.691334 12326 leader_election.cc:302] T 00000000000000000000000000000000 P c8cf66f5d13e4d189093383e397db0d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c8cf66f5d13e4d189093383e397db0d8; no voters:
I20260805 22:51:06.691525 12326 leader_election.cc:288] T 00000000000000000000000000000000 P c8cf66f5d13e4d189093383e397db0d8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:51:06.691599 12333 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c8cf66f5d13e4d189093383e397db0d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:51:06.691790 12333 raft_consensus.cc:686] T 00000000000000000000000000000000 P c8cf66f5d13e4d189093383e397db0d8 [term 1 LEADER]: Becoming Leader. State: Replica: c8cf66f5d13e4d189093383e397db0d8, State: Running, Role: LEADER
I20260805 22:51:06.691795 12326 sys_catalog.cc:564] T 00000000000000000000000000000000 P c8cf66f5d13e4d189093383e397db0d8 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:51:06.691895 12333 consensus_queue.cc:237] T 00000000000000000000000000000000 P c8cf66f5d13e4d189093383e397db0d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8cf66f5d13e4d189093383e397db0d8" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 46165 } }
I20260805 22:51:06.692225 12333 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8cf66f5d13e4d189093383e397db0d8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c8cf66f5d13e4d189093383e397db0d8. Latest consensus state: current_term: 1 leader_uuid: "c8cf66f5d13e4d189093383e397db0d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8cf66f5d13e4d189093383e397db0d8" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 46165 } } }
I20260805 22:51:06.692291 12333 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8cf66f5d13e4d189093383e397db0d8 [sys.catalog]: This master's current role is: LEADER
I20260805 22:51:06.692495 12337 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8cf66f5d13e4d189093383e397db0d8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c8cf66f5d13e4d189093383e397db0d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8cf66f5d13e4d189093383e397db0d8" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 46165 } } }
I20260805 22:51:06.692637 12337 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8cf66f5d13e4d189093383e397db0d8 [sys.catalog]: This master's current role is: LEADER
I20260805 22:51:06.692620 12345 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:51:06.693218 12345 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:51:06.695227 12345 catalog_manager.cc:1347] Generated new cluster ID: 89b53f891ba7412fbfcd0d0b6ed5dc1e
I20260805 22:51:06.695310 12345 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:51:06.695792 12332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:06.688675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39968 (local address 127.14.224.190:46165)
0805 22:51:06.688925 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:06.688934 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:06.688973 (+ 39us) server_negotiation.cc:407] Connection header received
0805 22:51:06.689993 (+ 1020us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:06.690003 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:06.690092 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:06.690266 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:06.690507 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:06.692481 (+ 1974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:06.693646 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:06.694196 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:06.694318 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:06.695058 (+ 740us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:06.695062 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:06.695062 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:51:06.695300 (+ 238us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:06.695346 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:51:06.695362 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:06.695427 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:06.695535 (+ 108us) server_negotiation.cc:299] Negotiation successful
0805 22:51:06.695626 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":98,"threads_started":1}
I20260805 22:51:06.723354 12345 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:51:06.724128 12345 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:51:06.730420 12345 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c8cf66f5d13e4d189093383e397db0d8: Generated new TSK 0
I20260805 22:51:06.730677 12345 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:51:06.742149 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970021300824-15234-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970021300824-15234-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970021300824-15234-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.129:0
--local_ip_for_outbound_sockets=127.14.224.129
--webserver_interface=127.14.224.129
--webserver_port=0
--tserver_master_addrs=127.14.224.190:46165
--builtin_ntp_servers=127.14.224.148:38667
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260805 22:51:06.828663 12362 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:51:06.828893 12362 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:51:06.828926 12362 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:51:06.830165 12362 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:51:06.830211 12362 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:51:06.830247 12362 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.129
I20260805 22:51:06.831717 12362 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:38667
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970021300824-15234-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970021300824-15234-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.224.129
--webserver_port=0
--tserver_master_addrs=127.14.224.190:46165
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12362
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.129
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970021300824-15234-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:51:06.831990 12362 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:51:06.832310 12362 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:51:06.837430 12369 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:06.837504 12370 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:06.837440 12372 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:51:06.837733 12362 server_base.cc:1034] running on GCE node
I20260805 22:51:06.837927 12362 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:51:06.838155 12362 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:51:06.839320 12362 hybrid_clock.cc:648] HybridClock initialized: now 1785970266839302 us; error 29 us; skew 500 ppm
I20260805 22:51:06.840796 12362 webserver.cc:460] Webserver started at http://127.14.224.129:41611/ using document root <none> and password file <none>
I20260805 22:51:06.841037 12362 fs_manager.cc:359] Metadata directory not provided
I20260805 22:51:06.841084 12362 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:51:06.841245 12362 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:51:06.842465 12362 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970021300824-15234-0/minicluster-data/ts-0/data/instance:
uuid: "23edcc4a912643548d00bc3d5d35fe78"
format_stamp: "Formatted at 2026-08-05 22:51:06 on dist-test-slave-gjrz"
server_key: "11947bb58a54ac8e9fa2affaa3f2c57e"
server_key_iv: "925ce655cc65e1b49bfca6b392877491"
server_key_version: "encryptionkey@0"
I20260805 22:51:06.842896 12362 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970021300824-15234-0/minicluster-data/ts-0/wal/instance:
uuid: "23edcc4a912643548d00bc3d5d35fe78"
format_stamp: "Formatted at 2026-08-05 22:51:06 on dist-test-slave-gjrz"
server_key: "11947bb58a54ac8e9fa2affaa3f2c57e"
server_key_iv: "925ce655cc65e1b49bfca6b392877491"
server_key_version: "encryptionkey@0"
I20260805 22:51:06.844275 12362 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260805 22:51:06.845065 12383 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:06.845268 12362 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:51:06.845376 12362 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970021300824-15234-0/minicluster-data/ts-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970021300824-15234-0/minicluster-data/ts-0/wal
uuid: "23edcc4a912643548d00bc3d5d35fe78"
format_stamp: "Formatted at 2026-08-05 22:51:06 on dist-test-slave-gjrz"
server_key: "11947bb58a54ac8e9fa2affaa3f2c57e"
server_key_iv: "925ce655cc65e1b49bfca6b392877491"
server_key_version: "encryptionkey@0"
I20260805 22:51:06.845448 12362 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970021300824-15234-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970021300824-15234-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970021300824-15234-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:51:06.858558 12362 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:51:06.858899 12362 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:51:06.859055 12362 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:51:06.859346 12362 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:51:06.859697 12362 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:51:06.859732 12362 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:06.859761 12362 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:51:06.859786 12362 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:06.865733 12362 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.129:41939
I20260805 22:51:06.865777 12552 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.129:41939 every 8 connection(s)
I20260805 22:51:06.866132 12362 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970021300824-15234-0/minicluster-data/ts-0/data/info.pb
I20260805 22:51:06.868498 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 12362
I20260805 22:51:06.868614 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970021300824-15234-0/minicluster-data/ts-0/wal/instance
I20260805 22:51:06.868788 15234 external_mini_cluster.cc:1428] Setting key 3bbe519fa07e86a4b58885d089d8ef54
I20260805 22:51:06.869710 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970021300824-15234-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970021300824-15234-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970021300824-15234-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.130:0
--local_ip_for_outbound_sockets=127.14.224.130
--webserver_interface=127.14.224.130
--webserver_port=0
--tserver_master_addrs=127.14.224.190:46165
--builtin_ntp_servers=127.14.224.148:38667
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260805 22:51:06.872067 12332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:06.866947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.129:48491 (local address 127.14.224.190:46165)
0805 22:51:06.867017 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:06.867019 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:06.867315 (+ 296us) server_negotiation.cc:407] Connection header received
0805 22:51:06.867842 (+ 527us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:06.867844 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:06.867858 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:06.867923 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:06.868659 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:06.869274 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:06.870456 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:06.870718 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:06.870795 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:06.871771 (+ 976us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:06.871773 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:06.871773 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:51:06.871779 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:06.871798 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:51:06.871803 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:06.871850 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:06.871941 (+ 91us) server_negotiation.cc:299] Negotiation successful
0805 22:51:06.871980 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260805 22:51:06.872301 12555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:06.866906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:46165 (local address 127.14.224.129:48491)
0805 22:51:06.867125 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:06.867169 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0805 22:51:06.867728 (+ 559us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:51:06.867997 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:51:06.868000 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:51:06.868009 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:51:06.868554 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:06.868559 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:06.869388 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:06.869390 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:06.870348 (+ 958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:06.870351 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:06.870834 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:06.870836 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:06.870976 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:06.871613 (+ 637us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 22:51:06.871614 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:51:06.871648 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 22:51:06.871675 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:51:06.871858 (+ 183us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:51:06.871865 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:51:06.871869 (+ 4us) client_negotiation.cc:769] Sending connection context
0805 22:51:06.871936 (+ 67us) client_negotiation.cc:240] Negotiation successful
0805 22:51:06.872066 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":99,"threads_started":1}
I20260805 22:51:06.872845 12553 heartbeater.cc:347] Connected to a master server at 127.14.224.190:46165
I20260805 22:51:06.872959 12553 heartbeater.cc:464] Registering TS with master...
I20260805 22:51:06.873178 12553 heartbeater.cc:511] Master 127.14.224.190:46165 requested a full tablet report, sending...
I20260805 22:51:06.873737 12273 ts_manager.cc:194] Registered new tserver with Master: 23edcc4a912643548d00bc3d5d35fe78 (127.14.224.129:41939)
I20260805 22:51:06.874402 12273 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.224.129:48491
W20260805 22:51:06.955083 12556 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:51:06.955360 12556 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:51:06.955394 12556 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:51:06.956732 12556 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:51:06.956790 12556 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:51:06.956828 12556 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.130
I20260805 22:51:06.958302 12556 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:38667
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970021300824-15234-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970021300824-15234-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.224.130
--webserver_port=0
--tserver_master_addrs=127.14.224.190:46165
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12556
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.130
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970021300824-15234-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:51:06.958583 12556 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:51:06.958909 12556 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:51:06.963999 12565 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:06.964075 12563 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:06.963980 12562 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:51:06.964238 12556 server_base.cc:1034] running on GCE node
I20260805 22:51:06.964461 12556 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:51:06.964706 12556 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:51:06.965878 12556 hybrid_clock.cc:648] HybridClock initialized: now 1785970266965860 us; error 33 us; skew 500 ppm
I20260805 22:51:06.967255 12556 webserver.cc:460] Webserver started at http://127.14.224.130:37333/ using document root <none> and password file <none>
I20260805 22:51:06.967545 12556 fs_manager.cc:359] Metadata directory not provided
I20260805 22:51:06.967610 12556 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:51:06.967752 12556 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:51:06.968875 12556 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970021300824-15234-0/minicluster-data/ts-1/data/instance:
uuid: "349ad69718184473a58bf84e0ff3d26e"
format_stamp: "Formatted at 2026-08-05 22:51:06 on dist-test-slave-gjrz"
server_key: "0f6db7f7b4aed46038fe6c1e26125978"
server_key_iv: "d8688c6987f00b143106cbede3ec03ef"
server_key_version: "encryptionkey@0"
I20260805 22:51:06.969229 12556 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970021300824-15234-0/minicluster-data/ts-1/wal/instance:
uuid: "349ad69718184473a58bf84e0ff3d26e"
format_stamp: "Formatted at 2026-08-05 22:51:06 on dist-test-slave-gjrz"
server_key: "0f6db7f7b4aed46038fe6c1e26125978"
server_key_iv: "d8688c6987f00b143106cbede3ec03ef"
server_key_version: "encryptionkey@0"
I20260805 22:51:06.970618 12556 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260805 22:51:06.971431 12573 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:06.971603 12556 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:51:06.971686 12556 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970021300824-15234-0/minicluster-data/ts-1/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970021300824-15234-0/minicluster-data/ts-1/wal
uuid: "349ad69718184473a58bf84e0ff3d26e"
format_stamp: "Formatted at 2026-08-05 22:51:06 on dist-test-slave-gjrz"
server_key: "0f6db7f7b4aed46038fe6c1e26125978"
server_key_iv: "d8688c6987f00b143106cbede3ec03ef"
server_key_version: "encryptionkey@0"
I20260805 22:51:06.971762 12556 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970021300824-15234-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970021300824-15234-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970021300824-15234-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:51:06.984994 12556 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:51:06.985332 12556 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:51:06.985466 12556 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:51:06.985702 12556 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:51:06.986043 12556 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:51:06.986078 12556 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:06.986104 12556 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:51:06.986127 12556 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:06.991735 12556 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.130:35727
I20260805 22:51:06.991804 12735 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.130:35727 every 8 connection(s)
I20260805 22:51:06.992156 12556 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970021300824-15234-0/minicluster-data/ts-1/data/info.pb
I20260805 22:51:06.996389 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 12556
I20260805 22:51:06.996526 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970021300824-15234-0/minicluster-data/ts-1/wal/instance
I20260805 22:51:06.996731 15234 external_mini_cluster.cc:1428] Setting key 25479ddd9e84fe4a12d446340c387352
I20260805 22:51:06.997520 12332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:06.992915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.130:38747 (local address 127.14.224.190:46165)
0805 22:51:06.992977 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:06.992979 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:06.993247 (+ 268us) server_negotiation.cc:407] Connection header received
0805 22:51:06.993758 (+ 511us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:06.993760 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:06.993774 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:06.993827 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:06.994514 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:06.995020 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:06.996032 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:06.996242 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:06.996298 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:06.997240 (+ 942us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:06.997241 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:06.997242 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:51:06.997247 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:06.997266 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:51:06.997271 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:06.997318 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:06.997401 (+ 83us) server_negotiation.cc:299] Negotiation successful
0805 22:51:06.997431 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260805 22:51:06.997759 12738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:06.992891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:46165 (local address 127.14.224.130:38747)
0805 22:51:06.993102 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:06.993137 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0805 22:51:06.993649 (+ 512us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:51:06.993899 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:51:06.993902 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:51:06.993911 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:51:06.994416 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:06.994420 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:06.995111 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:06.995113 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:06.995942 (+ 829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:06.995944 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:06.996314 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:06.996315 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:06.996448 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:06.997090 (+ 642us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 22:51:06.997090 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:51:06.997124 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 22:51:06.997151 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:51:06.997327 (+ 176us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:51:06.997332 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:51:06.997335 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:51:06.997411 (+ 76us) client_negotiation.cc:240] Negotiation successful
0805 22:51:06.997524 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":100,"threads_started":1}
I20260805 22:51:06.997784 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970021300824-15234-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970021300824-15234-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970021300824-15234-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.224.131:0
--local_ip_for_outbound_sockets=127.14.224.131
--webserver_interface=127.14.224.131
--webserver_port=0
--tserver_master_addrs=127.14.224.190:46165
--builtin_ntp_servers=127.14.224.148:38667
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260805 22:51:06.998306 12736 heartbeater.cc:347] Connected to a master server at 127.14.224.190:46165
I20260805 22:51:06.998401 12736 heartbeater.cc:464] Registering TS with master...
I20260805 22:51:06.998591 12736 heartbeater.cc:511] Master 127.14.224.190:46165 requested a full tablet report, sending...
I20260805 22:51:06.998971 12273 ts_manager.cc:194] Registered new tserver with Master: 349ad69718184473a58bf84e0ff3d26e (127.14.224.130:35727)
I20260805 22:51:06.999399 12273 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.224.130:38747
W20260805 22:51:07.085812 12739 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:51:07.086041 12739 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:51:07.086063 12739 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:51:07.087348 12739 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:51:07.087401 12739 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:51:07.087440 12739 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.224.131
I20260805 22:51:07.089068 12739 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:38667
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970021300824-15234-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970021300824-15234-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.224.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.224.131
--webserver_port=0
--tserver_master_addrs=127.14.224.190:46165
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12739
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.224.131
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970021300824-15234-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:51:07.089352 12739 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:51:07.089663 12739 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:51:07.094920 12747 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:07.095136 12749 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:51:07.095155 12739 server_base.cc:1034] running on GCE node
W20260805 22:51:07.095170 12744 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:51:07.095594 12739 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:51:07.095862 12739 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:51:07.097024 12739 hybrid_clock.cc:648] HybridClock initialized: now 1785970267096995 us; error 50 us; skew 500 ppm
I20260805 22:51:07.098430 12739 webserver.cc:460] Webserver started at http://127.14.224.131:42041/ using document root <none> and password file <none>
I20260805 22:51:07.098698 12739 fs_manager.cc:359] Metadata directory not provided
I20260805 22:51:07.098752 12739 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:51:07.098886 12739 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:51:07.100047 12739 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970021300824-15234-0/minicluster-data/ts-2/data/instance:
uuid: "dbe0a353326f469ca8cc0669c69c6091"
format_stamp: "Formatted at 2026-08-05 22:51:07 on dist-test-slave-gjrz"
server_key: "11754361bd74d2546d711c8d20ae7b7e"
server_key_iv: "ff31f2611c42d0861b4beedbd14fc550"
server_key_version: "encryptionkey@0"
I20260805 22:51:07.100399 12739 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970021300824-15234-0/minicluster-data/ts-2/wal/instance:
uuid: "dbe0a353326f469ca8cc0669c69c6091"
format_stamp: "Formatted at 2026-08-05 22:51:07 on dist-test-slave-gjrz"
server_key: "11754361bd74d2546d711c8d20ae7b7e"
server_key_iv: "ff31f2611c42d0861b4beedbd14fc550"
server_key_version: "encryptionkey@0"
I20260805 22:51:07.101678 12739 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260805 22:51:07.102456 12756 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:07.102649 12739 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:51:07.102741 12739 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970021300824-15234-0/minicluster-data/ts-2/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970021300824-15234-0/minicluster-data/ts-2/wal
uuid: "dbe0a353326f469ca8cc0669c69c6091"
format_stamp: "Formatted at 2026-08-05 22:51:07 on dist-test-slave-gjrz"
server_key: "11754361bd74d2546d711c8d20ae7b7e"
server_key_iv: "ff31f2611c42d0861b4beedbd14fc550"
server_key_version: "encryptionkey@0"
I20260805 22:51:07.102809 12739 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970021300824-15234-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970021300824-15234-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970021300824-15234-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:51:07.116853 12739 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:51:07.117198 12739 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:51:07.117332 12739 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:51:07.117566 12739 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:51:07.117928 12739 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:51:07.117974 12739 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:07.118005 12739 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:51:07.118023 12739 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:07.123955 12739 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.131:40193
I20260805 22:51:07.124020 12916 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.131:40193 every 8 connection(s)
I20260805 22:51:07.124436 12739 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970021300824-15234-0/minicluster-data/ts-2/data/info.pb
I20260805 22:51:07.129774 12332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:07.125208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.131:52681 (local address 127.14.224.190:46165)
0805 22:51:07.125263 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:07.125265 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:07.125475 (+ 210us) server_negotiation.cc:407] Connection header received
0805 22:51:07.126027 (+ 552us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:07.126029 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:07.126043 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:07.126097 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:07.126808 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:07.127347 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:07.128347 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:07.128559 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:07.128621 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:07.129486 (+ 865us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:07.129487 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:07.129488 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:51:07.129495 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:07.129514 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:51:07.129518 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:07.129562 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:07.129644 (+ 82us) server_negotiation.cc:299] Negotiation successful
0805 22:51:07.129683 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260805 22:51:07.129997 12919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:07.125174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:46165 (local address 127.14.224.131:52681)
0805 22:51:07.125349 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:07.125385 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0805 22:51:07.125898 (+ 513us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:51:07.126174 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:51:07.126178 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:51:07.126189 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:51:07.126709 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:07.126715 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:07.127442 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:07.127443 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:07.128252 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:07.128256 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:07.128643 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:07.128643 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:07.128776 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:07.129326 (+ 550us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 22:51:07.129327 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:51:07.129359 (+ 32us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 22:51:07.129386 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:51:07.129573 (+ 187us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:51:07.129578 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:51:07.129582 (+ 4us) client_negotiation.cc:769] Sending connection context
0805 22:51:07.129643 (+ 61us) client_negotiation.cc:240] Negotiation successful
0805 22:51:07.129761 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":68,"threads_started":1}
I20260805 22:51:07.130503 12917 heartbeater.cc:347] Connected to a master server at 127.14.224.190:46165
I20260805 22:51:07.130594 12917 heartbeater.cc:464] Registering TS with master...
I20260805 22:51:07.130756 12917 heartbeater.cc:511] Master 127.14.224.190:46165 requested a full tablet report, sending...
I20260805 22:51:07.131108 12273 ts_manager.cc:194] Registered new tserver with Master: dbe0a353326f469ca8cc0669c69c6091 (127.14.224.131:40193)
I20260805 22:51:07.131521 12273 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.224.131:52681
I20260805 22:51:07.133770 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 12739
I20260805 22:51:07.133884 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970021300824-15234-0/minicluster-data/ts-2/wal/instance
I20260805 22:51:07.134094 15234 external_mini_cluster.cc:1428] Setting key 3b5f694b975ef87e475b36a70a845154
I20260805 22:51:07.135056 15234 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 22:51:07.139307 12332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:07.136481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39978 (local address 127.14.224.190:46165)
0805 22:51:07.136545 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:07.136547 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:07.136632 (+ 85us) server_negotiation.cc:407] Connection header received
0805 22:51:07.136702 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:07.136703 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:07.136717 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:07.136763 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:07.136916 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:07.137403 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:07.138146 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:07.138332 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:07.138388 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:07.139024 (+ 636us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:07.139026 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:07.139026 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:51:07.139031 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:07.139049 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:51:07.139053 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:07.139095 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:07.139152 (+ 57us) server_negotiation.cc:299] Negotiation successful
0805 22:51:07.139182 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260805 22:51:07.140758 12273 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39978:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:51:07.142390 12273 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:51:07.148772 12927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:07.144502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.131:40193 (local address 127.0.0.1:36210)
0805 22:51:07.144718 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:07.144761 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0805 22:51:07.144828 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:51:07.145368 (+ 540us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:51:07.145369 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:51:07.145371 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:51:07.145406 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:07.145408 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:07.146317 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:07.146318 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:07.147560 (+ 1242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:07.147563 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:07.148396 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:07.148397 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:07.148496 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:07.148513 (+ 17us) client_negotiation.cc:769] Sending connection context
0805 22:51:07.148601 (+ 88us) client_negotiation.cc:240] Negotiation successful
0805 22:51:07.148686 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"mutex_wait_us":17,"thread_start_us":148,"threads_started":1}
I20260805 22:51:07.148782 12932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:07.144768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54656 (local address 127.14.224.130:35727)
0805 22:51:07.144978 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:07.144983 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:07.144996 (+ 13us) server_negotiation.cc:407] Connection header received
0805 22:51:07.145042 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:07.145044 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:07.145060 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:07.145144 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:51:07.145296 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:07.146112 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:07.147453 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:07.148254 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:07.148307 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:07.148431 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:07.148645 (+ 214us) server_negotiation.cc:299] Negotiation successful
0805 22:51:07.148695 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":171,"thread_start_us":92,"threads_started":1}
I20260805 22:51:07.148912 12935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:07.144962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36210 (local address 127.14.224.131:40193)
0805 22:51:07.145134 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:07.145152 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:07.145162 (+ 10us) server_negotiation.cc:407] Connection header received
0805 22:51:07.145197 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:07.145199 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:07.145213 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:07.145370 (+ 157us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:51:07.145525 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:07.146227 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:07.147632 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:07.148291 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:07.148679 (+ 388us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:07.148768 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:07.148794 (+ 26us) server_negotiation.cc:299] Negotiation successful
0805 22:51:07.148833 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":93,"threads_started":1}
I20260805 22:51:07.149070 12931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:07.144506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.130:35727 (local address 127.0.0.1:54656)
0805 22:51:07.144718 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:07.144761 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0805 22:51:07.144828 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:51:07.145171 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:51:07.145174 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:51:07.145176 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:51:07.145247 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:07.145249 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:07.146195 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:07.146197 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:07.147158 (+ 961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:07.147161 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:07.148488 (+ 1327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:07.148489 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:07.148537 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:07.148559 (+ 22us) client_negotiation.cc:769] Sending connection context
0805 22:51:07.148622 (+ 63us) client_negotiation.cc:240] Negotiation successful
0805 22:51:07.149008 (+ 386us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":66,"threads_started":1}
I20260805 22:51:07.149618 12829 tablet_service.cc:1467] Processing CreateTablet for tablet 12bc928b97e147629e4a45c4bacaf0b9 (DEFAULT_TABLE table=test-table [id=80e017eb10ce40dc929c47a23114836a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:51:07.149780 12642 tablet_service.cc:1467] Processing CreateTablet for tablet 12bc928b97e147629e4a45c4bacaf0b9 (DEFAULT_TABLE table=test-table [id=80e017eb10ce40dc929c47a23114836a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:51:07.149991 12926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:07.144506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.129:41939 (local address 127.0.0.1:45118)
0805 22:51:07.145144 (+ 638us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:07.145155 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:51:07.145202 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:51:07.146421 (+ 1219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:51:07.146422 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:51:07.146425 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:51:07.146503 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:07.146505 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:07.147728 (+ 1223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:07.147729 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:07.148484 (+ 755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:07.148486 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:07.149755 (+ 1269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:07.149756 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:07.149820 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:07.149824 (+ 4us) client_negotiation.cc:769] Sending connection context
0805 22:51:07.149882 (+ 58us) client_negotiation.cc:240] Negotiation successful
0805 22:51:07.149924 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":623,"mutex_wait_us":24,"thread_start_us":130,"threads_started":1}
I20260805 22:51:07.150029 12933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:07.144772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45118 (local address 127.14.224.129:41939)
0805 22:51:07.146253 (+ 1481us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:07.146257 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:07.146265 (+ 8us) server_negotiation.cc:407] Connection header received
0805 22:51:07.146305 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:07.146307 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:07.146322 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:07.146415 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:51:07.146564 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:07.147655 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:07.148558 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:07.149564 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:07.149636 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:07.149717 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:07.149903 (+ 186us) server_negotiation.cc:299] Negotiation successful
0805 22:51:07.149948 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1442,"thread_start_us":90,"threads_started":1}
I20260805 22:51:07.150036 12829 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 12bc928b97e147629e4a45c4bacaf0b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:51:07.150173 12642 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 12bc928b97e147629e4a45c4bacaf0b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:51:07.150693 12456 tablet_service.cc:1467] Processing CreateTablet for tablet 12bc928b97e147629e4a45c4bacaf0b9 (DEFAULT_TABLE table=test-table [id=80e017eb10ce40dc929c47a23114836a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:51:07.151006 12456 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 12bc928b97e147629e4a45c4bacaf0b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:51:07.152850 12936 tablet_bootstrap.cc:492] T 12bc928b97e147629e4a45c4bacaf0b9 P 349ad69718184473a58bf84e0ff3d26e: Bootstrap starting.
I20260805 22:51:07.153523 12936 tablet_bootstrap.cc:654] T 12bc928b97e147629e4a45c4bacaf0b9 P 349ad69718184473a58bf84e0ff3d26e: Neither blocks nor log segments found. Creating new log.
I20260805 22:51:07.153570 12937 tablet_bootstrap.cc:492] T 12bc928b97e147629e4a45c4bacaf0b9 P dbe0a353326f469ca8cc0669c69c6091: Bootstrap starting.
I20260805 22:51:07.153858 12936 log.cc:824] T 12bc928b97e147629e4a45c4bacaf0b9 P 349ad69718184473a58bf84e0ff3d26e: Log is configured to *not* fsync() on all Append() calls
I20260805 22:51:07.154213 12937 tablet_bootstrap.cc:654] T 12bc928b97e147629e4a45c4bacaf0b9 P dbe0a353326f469ca8cc0669c69c6091: Neither blocks nor log segments found. Creating new log.
I20260805 22:51:07.154534 12937 log.cc:824] T 12bc928b97e147629e4a45c4bacaf0b9 P dbe0a353326f469ca8cc0669c69c6091: Log is configured to *not* fsync() on all Append() calls
I20260805 22:51:07.154551 12941 tablet_bootstrap.cc:492] T 12bc928b97e147629e4a45c4bacaf0b9 P 23edcc4a912643548d00bc3d5d35fe78: Bootstrap starting.
I20260805 22:51:07.154700 12936 tablet_bootstrap.cc:492] T 12bc928b97e147629e4a45c4bacaf0b9 P 349ad69718184473a58bf84e0ff3d26e: No bootstrap required, opened a new log
I20260805 22:51:07.154817 12936 ts_tablet_manager.cc:1397] T 12bc928b97e147629e4a45c4bacaf0b9 P 349ad69718184473a58bf84e0ff3d26e: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260805 22:51:07.155157 12941 tablet_bootstrap.cc:654] T 12bc928b97e147629e4a45c4bacaf0b9 P 23edcc4a912643548d00bc3d5d35fe78: Neither blocks nor log segments found. Creating new log.
I20260805 22:51:07.155426 12937 tablet_bootstrap.cc:492] T 12bc928b97e147629e4a45c4bacaf0b9 P dbe0a353326f469ca8cc0669c69c6091: No bootstrap required, opened a new log
I20260805 22:51:07.155498 12937 ts_tablet_manager.cc:1397] T 12bc928b97e147629e4a45c4bacaf0b9 P dbe0a353326f469ca8cc0669c69c6091: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260805 22:51:07.155512 12941 log.cc:824] T 12bc928b97e147629e4a45c4bacaf0b9 P 23edcc4a912643548d00bc3d5d35fe78: Log is configured to *not* fsync() on all Append() calls
I20260805 22:51:07.156311 12941 tablet_bootstrap.cc:492] T 12bc928b97e147629e4a45c4bacaf0b9 P 23edcc4a912643548d00bc3d5d35fe78: No bootstrap required, opened a new log
I20260805 22:51:07.156400 12941 ts_tablet_manager.cc:1397] T 12bc928b97e147629e4a45c4bacaf0b9 P 23edcc4a912643548d00bc3d5d35fe78: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260805 22:51:07.157034 12936 raft_consensus.cc:348] T 12bc928b97e147629e4a45c4bacaf0b9 P 349ad69718184473a58bf84e0ff3d26e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "349ad69718184473a58bf84e0ff3d26e" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 35727 } } peers { permanent_uuid: "dbe0a353326f469ca8cc0669c69c6091" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 40193 } } peers { permanent_uuid: "23edcc4a912643548d00bc3d5d35fe78" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 41939 } }
I20260805 22:51:07.157176 12936 raft_consensus.cc:374] T 12bc928b97e147629e4a45c4bacaf0b9 P 349ad69718184473a58bf84e0ff3d26e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:51:07.157207 12936 raft_consensus.cc:729] T 12bc928b97e147629e4a45c4bacaf0b9 P 349ad69718184473a58bf84e0ff3d26e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 349ad69718184473a58bf84e0ff3d26e, State: Initialized, Role: FOLLOWER
I20260805 22:51:07.157337 12936 consensus_queue.cc:260] T 12bc928b97e147629e4a45c4bacaf0b9 P 349ad69718184473a58bf84e0ff3d26e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "349ad69718184473a58bf84e0ff3d26e" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 35727 } } peers { permanent_uuid: "dbe0a353326f469ca8cc0669c69c6091" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 40193 } } peers { permanent_uuid: "23edcc4a912643548d00bc3d5d35fe78" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 41939 } }
I20260805 22:51:07.157586 12936 ts_tablet_manager.cc:1428] T 12bc928b97e147629e4a45c4bacaf0b9 P 349ad69718184473a58bf84e0ff3d26e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260805 22:51:07.157699 12736 heartbeater.cc:503] Master 127.14.224.190:46165 was elected leader, sending a full tablet report...
I20260805 22:51:07.157980 12937 raft_consensus.cc:348] T 12bc928b97e147629e4a45c4bacaf0b9 P dbe0a353326f469ca8cc0669c69c6091 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "349ad69718184473a58bf84e0ff3d26e" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 35727 } } peers { permanent_uuid: "dbe0a353326f469ca8cc0669c69c6091" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 40193 } } peers { permanent_uuid: "23edcc4a912643548d00bc3d5d35fe78" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 41939 } }
I20260805 22:51:07.158540 12937 raft_consensus.cc:374] T 12bc928b97e147629e4a45c4bacaf0b9 P dbe0a353326f469ca8cc0669c69c6091 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:51:07.158589 12937 raft_consensus.cc:729] T 12bc928b97e147629e4a45c4bacaf0b9 P dbe0a353326f469ca8cc0669c69c6091 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbe0a353326f469ca8cc0669c69c6091, State: Initialized, Role: FOLLOWER
I20260805 22:51:07.158699 12937 consensus_queue.cc:260] T 12bc928b97e147629e4a45c4bacaf0b9 P dbe0a353326f469ca8cc0669c69c6091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "349ad69718184473a58bf84e0ff3d26e" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 35727 } } peers { permanent_uuid: "dbe0a353326f469ca8cc0669c69c6091" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 40193 } } peers { permanent_uuid: "23edcc4a912643548d00bc3d5d35fe78" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 41939 } }
I20260805 22:51:07.158780 12941 raft_consensus.cc:348] T 12bc928b97e147629e4a45c4bacaf0b9 P 23edcc4a912643548d00bc3d5d35fe78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "349ad69718184473a58bf84e0ff3d26e" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 35727 } } peers { permanent_uuid: "dbe0a353326f469ca8cc0669c69c6091" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 40193 } } peers { permanent_uuid: "23edcc4a912643548d00bc3d5d35fe78" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 41939 } }
I20260805 22:51:07.158932 12941 raft_consensus.cc:374] T 12bc928b97e147629e4a45c4bacaf0b9 P 23edcc4a912643548d00bc3d5d35fe78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:51:07.158970 12937 ts_tablet_manager.cc:1428] T 12bc928b97e147629e4a45c4bacaf0b9 P dbe0a353326f469ca8cc0669c69c6091: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260805 22:51:07.158973 12941 raft_consensus.cc:729] T 12bc928b97e147629e4a45c4bacaf0b9 P 23edcc4a912643548d00bc3d5d35fe78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23edcc4a912643548d00bc3d5d35fe78, State: Initialized, Role: FOLLOWER
I20260805 22:51:07.158996 12917 heartbeater.cc:503] Master 127.14.224.190:46165 was elected leader, sending a full tablet report...
I20260805 22:51:07.159099 12941 consensus_queue.cc:260] T 12bc928b97e147629e4a45c4bacaf0b9 P 23edcc4a912643548d00bc3d5d35fe78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "349ad69718184473a58bf84e0ff3d26e" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 35727 } } peers { permanent_uuid: "dbe0a353326f469ca8cc0669c69c6091" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 40193 } } peers { permanent_uuid: "23edcc4a912643548d00bc3d5d35fe78" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 41939 } }
I20260805 22:51:07.159370 12941 ts_tablet_manager.cc:1428] T 12bc928b97e147629e4a45c4bacaf0b9 P 23edcc4a912643548d00bc3d5d35fe78: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260805 22:51:07.159512 12553 heartbeater.cc:503] Master 127.14.224.190:46165 was elected leader, sending a full tablet report...
W20260805 22:51:07.242743 12737 tablet.cc:2369] T 12bc928b97e147629e4a45c4bacaf0b9 P 349ad69718184473a58bf84e0ff3d26e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260805 22:51:07.366869 12554 tablet.cc:2369] T 12bc928b97e147629e4a45c4bacaf0b9 P 23edcc4a912643548d00bc3d5d35fe78: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260805 22:51:07.375036 12918 tablet.cc:2369] T 12bc928b97e147629e4a45c4bacaf0b9 P dbe0a353326f469ca8cc0669c69c6091: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:51:07.517287 12946 raft_consensus.cc:482] T 12bc928b97e147629e4a45c4bacaf0b9 P 23edcc4a912643548d00bc3d5d35fe78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:51:07.517470 12946 raft_consensus.cc:504] T 12bc928b97e147629e4a45c4bacaf0b9 P 23edcc4a912643548d00bc3d5d35fe78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "349ad69718184473a58bf84e0ff3d26e" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 35727 } } peers { permanent_uuid: "dbe0a353326f469ca8cc0669c69c6091" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 40193 } } peers { permanent_uuid: "23edcc4a912643548d00bc3d5d35fe78" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 41939 } }
I20260805 22:51:07.517840 12946 leader_election.cc:288] T 12bc928b97e147629e4a45c4bacaf0b9 P 23edcc4a912643548d00bc3d5d35fe78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 349ad69718184473a58bf84e0ff3d26e (127.14.224.130:35727), dbe0a353326f469ca8cc0669c69c6091 (127.14.224.131:40193)
I20260805 22:51:07.521922 12935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:07.518100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.129:60033 (local address 127.14.224.131:40193)
0805 22:51:07.518160 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:07.518162 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:07.518235 (+ 73us) server_negotiation.cc:407] Connection header received
0805 22:51:07.518292 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:07.518293 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:07.518304 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:07.518368 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:51:07.518613 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:07.519398 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:07.520938 (+ 1540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:07.521508 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:07.521587 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:07.521596 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:07.521790 (+ 194us) server_negotiation.cc:299] Negotiation successful
0805 22:51:07.521832 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260805 22:51:07.521922 12932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:07.518157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.224.129:47503 (local address 127.14.224.130:35727)
0805 22:51:07.518202 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:07.518203 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:07.518214 (+ 11us) server_negotiation.cc:407] Connection header received
0805 22:51:07.518323 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:07.518324 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:07.518332 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:07.518380 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:51:07.518614 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:07.519403 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:07.520962 (+ 1559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:07.521506 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:07.521587 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:07.521596 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:07.521790 (+ 194us) server_negotiation.cc:299] Negotiation successful
0805 22:51:07.521832 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260805 22:51:07.521960 12948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:07.518033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.130:35727 (local address 127.14.224.129:47503)
0805 22:51:07.518161 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:07.518171 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0805 22:51:07.518227 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:51:07.518421 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:51:07.518422 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:51:07.518427 (+ 5us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:51:07.518528 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:07.518530 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:07.519517 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:07.519519 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:07.520834 (+ 1315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:07.520839 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:07.521633 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:07.521634 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:07.521710 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:07.521715 (+ 5us) client_negotiation.cc:769] Sending connection context
0805 22:51:07.521779 (+ 64us) client_negotiation.cc:240] Negotiation successful
0805 22:51:07.521833 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"mutex_wait_us":54,"thread_start_us":65,"threads_started":1}
I20260805 22:51:07.521968 12951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:07.518030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.131:40193 (local address 127.14.224.129:60033)
0805 22:51:07.518160 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:07.518171 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:51:07.518229 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:51:07.518421 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:51:07.518422 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:51:07.518425 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:51:07.518528 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:07.518530 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:07.519517 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:07.519519 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:07.520834 (+ 1315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:07.520839 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:07.521622 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:07.521624 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:07.521710 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:07.521716 (+ 6us) client_negotiation.cc:769] Sending connection context
0805 22:51:07.521779 (+ 63us) client_negotiation.cc:240] Negotiation successful
0805 22:51:07.521833 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"mutex_wait_us":81,"thread_start_us":64,"threads_started":1}
I20260805 22:51:07.522316 12673 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12bc928b97e147629e4a45c4bacaf0b9" candidate_uuid: "23edcc4a912643548d00bc3d5d35fe78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "349ad69718184473a58bf84e0ff3d26e" is_pre_election: true
I20260805 22:51:07.522481 12673 raft_consensus.cc:2454] T 12bc928b97e147629e4a45c4bacaf0b9 P 349ad69718184473a58bf84e0ff3d26e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23edcc4a912643548d00bc3d5d35fe78 in term 0.
I20260805 22:51:07.522769 12387 leader_election.cc:302] T 12bc928b97e147629e4a45c4bacaf0b9 P 23edcc4a912643548d00bc3d5d35fe78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23edcc4a912643548d00bc3d5d35fe78, 349ad69718184473a58bf84e0ff3d26e; no voters:
I20260805 22:51:07.522776 12859 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12bc928b97e147629e4a45c4bacaf0b9" candidate_uuid: "23edcc4a912643548d00bc3d5d35fe78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe0a353326f469ca8cc0669c69c6091" is_pre_election: true
I20260805 22:51:07.522907 12859 raft_consensus.cc:2454] T 12bc928b97e147629e4a45c4bacaf0b9 P dbe0a353326f469ca8cc0669c69c6091 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23edcc4a912643548d00bc3d5d35fe78 in term 0.
I20260805 22:51:07.523000 12946 raft_consensus.cc:2781] T 12bc928b97e147629e4a45c4bacaf0b9 P 23edcc4a912643548d00bc3d5d35fe78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:51:07.523092 12946 raft_consensus.cc:482] T 12bc928b97e147629e4a45c4bacaf0b9 P 23edcc4a912643548d00bc3d5d35fe78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:51:07.523120 12946 raft_consensus.cc:3037] T 12bc928b97e147629e4a45c4bacaf0b9 P 23edcc4a912643548d00bc3d5d35fe78 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:51:07.523897 12946 raft_consensus.cc:504] T 12bc928b97e147629e4a45c4bacaf0b9 P 23edcc4a912643548d00bc3d5d35fe78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "349ad69718184473a58bf84e0ff3d26e" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 35727 } } peers { permanent_uuid: "dbe0a353326f469ca8cc0669c69c6091" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 40193 } } peers { permanent_uuid: "23edcc4a912643548d00bc3d5d35fe78" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 41939 } }
I20260805 22:51:07.524035 12946 leader_election.cc:288] T 12bc928b97e147629e4a45c4bacaf0b9 P 23edcc4a912643548d00bc3d5d35fe78 [CANDIDATE]: Term 1 election: Requested vote from peers 349ad69718184473a58bf84e0ff3d26e (127.14.224.130:35727), dbe0a353326f469ca8cc0669c69c6091 (127.14.224.131:40193)
I20260805 22:51:07.524242 12859 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12bc928b97e147629e4a45c4bacaf0b9" candidate_uuid: "23edcc4a912643548d00bc3d5d35fe78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe0a353326f469ca8cc0669c69c6091"
I20260805 22:51:07.524235 12673 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12bc928b97e147629e4a45c4bacaf0b9" candidate_uuid: "23edcc4a912643548d00bc3d5d35fe78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "349ad69718184473a58bf84e0ff3d26e"
I20260805 22:51:07.524320 12673 raft_consensus.cc:3037] T 12bc928b97e147629e4a45c4bacaf0b9 P 349ad69718184473a58bf84e0ff3d26e [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:51:07.524322 12859 raft_consensus.cc:3037] T 12bc928b97e147629e4a45c4bacaf0b9 P dbe0a353326f469ca8cc0669c69c6091 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:51:07.525023 12859 raft_consensus.cc:2454] T 12bc928b97e147629e4a45c4bacaf0b9 P dbe0a353326f469ca8cc0669c69c6091 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23edcc4a912643548d00bc3d5d35fe78 in term 1.
I20260805 22:51:07.525070 12673 raft_consensus.cc:2454] T 12bc928b97e147629e4a45c4bacaf0b9 P 349ad69718184473a58bf84e0ff3d26e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23edcc4a912643548d00bc3d5d35fe78 in term 1.
I20260805 22:51:07.525228 12385 leader_election.cc:302] T 12bc928b97e147629e4a45c4bacaf0b9 P 23edcc4a912643548d00bc3d5d35fe78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23edcc4a912643548d00bc3d5d35fe78, dbe0a353326f469ca8cc0669c69c6091; no voters:
I20260805 22:51:07.525344 12946 raft_consensus.cc:2781] T 12bc928b97e147629e4a45c4bacaf0b9 P 23edcc4a912643548d00bc3d5d35fe78 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:51:07.525496 12946 raft_consensus.cc:686] T 12bc928b97e147629e4a45c4bacaf0b9 P 23edcc4a912643548d00bc3d5d35fe78 [term 1 LEADER]: Becoming Leader. State: Replica: 23edcc4a912643548d00bc3d5d35fe78, State: Running, Role: LEADER
I20260805 22:51:07.525588 12946 consensus_queue.cc:237] T 12bc928b97e147629e4a45c4bacaf0b9 P 23edcc4a912643548d00bc3d5d35fe78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "349ad69718184473a58bf84e0ff3d26e" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 35727 } } peers { permanent_uuid: "dbe0a353326f469ca8cc0669c69c6091" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 40193 } } peers { permanent_uuid: "23edcc4a912643548d00bc3d5d35fe78" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 41939 } }
I20260805 22:51:07.526520 12272 catalog_manager.cc:5495] T 12bc928b97e147629e4a45c4bacaf0b9 P 23edcc4a912643548d00bc3d5d35fe78 reported cstate change: term changed from 0 to 1, leader changed from <none> to 23edcc4a912643548d00bc3d5d35fe78 (127.14.224.129). New cstate: current_term: 1 leader_uuid: "23edcc4a912643548d00bc3d5d35fe78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "349ad69718184473a58bf84e0ff3d26e" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 35727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbe0a353326f469ca8cc0669c69c6091" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 40193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23edcc4a912643548d00bc3d5d35fe78" member_type: VOTER last_known_addr { host: "127.14.224.129" port: 41939 } health_report { overall_health: HEALTHY } } }
I20260805 22:51:07.591374 12933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:07.588984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45130 (local address 127.14.224.129:41939)
0805 22:51:07.589048 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:07.589049 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:07.589063 (+ 14us) server_negotiation.cc:407] Connection header received
0805 22:51:07.589110 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:07.589111 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:07.589133 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:07.589194 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:51:07.589310 (+ 116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:07.589803 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:07.590585 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:07.590793 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:07.590849 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:07.591006 (+ 157us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:51:07.591116 (+ 110us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:51:07.591188 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:07.591229 (+ 41us) server_negotiation.cc:299] Negotiation successful
0805 22:51:07.591251 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260805 22:51:07.593333 12859 raft_consensus.cc:1261] T 12bc928b97e147629e4a45c4bacaf0b9 P dbe0a353326f469ca8cc0669c69c6091 [term 1 FOLLOWER]: Refusing update from remote peer 23edcc4a912643548d00bc3d5d35fe78: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:51:07.593345 12673 raft_consensus.cc:1261] T 12bc928b97e147629e4a45c4bacaf0b9 P 349ad69718184473a58bf84e0ff3d26e [term 1 FOLLOWER]: Refusing update from remote peer 23edcc4a912643548d00bc3d5d35fe78: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:51:07.593703 12952 consensus_queue.cc:1035] T 12bc928b97e147629e4a45c4bacaf0b9 P 23edcc4a912643548d00bc3d5d35fe78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "349ad69718184473a58bf84e0ff3d26e" member_type: VOTER last_known_addr { host: "127.14.224.130" port: 35727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:51:07.593868 12946 consensus_queue.cc:1035] T 12bc928b97e147629e4a45c4bacaf0b9 P 23edcc4a912643548d00bc3d5d35fe78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe0a353326f469ca8cc0669c69c6091" member_type: VOTER last_known_addr { host: "127.14.224.131" port: 40193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:51:07.596304 12958 mvcc.cc:205] Tried to move back new op lower bound from 7315334216059502592 to 7315334215785414656. Current Snapshot: MvccSnapshot[applied={T|T < 7315334216059502592}]
I20260805 22:51:07.596450 12962 mvcc.cc:205] Tried to move back new op lower bound from 7315334216059502592 to 7315334215785414656. Current Snapshot: MvccSnapshot[applied={T|T < 7315334216059502592}]
I20260805 22:51:07.599105 12273 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39978:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:51:07.599215 12273 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39978:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:51:07.599993 12273 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c8cf66f5d13e4d189093383e397db0d8: Sending DeleteTablet for 3 replicas of tablet 12bc928b97e147629e4a45c4bacaf0b9
I20260805 22:51:07.600339 12642 tablet_service.cc:1514] Processing DeleteTablet for tablet 12bc928b97e147629e4a45c4bacaf0b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:51:07 UTC) from {username='slave'} at 127.0.0.1:54656
I20260805 22:51:07.600363 12829 tablet_service.cc:1514] Processing DeleteTablet for tablet 12bc928b97e147629e4a45c4bacaf0b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:51:07 UTC) from {username='slave'} at 127.0.0.1:36210
I20260805 22:51:07.600579 12456 tablet_service.cc:1514] Processing DeleteTablet for tablet 12bc928b97e147629e4a45c4bacaf0b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:51:07 UTC) from {username='slave'} at 127.0.0.1:45118
I20260805 22:51:07.600674 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 12362
I20260805 22:51:07.604964 12973 tablet_replica.cc:330] T 12bc928b97e147629e4a45c4bacaf0b9 P 349ad69718184473a58bf84e0ff3d26e: stopping tablet replica
I20260805 22:51:07.605129 12973 raft_consensus.cc:2229] T 12bc928b97e147629e4a45c4bacaf0b9 P 349ad69718184473a58bf84e0ff3d26e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:51:07.605335 12973 raft_consensus.cc:2258] T 12bc928b97e147629e4a45c4bacaf0b9 P 349ad69718184473a58bf84e0ff3d26e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:51:07.605476 12974 tablet_replica.cc:330] T 12bc928b97e147629e4a45c4bacaf0b9 P dbe0a353326f469ca8cc0669c69c6091: stopping tablet replica
I20260805 22:51:07.605598 12974 raft_consensus.cc:2229] T 12bc928b97e147629e4a45c4bacaf0b9 P dbe0a353326f469ca8cc0669c69c6091 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:51:07.605708 12974 raft_consensus.cc:2258] T 12bc928b97e147629e4a45c4bacaf0b9 P dbe0a353326f469ca8cc0669c69c6091 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:51:07.606267 12974 ts_tablet_manager.cc:1905] T 12bc928b97e147629e4a45c4bacaf0b9 P dbe0a353326f469ca8cc0669c69c6091: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:51:07.608316 12974 ts_tablet_manager.cc:1918] T 12bc928b97e147629e4a45c4bacaf0b9 P dbe0a353326f469ca8cc0669c69c6091: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:51:07.608404 12974 log.cc:1196] T 12bc928b97e147629e4a45c4bacaf0b9 P dbe0a353326f469ca8cc0669c69c6091: Deleting WAL directory at /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970021300824-15234-0/minicluster-data/ts-2/wal/wals/12bc928b97e147629e4a45c4bacaf0b9
I20260805 22:51:07.608636 12974 ts_tablet_manager.cc:1939] T 12bc928b97e147629e4a45c4bacaf0b9 P dbe0a353326f469ca8cc0669c69c6091: Deleting consensus metadata
I20260805 22:51:07.609145 12251 catalog_manager.cc:4841] TS dbe0a353326f469ca8cc0669c69c6091 (127.14.224.131:40193): tablet 12bc928b97e147629e4a45c4bacaf0b9 (table test-table [id=80e017eb10ce40dc929c47a23114836a]) successfully deleted
I20260805 22:51:07.611701 12973 ts_tablet_manager.cc:1905] T 12bc928b97e147629e4a45c4bacaf0b9 P 349ad69718184473a58bf84e0ff3d26e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260805 22:51:07.611887 12249 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.224.129:41939 (error 108)
I20260805 22:51:07.612375 12931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:07.612252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.129:41939 (local address 127.0.0.1:45138)
0805 22:51:07.612306 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:07.612344 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.129:41939: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260805 22:51:07.612378 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 12556
W20260805 22:51:07.623827 12249 catalog_manager.cc:4584] TS 23edcc4a912643548d00bc3d5d35fe78 (127.14.224.129:41939): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 12bc928b97e147629e4a45c4bacaf0b9: Network error: Client connection negotiation failed: client connection to 127.14.224.129:41939: connect: Connection refused (error 111)
I20260805 22:51:07.627756 12931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:07.627630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.130:35727 (local address 127.0.0.1:54670)
0805 22:51:07.627691 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:07.627717 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.130:35727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260805 22:51:07.627745 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 12739
I20260805 22:51:07.644357 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 12225
2026-08-05T22:51:07Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (1126 ms)
[----------] 6 tests from EncryptionPolicyTest (9471 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970021300824-15234-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:51:07 dist-test-slave-gjrz krb5kdc[12980](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:51:07 dist-test-slave-gjrz krb5kdc[12980](info): set up 2 sockets
Aug 05 22:51:07 dist-test-slave-gjrz krb5kdc[12980](info): commencing operation
krb5kdc: starting...
W20260805 22:51:08.771226 15234 mini_kdc.cc:121] Time spent starting KDC: real 1.101s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Aug 05 22:51:08 dist-test-slave-gjrz krb5kdc[12980](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970268, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:51:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:51:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970021300824-15234-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970021300824-15234-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260805 22:51:08.900313 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970021300824-15234-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970021300824-15234-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970021300824-15234-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34667
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970021300824-15234-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43019
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34667
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:51:08.983973 12999 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:51:08.984218 12999 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:51:08.984241 12999 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:51:08.985422 12999 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:51:08.985467 12999 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:51:08.985481 12999 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:51:08.985492 12999 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:51:08.985503 12999 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:51:08.987043 12999 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43019
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970021300824-15234-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970021300824-15234-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34667
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970021300824-15234-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34667
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12999
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970021300824-15234-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:51:08.987293 12999 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:51:08.987493 12999 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:51:08.992412 13009 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:08.992408 13012 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:51:08.992452 12999 server_base.cc:1034] running on GCE node
W20260805 22:51:08.992415 13008 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:51:08.992967 12999 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:51:08.993273 12999 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:51:08.994426 12999 hybrid_clock.cc:648] HybridClock initialized: now 1785970268994412 us; error 31 us; skew 500 ppm
Aug 05 22:51:08 dist-test-slave-gjrz krb5kdc[12980](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970268, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:51:08.996991 12999 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260805 22:51:08.997452 12999 webserver.cc:460] Webserver started at http://127.0.0.1:41835/ using document root <none> and password file <none>
I20260805 22:51:08.997666 12999 fs_manager.cc:359] Metadata directory not provided
I20260805 22:51:08.997707 12999 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:51:08.997807 12999 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:51:08.998859 12999 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970021300824-15234-0/minicluster-data/master-0/data/instance:
uuid: "468f609e0f2642aabdae196e45f82a0b"
format_stamp: "Formatted at 2026-08-05 22:51:08 on dist-test-slave-gjrz"
server_key: "3514931277061a436812dd436c6323a2"
server_key_iv: "f838c334b77162e2c4ad88b737f957ac"
server_key_version: "encryptionkey@0"
I20260805 22:51:08.999344 12999 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970021300824-15234-0/minicluster-data/master-0/wal/instance:
uuid: "468f609e0f2642aabdae196e45f82a0b"
format_stamp: "Formatted at 2026-08-05 22:51:08 on dist-test-slave-gjrz"
server_key: "3514931277061a436812dd436c6323a2"
server_key_iv: "f838c334b77162e2c4ad88b737f957ac"
server_key_version: "encryptionkey@0"
I20260805 22:51:09.000690 12999 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:51:09.001513 13019 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:09.001741 12999 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:51:09.001838 12999 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970021300824-15234-0/minicluster-data/master-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970021300824-15234-0/minicluster-data/master-0/wal
uuid: "468f609e0f2642aabdae196e45f82a0b"
format_stamp: "Formatted at 2026-08-05 22:51:08 on dist-test-slave-gjrz"
server_key: "3514931277061a436812dd436c6323a2"
server_key_iv: "f838c334b77162e2c4ad88b737f957ac"
server_key_version: "encryptionkey@0"
I20260805 22:51:09.001919 12999 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970021300824-15234-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970021300824-15234-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970021300824-15234-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:51:09.018649 12999 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:51:09.020886 12999 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:51:09.021052 12999 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:51:09.025205 12999 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34667
I20260805 22:51:09.025240 13102 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34667 every 8 connection(s)
I20260805 22:51:09.025591 12999 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
I20260805 22:51:09.026515 13103 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:51:09.026543 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 12999
I20260805 22:51:09.026655 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970021300824-15234-0/minicluster-data/master-0/wal/instance
I20260805 22:51:09.026881 15234 external_mini_cluster.cc:1428] Setting key 1f3eb9385d2c30694238f76946490988
I20260805 22:51:09.029795 13103 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 468f609e0f2642aabdae196e45f82a0b: Bootstrap starting.
I20260805 22:51:09.030488 13103 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 468f609e0f2642aabdae196e45f82a0b: Neither blocks nor log segments found. Creating new log.
I20260805 22:51:09.030807 13103 log.cc:824] T 00000000000000000000000000000000 P 468f609e0f2642aabdae196e45f82a0b: Log is configured to *not* fsync() on all Append() calls
I20260805 22:51:09.031575 13103 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 468f609e0f2642aabdae196e45f82a0b: No bootstrap required, opened a new log
Aug 05 22:51:09 dist-test-slave-gjrz krb5kdc[12980](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970268, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260805 22:51:09.033634 13103 raft_consensus.cc:348] T 00000000000000000000000000000000 P 468f609e0f2642aabdae196e45f82a0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "468f609e0f2642aabdae196e45f82a0b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34667 } }
I20260805 22:51:09.033803 13103 raft_consensus.cc:374] T 00000000000000000000000000000000 P 468f609e0f2642aabdae196e45f82a0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:51:09.033828 13103 raft_consensus.cc:729] T 00000000000000000000000000000000 P 468f609e0f2642aabdae196e45f82a0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 468f609e0f2642aabdae196e45f82a0b, State: Initialized, Role: FOLLOWER
I20260805 22:51:09.033970 13103 consensus_queue.cc:260] T 00000000000000000000000000000000 P 468f609e0f2642aabdae196e45f82a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "468f609e0f2642aabdae196e45f82a0b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34667 } }
I20260805 22:51:09.034037 13103 raft_consensus.cc:388] T 00000000000000000000000000000000 P 468f609e0f2642aabdae196e45f82a0b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:51:09.034060 13103 raft_consensus.cc:482] T 00000000000000000000000000000000 P 468f609e0f2642aabdae196e45f82a0b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:51:09.034107 13103 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 468f609e0f2642aabdae196e45f82a0b [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:51:09.034684 13103 raft_consensus.cc:504] T 00000000000000000000000000000000 P 468f609e0f2642aabdae196e45f82a0b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "468f609e0f2642aabdae196e45f82a0b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34667 } }
I20260805 22:51:09.034775 13103 leader_election.cc:302] T 00000000000000000000000000000000 P 468f609e0f2642aabdae196e45f82a0b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 468f609e0f2642aabdae196e45f82a0b; no voters:
I20260805 22:51:09.034961 13103 leader_election.cc:288] T 00000000000000000000000000000000 P 468f609e0f2642aabdae196e45f82a0b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:51:09.034994 13111 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 468f609e0f2642aabdae196e45f82a0b [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:51:09.035105 13111 raft_consensus.cc:686] T 00000000000000000000000000000000 P 468f609e0f2642aabdae196e45f82a0b [term 1 LEADER]: Becoming Leader. State: Replica: 468f609e0f2642aabdae196e45f82a0b, State: Running, Role: LEADER
I20260805 22:51:09.035252 13103 sys_catalog.cc:564] T 00000000000000000000000000000000 P 468f609e0f2642aabdae196e45f82a0b [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:51:09.035250 13111 consensus_queue.cc:237] T 00000000000000000000000000000000 P 468f609e0f2642aabdae196e45f82a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "468f609e0f2642aabdae196e45f82a0b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34667 } }
I20260805 22:51:09.035741 13113 sys_catalog.cc:455] T 00000000000000000000000000000000 P 468f609e0f2642aabdae196e45f82a0b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 468f609e0f2642aabdae196e45f82a0b. Latest consensus state: current_term: 1 leader_uuid: "468f609e0f2642aabdae196e45f82a0b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "468f609e0f2642aabdae196e45f82a0b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34667 } } }
I20260805 22:51:09.035905 13113 sys_catalog.cc:458] T 00000000000000000000000000000000 P 468f609e0f2642aabdae196e45f82a0b [sys.catalog]: This master's current role is: LEADER
I20260805 22:51:09.036399 13124 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:51:09.036496 13112 sys_catalog.cc:455] T 00000000000000000000000000000000 P 468f609e0f2642aabdae196e45f82a0b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "468f609e0f2642aabdae196e45f82a0b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "468f609e0f2642aabdae196e45f82a0b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34667 } } }
I20260805 22:51:09.036690 13112 sys_catalog.cc:458] T 00000000000000000000000000000000 P 468f609e0f2642aabdae196e45f82a0b [sys.catalog]: This master's current role is: LEADER
I20260805 22:51:09.036975 13124 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:51:09.037775 13108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:09.027487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57419 (local address 127.0.0.1:34667)
0805 22:51:09.027672 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:09.027681 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:09.027707 (+ 26us) server_negotiation.cc:407] Connection header received
0805 22:51:09.028146 (+ 439us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:09.028153 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:09.028199 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:09.028311 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:09.029077 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:09.030124 (+ 1047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:09.031115 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:09.031557 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:09.031676 (+ 119us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:09.034204 (+ 2528us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:09.034208 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:09.034208 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:51:09.034221 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:09.036030 (+ 1809us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:09.036473 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:09.036477 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:09.036477 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:09.036588 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:09.036844 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:09.036845 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:09.036846 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:09.037182 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:09.037336 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:09.037469 (+ 133us) server_negotiation.cc:299] Negotiation successful
0805 22:51:09.037563 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":73,"threads_started":1}
I20260805 22:51:09.038544 13124 catalog_manager.cc:1347] Generated new cluster ID: 87ebf22606034b999a163cc4f2d0ad61
I20260805 22:51:09.038606 13124 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:51:09.038676 15234 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:51:09.045567 13124 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:51:09.046239 13124 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:51:09.052539 13108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:09.040115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37871 (local address 127.0.0.1:34667)
0805 22:51:09.040147 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:09.040149 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:09.045202 (+ 5053us) server_negotiation.cc:407] Connection header received
0805 22:51:09.045347 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:09.045348 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:09.045359 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:09.045389 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:09.046135 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:09.046909 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:09.047968 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:09.048320 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:09.048386 (+ 66us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:09.049740 (+ 1354us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:09.049742 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:09.049742 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:51:09.049750 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:09.051360 (+ 1610us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:09.051769 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:09.051770 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:09.051771 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:09.051837 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:09.052022 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:09.052022 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:09.052023 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:09.052159 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:09.052263 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:09.052369 (+ 106us) server_negotiation.cc:299] Negotiation successful
0805 22:51:09.052439 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260805 22:51:09.054276 13124 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 468f609e0f2642aabdae196e45f82a0b: Generated new TSK 0
I20260805 22:51:09.054473 13124 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:51:09.060482 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 12999
W20260805 22:51:09.078917 12978 connection.cc:535] client connection to 127.0.0.1:34667 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34667): Connection reset by peer (error 104)
2026-08-05T22:51:09Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1422 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970021300824-15234-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:51:09 dist-test-slave-gjrz krb5kdc[13149](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:51:09 dist-test-slave-gjrz krb5kdc[13149](info): set up 2 sockets
Aug 05 22:51:09 dist-test-slave-gjrz krb5kdc[13149](info): commencing operation
krb5kdc: starting...
W20260805 22:51:10.197183 15234 mini_kdc.cc:121] Time spent starting KDC: real 1.105s user 0.006s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Aug 05 22:51:10 dist-test-slave-gjrz krb5kdc[13149](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970270, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:51:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:51:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970021300824-15234-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970021300824-15234-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260805 22:51:10.327399 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970021300824-15234-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970021300824-15234-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970021300824-15234-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43081
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970021300824-15234-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38565
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43081
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:51:10.411891 13166 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:51:10.412137 13166 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:51:10.412169 13166 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:51:10.413651 13166 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:51:10.413726 13166 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:51:10.413750 13166 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:51:10.413769 13166 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:51:10.413784 13166 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:51:10.415557 13166 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38565
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970021300824-15234-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970021300824-15234-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43081
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970021300824-15234-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43081
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13166
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970021300824-15234-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:51:10.415851 13166 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:51:10.416093 13166 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:51:10.421156 13179 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:10.421159 13175 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:10.421157 13174 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:51:10.421478 13166 server_base.cc:1034] running on GCE node
I20260805 22:51:10.421700 13166 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:51:10.422009 13166 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:51:10.423178 13166 hybrid_clock.cc:648] HybridClock initialized: now 1785970270423159 us; error 35 us; skew 500 ppm
Aug 05 22:51:10 dist-test-slave-gjrz krb5kdc[13149](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970270, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:51:10.425796 13166 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260805 22:51:10.426294 13166 webserver.cc:460] Webserver started at http://127.0.0.1:39949/ using document root <none> and password file <none>
I20260805 22:51:10.426512 13166 fs_manager.cc:359] Metadata directory not provided
I20260805 22:51:10.426563 13166 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:51:10.426693 13166 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:51:10.427857 13166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970021300824-15234-0/minicluster-data/master-0/data/instance:
uuid: "319e50f29be24ed8a57aa45420361660"
format_stamp: "Formatted at 2026-08-05 22:51:10 on dist-test-slave-gjrz"
server_key: "ad3764c56fc913ad1eb88b49865f504d"
server_key_iv: "77113ce8e64548e15a9fecd83594f1f8"
server_key_version: "encryptionkey@0"
I20260805 22:51:10.428226 13166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970021300824-15234-0/minicluster-data/master-0/wal/instance:
uuid: "319e50f29be24ed8a57aa45420361660"
format_stamp: "Formatted at 2026-08-05 22:51:10 on dist-test-slave-gjrz"
server_key: "ad3764c56fc913ad1eb88b49865f504d"
server_key_iv: "77113ce8e64548e15a9fecd83594f1f8"
server_key_version: "encryptionkey@0"
I20260805 22:51:10.429579 13166 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260805 22:51:10.430320 13192 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:10.430466 13166 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260805 22:51:10.430559 13166 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970021300824-15234-0/minicluster-data/master-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970021300824-15234-0/minicluster-data/master-0/wal
uuid: "319e50f29be24ed8a57aa45420361660"
format_stamp: "Formatted at 2026-08-05 22:51:10 on dist-test-slave-gjrz"
server_key: "ad3764c56fc913ad1eb88b49865f504d"
server_key_iv: "77113ce8e64548e15a9fecd83594f1f8"
server_key_version: "encryptionkey@0"
I20260805 22:51:10.430627 13166 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970021300824-15234-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970021300824-15234-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970021300824-15234-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:51:10.441604 13166 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:51:10.443940 13166 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:51:10.444094 13166 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:51:10.448240 13166 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43081
I20260805 22:51:10.448300 13283 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43081 every 8 connection(s)
I20260805 22:51:10.448674 13166 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
I20260805 22:51:10.449576 13284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:51:10.451989 13284 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 319e50f29be24ed8a57aa45420361660: Bootstrap starting.
I20260805 22:51:10.452594 13284 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 319e50f29be24ed8a57aa45420361660: Neither blocks nor log segments found. Creating new log.
I20260805 22:51:10.452860 13284 log.cc:824] T 00000000000000000000000000000000 P 319e50f29be24ed8a57aa45420361660: Log is configured to *not* fsync() on all Append() calls
I20260805 22:51:10.453204 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 13166
I20260805 22:51:10.453317 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970021300824-15234-0/minicluster-data/master-0/wal/instance
I20260805 22:51:10.453574 15234 external_mini_cluster.cc:1428] Setting key 871d4eef45e339873492a163ac757a67
I20260805 22:51:10.453709 13284 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 319e50f29be24ed8a57aa45420361660: No bootstrap required, opened a new log
I20260805 22:51:10.455719 13284 raft_consensus.cc:348] T 00000000000000000000000000000000 P 319e50f29be24ed8a57aa45420361660 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "319e50f29be24ed8a57aa45420361660" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43081 } }
I20260805 22:51:10.455878 13284 raft_consensus.cc:374] T 00000000000000000000000000000000 P 319e50f29be24ed8a57aa45420361660 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:51:10.455900 13284 raft_consensus.cc:729] T 00000000000000000000000000000000 P 319e50f29be24ed8a57aa45420361660 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 319e50f29be24ed8a57aa45420361660, State: Initialized, Role: FOLLOWER
I20260805 22:51:10.456027 13284 consensus_queue.cc:260] T 00000000000000000000000000000000 P 319e50f29be24ed8a57aa45420361660 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "319e50f29be24ed8a57aa45420361660" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43081 } }
I20260805 22:51:10.456097 13284 raft_consensus.cc:388] T 00000000000000000000000000000000 P 319e50f29be24ed8a57aa45420361660 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:51:10.456120 13284 raft_consensus.cc:482] T 00000000000000000000000000000000 P 319e50f29be24ed8a57aa45420361660 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:51:10.456164 13284 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 319e50f29be24ed8a57aa45420361660 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:51:10.456750 13284 raft_consensus.cc:504] T 00000000000000000000000000000000 P 319e50f29be24ed8a57aa45420361660 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "319e50f29be24ed8a57aa45420361660" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43081 } }
I20260805 22:51:10.456856 13284 leader_election.cc:302] T 00000000000000000000000000000000 P 319e50f29be24ed8a57aa45420361660 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 319e50f29be24ed8a57aa45420361660; no voters:
I20260805 22:51:10.457043 13284 leader_election.cc:288] T 00000000000000000000000000000000 P 319e50f29be24ed8a57aa45420361660 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:51:10.457090 13291 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 319e50f29be24ed8a57aa45420361660 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:51:10.457262 13291 raft_consensus.cc:686] T 00000000000000000000000000000000 P 319e50f29be24ed8a57aa45420361660 [term 1 LEADER]: Becoming Leader. State: Replica: 319e50f29be24ed8a57aa45420361660, State: Running, Role: LEADER
I20260805 22:51:10.457329 13284 sys_catalog.cc:564] T 00000000000000000000000000000000 P 319e50f29be24ed8a57aa45420361660 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:51:10.457412 13291 consensus_queue.cc:237] T 00000000000000000000000000000000 P 319e50f29be24ed8a57aa45420361660 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "319e50f29be24ed8a57aa45420361660" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43081 } }
I20260805 22:51:10.457757 13291 sys_catalog.cc:455] T 00000000000000000000000000000000 P 319e50f29be24ed8a57aa45420361660 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 319e50f29be24ed8a57aa45420361660. Latest consensus state: current_term: 1 leader_uuid: "319e50f29be24ed8a57aa45420361660" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "319e50f29be24ed8a57aa45420361660" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43081 } } }
I20260805 22:51:10.457986 13291 sys_catalog.cc:458] T 00000000000000000000000000000000 P 319e50f29be24ed8a57aa45420361660 [sys.catalog]: This master's current role is: LEADER
I20260805 22:51:10.457911 13293 sys_catalog.cc:455] T 00000000000000000000000000000000 P 319e50f29be24ed8a57aa45420361660 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "319e50f29be24ed8a57aa45420361660" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "319e50f29be24ed8a57aa45420361660" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43081 } } }
I20260805 22:51:10.458215 13293 sys_catalog.cc:458] T 00000000000000000000000000000000 P 319e50f29be24ed8a57aa45420361660 [sys.catalog]: This master's current role is: LEADER
I20260805 22:51:10.458364 13304 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:51:10.458914 13304 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:51:10.460165 13290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:10.454139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36663 (local address 127.0.0.1:43081)
0805 22:51:10.454323 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:10.454332 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:10.454358 (+ 26us) server_negotiation.cc:407] Connection header received
0805 22:51:10.454995 (+ 637us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:10.455002 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:10.455054 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:10.455179 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:10.455429 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:10.456721 (+ 1292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:10.457792 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:10.458404 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:10.458489 (+ 85us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:10.459473 (+ 984us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:10.459477 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:10.459478 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:51:10.459681 (+ 203us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:10.459716 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:51:10.459728 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:10.459773 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:10.459922 (+ 149us) server_negotiation.cc:299] Negotiation successful
0805 22:51:10.459950 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":81,"threads_started":1}
I20260805 22:51:10.460737 13304 catalog_manager.cc:1347] Generated new cluster ID: d167a31f952d4a5b8acc3227d8b9e7e8
I20260805 22:51:10.460785 13304 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:51:10.461311 15234 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:51:10.470592 13304 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:51:10.471392 13304 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:51:10.473096 13290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:10.463650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37089 (local address 127.0.0.1:43081)
0805 22:51:10.463697 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:10.463699 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:10.470240 (+ 6541us) server_negotiation.cc:407] Connection header received
0805 22:51:10.470298 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:10.470299 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:10.470310 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:10.470357 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:10.470533 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:10.471068 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:10.471908 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:10.472141 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:10.472197 (+ 56us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:10.472872 (+ 675us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:10.472873 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:10.472873 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:51:10.472879 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:10.472895 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:51:10.472899 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:10.472943 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:10.473014 (+ 71us) server_negotiation.cc:299] Negotiation successful
0805 22:51:10.473022 (+ 8us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260805 22:51:10.479600 13304 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 319e50f29be24ed8a57aa45420361660: Generated new TSK 0
I20260805 22:51:10.479811 13304 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:51:10.486856 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 13166
W20260805 22:51:10.497960 13146 connection.cc:535] client connection to 127.0.0.1:43081 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43081): Connection reset by peer (error 104)
2026-08-05T22:51:10Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1419 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970021300824-15234-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:51:10 dist-test-slave-gjrz krb5kdc[13328](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:51:10 dist-test-slave-gjrz krb5kdc[13328](info): set up 2 sockets
Aug 05 22:51:10 dist-test-slave-gjrz krb5kdc[13328](info): commencing operation
krb5kdc: starting...
W20260805 22:51:11.626871 15234 mini_kdc.cc:121] Time spent starting KDC: real 1.115s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Aug 05 22:51:11 dist-test-slave-gjrz krb5kdc[13328](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970271, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:51:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:51:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970021300824-15234-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970021300824-15234-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260805 22:51:11.758798 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970021300824-15234-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970021300824-15234-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970021300824-15234-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37871
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970021300824-15234-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37871
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:51:11.843489 13346 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:51:11.843719 13346 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:51:11.843752 13346 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:51:11.844944 13346 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:51:11.844990 13346 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:51:11.845009 13346 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:51:11.845026 13346 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:51:11.845043 13346 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:51:11.846611 13346 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970021300824-15234-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970021300824-15234-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37871
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970021300824-15234-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37871
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13346
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970021300824-15234-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:51:11.846861 13346 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:51:11.847074 13346 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:51:11.852025 13356 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:11.852089 13360 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:51:11.852139 13346 server_base.cc:1034] running on GCE node
W20260805 22:51:11.852231 13357 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:51:11.852504 13346 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:51:11.852803 13346 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:51:11.853981 13346 hybrid_clock.cc:648] HybridClock initialized: now 1785970271853965 us; error 31 us; skew 500 ppm
Aug 05 22:51:11 dist-test-slave-gjrz krb5kdc[13328](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970271, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:51:11.860682 13346 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260805 22:51:11.861135 13346 webserver.cc:460] Webserver started at http://127.0.0.1:37043/ using document root <none> and password file <none>
I20260805 22:51:11.861325 13346 fs_manager.cc:359] Metadata directory not provided
I20260805 22:51:11.861367 13346 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:51:11.861467 13346 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:51:11.862521 13346 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970021300824-15234-0/minicluster-data/master-0/data/instance:
uuid: "7b026fcd966445769c4e7dcae0758103"
format_stamp: "Formatted at 2026-08-05 22:51:11 on dist-test-slave-gjrz"
server_key: "fcc0070acf9ba5289e09d81540c6471c"
server_key_iv: "c86965dcc895b9951bb104ded03d4db4"
server_key_version: "encryptionkey@0"
I20260805 22:51:11.862828 13346 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970021300824-15234-0/minicluster-data/master-0/wal/instance:
uuid: "7b026fcd966445769c4e7dcae0758103"
format_stamp: "Formatted at 2026-08-05 22:51:11 on dist-test-slave-gjrz"
server_key: "fcc0070acf9ba5289e09d81540c6471c"
server_key_iv: "c86965dcc895b9951bb104ded03d4db4"
server_key_version: "encryptionkey@0"
I20260805 22:51:11.864171 13346 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260805 22:51:11.864962 13370 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:11.865119 13346 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260805 22:51:11.865211 13346 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970021300824-15234-0/minicluster-data/master-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970021300824-15234-0/minicluster-data/master-0/wal
uuid: "7b026fcd966445769c4e7dcae0758103"
format_stamp: "Formatted at 2026-08-05 22:51:11 on dist-test-slave-gjrz"
server_key: "fcc0070acf9ba5289e09d81540c6471c"
server_key_iv: "c86965dcc895b9951bb104ded03d4db4"
server_key_version: "encryptionkey@0"
I20260805 22:51:11.865278 13346 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970021300824-15234-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970021300824-15234-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970021300824-15234-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:51:11.868825 13346 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:51:11.870810 13346 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:51:11.870954 13346 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:51:11.875093 13346 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37871
I20260805 22:51:11.875139 13445 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37871 every 8 connection(s)
I20260805 22:51:11.875530 13346 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
I20260805 22:51:11.876572 13447 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:51:11.878911 13447 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b026fcd966445769c4e7dcae0758103: Bootstrap starting.
I20260805 22:51:11.879606 13447 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7b026fcd966445769c4e7dcae0758103: Neither blocks nor log segments found. Creating new log.
I20260805 22:51:11.879873 13447 log.cc:824] T 00000000000000000000000000000000 P 7b026fcd966445769c4e7dcae0758103: Log is configured to *not* fsync() on all Append() calls
I20260805 22:51:11.880657 13447 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b026fcd966445769c4e7dcae0758103: No bootstrap required, opened a new log
I20260805 22:51:11.882355 13447 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7b026fcd966445769c4e7dcae0758103 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b026fcd966445769c4e7dcae0758103" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37871 } }
I20260805 22:51:11.882529 13447 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7b026fcd966445769c4e7dcae0758103 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:51:11.882553 13447 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7b026fcd966445769c4e7dcae0758103 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b026fcd966445769c4e7dcae0758103, State: Initialized, Role: FOLLOWER
I20260805 22:51:11.882710 13447 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7b026fcd966445769c4e7dcae0758103 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b026fcd966445769c4e7dcae0758103" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37871 } }
I20260805 22:51:11.882797 13447 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7b026fcd966445769c4e7dcae0758103 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:51:11.882822 13447 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7b026fcd966445769c4e7dcae0758103 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:51:11.882854 13447 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7b026fcd966445769c4e7dcae0758103 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:51:11.883522 13447 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7b026fcd966445769c4e7dcae0758103 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b026fcd966445769c4e7dcae0758103" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37871 } }
I20260805 22:51:11.883630 13447 leader_election.cc:302] T 00000000000000000000000000000000 P 7b026fcd966445769c4e7dcae0758103 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7b026fcd966445769c4e7dcae0758103; no voters:
I20260805 22:51:11.883809 13447 leader_election.cc:288] T 00000000000000000000000000000000 P 7b026fcd966445769c4e7dcae0758103 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:51:11.883867 13454 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7b026fcd966445769c4e7dcae0758103 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:51:11.884047 13454 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7b026fcd966445769c4e7dcae0758103 [term 1 LEADER]: Becoming Leader. State: Replica: 7b026fcd966445769c4e7dcae0758103, State: Running, Role: LEADER
I20260805 22:51:11.884095 13447 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7b026fcd966445769c4e7dcae0758103 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:51:11.884156 13454 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7b026fcd966445769c4e7dcae0758103 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b026fcd966445769c4e7dcae0758103" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37871 } }
I20260805 22:51:11.884570 13457 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b026fcd966445769c4e7dcae0758103 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7b026fcd966445769c4e7dcae0758103. Latest consensus state: current_term: 1 leader_uuid: "7b026fcd966445769c4e7dcae0758103" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b026fcd966445769c4e7dcae0758103" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37871 } } }
I20260805 22:51:11.884663 13457 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b026fcd966445769c4e7dcae0758103 [sys.catalog]: This master's current role is: LEADER
I20260805 22:51:11.884791 13456 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b026fcd966445769c4e7dcae0758103 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7b026fcd966445769c4e7dcae0758103" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b026fcd966445769c4e7dcae0758103" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37871 } } }
I20260805 22:51:11.884938 13456 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b026fcd966445769c4e7dcae0758103 [sys.catalog]: This master's current role is: LEADER
I20260805 22:51:11.885026 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 13346
I20260805 22:51:11.885058 13469 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:51:11.885161 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970021300824-15234-0/minicluster-data/master-0/wal/instance
I20260805 22:51:11.885398 15234 external_mini_cluster.cc:1428] Setting key d6ea2d20e5b18f02b423f23f6aec6d36
I20260805 22:51:11.885651 13469 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:51:11.887765 13469 catalog_manager.cc:1347] Generated new cluster ID: 284f6d504acf4be8af23454b00df0a60
I20260805 22:51:11.887893 13469 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:51:11.888202 13485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:11.886085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34029 (local address 127.0.0.1:37871)
0805 22:51:11.886399 (+ 314us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:11.886409 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:11.886456 (+ 47us) server_negotiation.cc:407] Connection header received
0805 22:51:11.886588 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:11.886596 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:11.886629 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:11.886783 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:11.887631 (+ 848us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:11.887635 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:11.887636 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:51:11.887641 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:11.887684 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:51:11.887700 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:11.887921 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:11.887955 (+ 34us) server_negotiation.cc:299] Negotiation successful
0805 22:51:11.888000 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":255,"thread_start_us":72,"threads_started":1}
I20260805 22:51:11.889600 15234 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:51:11.892472 13485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:11.891257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51921 (local address 127.0.0.1:37871)
0805 22:51:11.891327 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:11.891329 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:11.891488 (+ 159us) server_negotiation.cc:407] Connection header received
0805 22:51:11.891551 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:11.891552 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:11.891559 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:11.891609 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:11.892240 (+ 631us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:11.892241 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:11.892241 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:51:11.892245 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:11.892262 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:51:11.892266 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:11.892315 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:11.892383 (+ 68us) server_negotiation.cc:299] Negotiation successful
0805 22:51:11.892397 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260805 22:51:11.898262 13469 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:51:11.898459 13469 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:51:11.904501 13469 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7b026fcd966445769c4e7dcae0758103: Generated new TSK 0
I20260805 22:51:11.904706 13469 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:51:11.910243 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 13346
2026-08-05T22:51:11Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1433 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970021300824-15234-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:51:11 dist-test-slave-gjrz krb5kdc[13503](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:51:11 dist-test-slave-gjrz krb5kdc[13503](info): set up 2 sockets
Aug 05 22:51:11 dist-test-slave-gjrz krb5kdc[13503](info): commencing operation
krb5kdc: starting...
W20260805 22:51:13.050066 15234 mini_kdc.cc:121] Time spent starting KDC: real 1.105s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Aug 05 22:51:13 dist-test-slave-gjrz krb5kdc[13503](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970273, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:51:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:51:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970021300824-15234-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970021300824-15234-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260805 22:51:13.178552 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970021300824-15234-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970021300824-15234-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970021300824-15234-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42359
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970021300824-15234-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45309
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42359
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:51:13.264169 13521 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:51:13.264407 13521 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:51:13.264432 13521 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:51:13.265625 13521 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:51:13.265673 13521 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:51:13.265686 13521 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:51:13.265697 13521 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:51:13.265708 13521 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:51:13.267256 13521 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45309
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970021300824-15234-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970021300824-15234-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42359
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970021300824-15234-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42359
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13521
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970021300824-15234-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:51:13.267537 13521 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:51:13.267762 13521 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:51:13.272617 13526 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:13.272673 13529 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:51:13.272737 13521 server_base.cc:1034] running on GCE node
W20260805 22:51:13.272673 13527 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:51:13.273082 13521 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:51:13.273377 13521 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:51:13.274533 13521 hybrid_clock.cc:648] HybridClock initialized: now 1785970273274518 us; error 31 us; skew 500 ppm
Aug 05 22:51:13 dist-test-slave-gjrz krb5kdc[13503](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970273, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:51:13.277056 13521 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260805 22:51:13.277457 13521 webserver.cc:460] Webserver started at http://127.0.0.1:41459/ using document root <none> and password file <none>
I20260805 22:51:13.277665 13521 fs_manager.cc:359] Metadata directory not provided
I20260805 22:51:13.277704 13521 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:51:13.277801 13521 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:51:13.278847 13521 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970021300824-15234-0/minicluster-data/master-0/data/instance:
uuid: "4aa8ce0b434b4ae3a68c5e8c9e48c646"
format_stamp: "Formatted at 2026-08-05 22:51:13 on dist-test-slave-gjrz"
server_key: "32b62631ef85700a6a2c0b01bd2a06a0"
server_key_iv: "72f73cd2761459396d68ee798d3e1963"
server_key_version: "encryptionkey@0"
I20260805 22:51:13.279156 13521 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970021300824-15234-0/minicluster-data/master-0/wal/instance:
uuid: "4aa8ce0b434b4ae3a68c5e8c9e48c646"
format_stamp: "Formatted at 2026-08-05 22:51:13 on dist-test-slave-gjrz"
server_key: "32b62631ef85700a6a2c0b01bd2a06a0"
server_key_iv: "72f73cd2761459396d68ee798d3e1963"
server_key_version: "encryptionkey@0"
I20260805 22:51:13.280498 13521 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:51:13.281306 13536 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:13.281502 13521 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:51:13.281592 13521 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970021300824-15234-0/minicluster-data/master-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970021300824-15234-0/minicluster-data/master-0/wal
uuid: "4aa8ce0b434b4ae3a68c5e8c9e48c646"
format_stamp: "Formatted at 2026-08-05 22:51:13 on dist-test-slave-gjrz"
server_key: "32b62631ef85700a6a2c0b01bd2a06a0"
server_key_iv: "72f73cd2761459396d68ee798d3e1963"
server_key_version: "encryptionkey@0"
I20260805 22:51:13.281651 13521 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970021300824-15234-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970021300824-15234-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970021300824-15234-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:51:13.299695 13521 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:51:13.301930 13521 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:51:13.302093 13521 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:51:13.306209 13521 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42359
I20260805 22:51:13.306254 13606 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42359 every 8 connection(s)
I20260805 22:51:13.306617 13521 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
I20260805 22:51:13.307610 13609 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:51:13.310047 13609 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4aa8ce0b434b4ae3a68c5e8c9e48c646: Bootstrap starting.
I20260805 22:51:13.310673 13609 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4aa8ce0b434b4ae3a68c5e8c9e48c646: Neither blocks nor log segments found. Creating new log.
I20260805 22:51:13.310950 13609 log.cc:824] T 00000000000000000000000000000000 P 4aa8ce0b434b4ae3a68c5e8c9e48c646: Log is configured to *not* fsync() on all Append() calls
I20260805 22:51:13.311940 13609 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4aa8ce0b434b4ae3a68c5e8c9e48c646: No bootstrap required, opened a new log
I20260805 22:51:13.313701 13609 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4aa8ce0b434b4ae3a68c5e8c9e48c646 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4aa8ce0b434b4ae3a68c5e8c9e48c646" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42359 } }
I20260805 22:51:13.313867 13609 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4aa8ce0b434b4ae3a68c5e8c9e48c646 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:51:13.313890 13609 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4aa8ce0b434b4ae3a68c5e8c9e48c646 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4aa8ce0b434b4ae3a68c5e8c9e48c646, State: Initialized, Role: FOLLOWER
I20260805 22:51:13.314033 13609 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4aa8ce0b434b4ae3a68c5e8c9e48c646 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4aa8ce0b434b4ae3a68c5e8c9e48c646" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42359 } }
I20260805 22:51:13.314101 13609 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4aa8ce0b434b4ae3a68c5e8c9e48c646 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:51:13.314123 13609 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4aa8ce0b434b4ae3a68c5e8c9e48c646 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:51:13.314152 13609 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4aa8ce0b434b4ae3a68c5e8c9e48c646 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:51:13.314740 13609 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4aa8ce0b434b4ae3a68c5e8c9e48c646 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4aa8ce0b434b4ae3a68c5e8c9e48c646" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42359 } }
I20260805 22:51:13.314837 13609 leader_election.cc:302] T 00000000000000000000000000000000 P 4aa8ce0b434b4ae3a68c5e8c9e48c646 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4aa8ce0b434b4ae3a68c5e8c9e48c646; no voters:
I20260805 22:51:13.315023 13609 leader_election.cc:288] T 00000000000000000000000000000000 P 4aa8ce0b434b4ae3a68c5e8c9e48c646 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:51:13.315062 13613 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4aa8ce0b434b4ae3a68c5e8c9e48c646 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:51:13.315135 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 13521
I20260805 22:51:13.315188 13613 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4aa8ce0b434b4ae3a68c5e8c9e48c646 [term 1 LEADER]: Becoming Leader. State: Replica: 4aa8ce0b434b4ae3a68c5e8c9e48c646, State: Running, Role: LEADER
I20260805 22:51:13.315289 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970021300824-15234-0/minicluster-data/master-0/wal/instance
I20260805 22:51:13.315310 13613 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4aa8ce0b434b4ae3a68c5e8c9e48c646 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4aa8ce0b434b4ae3a68c5e8c9e48c646" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42359 } }
I20260805 22:51:13.315344 13609 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4aa8ce0b434b4ae3a68c5e8c9e48c646 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:51:13.315511 15234 external_mini_cluster.cc:1428] Setting key 189c0c1bc5af5a204006212b97002c8a
I20260805 22:51:13.315855 13615 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4aa8ce0b434b4ae3a68c5e8c9e48c646 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4aa8ce0b434b4ae3a68c5e8c9e48c646" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4aa8ce0b434b4ae3a68c5e8c9e48c646" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42359 } } }
I20260805 22:51:13.316044 13615 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4aa8ce0b434b4ae3a68c5e8c9e48c646 [sys.catalog]: This master's current role is: LEADER
I20260805 22:51:13.316427 13629 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:51:13.316653 13617 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4aa8ce0b434b4ae3a68c5e8c9e48c646 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4aa8ce0b434b4ae3a68c5e8c9e48c646. Latest consensus state: current_term: 1 leader_uuid: "4aa8ce0b434b4ae3a68c5e8c9e48c646" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4aa8ce0b434b4ae3a68c5e8c9e48c646" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42359 } } }
I20260805 22:51:13.316788 13617 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4aa8ce0b434b4ae3a68c5e8c9e48c646 [sys.catalog]: This master's current role is: LEADER
I20260805 22:51:13.317006 13629 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:51:13.318650 13629 catalog_manager.cc:1347] Generated new cluster ID: d3260be02ede4a70b3887b835b06f1da
I20260805 22:51:13.318706 13629 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 05 22:51:13 dist-test-slave-gjrz krb5kdc[13503](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970273, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260805 22:51:13.326587 13629 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:51:13.327193 13629 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:51:13.328733 13630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:13.316189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33839 (local address 127.0.0.1:42359)
0805 22:51:13.316365 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:13.316934 (+ 569us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:13.316975 (+ 41us) server_negotiation.cc:407] Connection header received
0805 22:51:13.317122 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:13.317131 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:13.317195 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:13.317336 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:13.318101 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:13.319528 (+ 1427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:13.320632 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:13.321316 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:13.321434 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:13.324552 (+ 3118us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:13.324561 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:13.324562 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:51:13.324587 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:13.326841 (+ 2254us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:13.327403 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:13.327407 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:13.327408 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:13.327536 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:13.327752 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:13.327753 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:13.327753 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:13.328064 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:13.328218 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:13.328320 (+ 102us) server_negotiation.cc:299] Negotiation successful
0805 22:51:13.328478 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":78,"threads_started":1}
I20260805 22:51:13.329754 15234 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:51:13.333552 13629 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4aa8ce0b434b4ae3a68c5e8c9e48c646: Generated new TSK 0
I20260805 22:51:13.333773 13629 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:51:13.338961 13630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:13.331306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47071 (local address 127.0.0.1:42359)
0805 22:51:13.331346 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:13.331348 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:13.333238 (+ 1890us) server_negotiation.cc:407] Connection header received
0805 22:51:13.333287 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:13.333288 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:13.333299 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:13.333348 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:13.333898 (+ 550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:13.334439 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:13.335172 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:13.335464 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:13.335525 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:13.336740 (+ 1215us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:13.336742 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:13.336743 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:51:13.336749 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:13.337947 (+ 1198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:13.338261 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:13.338263 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:13.338263 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:13.338320 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:13.338486 (+ 166us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:13.338487 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:13.338487 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:13.338599 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:13.338703 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:13.338788 (+ 85us) server_negotiation.cc:299] Negotiation successful
0805 22:51:13.338873 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260805 22:51:13.341183 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 13521
2026-08-05T22:51:13Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1424 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970021300824-15234-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:51:13 dist-test-slave-gjrz krb5kdc[13653](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:51:13 dist-test-slave-gjrz krb5kdc[13653](info): set up 2 sockets
Aug 05 22:51:13 dist-test-slave-gjrz krb5kdc[13653](info): commencing operation
krb5kdc: starting...
W20260805 22:51:14.475289 15234 mini_kdc.cc:121] Time spent starting KDC: real 1.105s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Aug 05 22:51:14 dist-test-slave-gjrz krb5kdc[13653](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970274, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:51:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:51:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970021300824-15234-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970021300824-15234-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260805 22:51:14.602249 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970021300824-15234-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970021300824-15234-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970021300824-15234-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36175
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970021300824-15234-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46879
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36175
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:51:14.686913 13673 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:51:14.687155 13673 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:51:14.687188 13673 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:51:14.688485 13673 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:51:14.688539 13673 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:51:14.688558 13673 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:51:14.688575 13673 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:51:14.688599 13673 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:51:14.690197 13673 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46879
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970021300824-15234-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970021300824-15234-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36175
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970021300824-15234-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36175
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13673
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970021300824-15234-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:51:14.690455 13673 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:51:14.690680 13673 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:51:14.695693 13685 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:14.695726 13680 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:51:14.695734 13673 server_base.cc:1034] running on GCE node
W20260805 22:51:14.695703 13681 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:51:14.696166 13673 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:51:14.696452 13673 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:51:14.697593 13673 hybrid_clock.cc:648] HybridClock initialized: now 1785970274697579 us; error 29 us; skew 500 ppm
Aug 05 22:51:14 dist-test-slave-gjrz krb5kdc[13653](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970274, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:51:14.700084 13673 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260805 22:51:14.700528 13673 webserver.cc:460] Webserver started at http://127.0.0.1:35001/ using document root <none> and password file <none>
I20260805 22:51:14.700754 13673 fs_manager.cc:359] Metadata directory not provided
I20260805 22:51:14.700798 13673 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:51:14.700923 13673 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:51:14.701989 13673 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970021300824-15234-0/minicluster-data/master-0/data/instance:
uuid: "e8d71230bc184a64a2a86fc9b0b91082"
format_stamp: "Formatted at 2026-08-05 22:51:14 on dist-test-slave-gjrz"
server_key: "83163721c708698088ef51e9e1b30e07"
server_key_iv: "f80b3a9bb3352a273d7443a8afddb1a8"
server_key_version: "encryptionkey@0"
I20260805 22:51:14.702323 13673 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970021300824-15234-0/minicluster-data/master-0/wal/instance:
uuid: "e8d71230bc184a64a2a86fc9b0b91082"
format_stamp: "Formatted at 2026-08-05 22:51:14 on dist-test-slave-gjrz"
server_key: "83163721c708698088ef51e9e1b30e07"
server_key_iv: "f80b3a9bb3352a273d7443a8afddb1a8"
server_key_version: "encryptionkey@0"
I20260805 22:51:14.703750 13673 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260805 22:51:14.704532 13693 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:14.704751 13673 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:51:14.704833 13673 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970021300824-15234-0/minicluster-data/master-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970021300824-15234-0/minicluster-data/master-0/wal
uuid: "e8d71230bc184a64a2a86fc9b0b91082"
format_stamp: "Formatted at 2026-08-05 22:51:14 on dist-test-slave-gjrz"
server_key: "83163721c708698088ef51e9e1b30e07"
server_key_iv: "f80b3a9bb3352a273d7443a8afddb1a8"
server_key_version: "encryptionkey@0"
I20260805 22:51:14.704905 13673 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970021300824-15234-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970021300824-15234-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970021300824-15234-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:51:14.717446 13673 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:51:14.719218 13673 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:51:14.719367 13673 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:51:14.723323 13673 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36175
I20260805 22:51:14.723394 13763 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36175 every 8 connection(s)
I20260805 22:51:14.723718 13673 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
I20260805 22:51:14.724578 13764 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:51:14.726915 13764 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e8d71230bc184a64a2a86fc9b0b91082: Bootstrap starting.
I20260805 22:51:14.727547 13764 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e8d71230bc184a64a2a86fc9b0b91082: Neither blocks nor log segments found. Creating new log.
I20260805 22:51:14.727782 13764 log.cc:824] T 00000000000000000000000000000000 P e8d71230bc184a64a2a86fc9b0b91082: Log is configured to *not* fsync() on all Append() calls
I20260805 22:51:14.728502 13764 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e8d71230bc184a64a2a86fc9b0b91082: No bootstrap required, opened a new log
I20260805 22:51:14.728618 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 13673
I20260805 22:51:14.728739 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970021300824-15234-0/minicluster-data/master-0/wal/instance
I20260805 22:51:14.728924 15234 external_mini_cluster.cc:1428] Setting key a93c1d0bed2243aaa2c57bc3cb99242d
I20260805 22:51:14.730474 13764 raft_consensus.cc:348] T 00000000000000000000000000000000 P e8d71230bc184a64a2a86fc9b0b91082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8d71230bc184a64a2a86fc9b0b91082" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36175 } }
I20260805 22:51:14.730639 13764 raft_consensus.cc:374] T 00000000000000000000000000000000 P e8d71230bc184a64a2a86fc9b0b91082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:51:14.730677 13764 raft_consensus.cc:729] T 00000000000000000000000000000000 P e8d71230bc184a64a2a86fc9b0b91082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8d71230bc184a64a2a86fc9b0b91082, State: Initialized, Role: FOLLOWER
I20260805 22:51:14.730849 13764 consensus_queue.cc:260] T 00000000000000000000000000000000 P e8d71230bc184a64a2a86fc9b0b91082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8d71230bc184a64a2a86fc9b0b91082" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36175 } }
I20260805 22:51:14.730945 13764 raft_consensus.cc:388] T 00000000000000000000000000000000 P e8d71230bc184a64a2a86fc9b0b91082 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:51:14.730976 13764 raft_consensus.cc:482] T 00000000000000000000000000000000 P e8d71230bc184a64a2a86fc9b0b91082 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:51:14.731025 13764 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e8d71230bc184a64a2a86fc9b0b91082 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:51:14.731698 13764 raft_consensus.cc:504] T 00000000000000000000000000000000 P e8d71230bc184a64a2a86fc9b0b91082 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8d71230bc184a64a2a86fc9b0b91082" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36175 } }
I20260805 22:51:14.731793 13764 leader_election.cc:302] T 00000000000000000000000000000000 P e8d71230bc184a64a2a86fc9b0b91082 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e8d71230bc184a64a2a86fc9b0b91082; no voters:
I20260805 22:51:14.731961 13764 leader_election.cc:288] T 00000000000000000000000000000000 P e8d71230bc184a64a2a86fc9b0b91082 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:51:14.732018 13771 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e8d71230bc184a64a2a86fc9b0b91082 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:51:14.732167 13771 raft_consensus.cc:686] T 00000000000000000000000000000000 P e8d71230bc184a64a2a86fc9b0b91082 [term 1 LEADER]: Becoming Leader. State: Replica: e8d71230bc184a64a2a86fc9b0b91082, State: Running, Role: LEADER
I20260805 22:51:14.732245 13764 sys_catalog.cc:564] T 00000000000000000000000000000000 P e8d71230bc184a64a2a86fc9b0b91082 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:51:14.732285 13771 consensus_queue.cc:237] T 00000000000000000000000000000000 P e8d71230bc184a64a2a86fc9b0b91082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8d71230bc184a64a2a86fc9b0b91082" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36175 } }
I20260805 22:51:14.732733 13773 sys_catalog.cc:455] T 00000000000000000000000000000000 P e8d71230bc184a64a2a86fc9b0b91082 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e8d71230bc184a64a2a86fc9b0b91082. Latest consensus state: current_term: 1 leader_uuid: "e8d71230bc184a64a2a86fc9b0b91082" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8d71230bc184a64a2a86fc9b0b91082" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36175 } } }
I20260805 22:51:14.732813 13773 sys_catalog.cc:458] T 00000000000000000000000000000000 P e8d71230bc184a64a2a86fc9b0b91082 [sys.catalog]: This master's current role is: LEADER
I20260805 22:51:14.732990 13772 sys_catalog.cc:455] T 00000000000000000000000000000000 P e8d71230bc184a64a2a86fc9b0b91082 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e8d71230bc184a64a2a86fc9b0b91082" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8d71230bc184a64a2a86fc9b0b91082" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36175 } } }
I20260805 22:51:14.733063 13772 sys_catalog.cc:458] T 00000000000000000000000000000000 P e8d71230bc184a64a2a86fc9b0b91082 [sys.catalog]: This master's current role is: LEADER
I20260805 22:51:14.733819 13783 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:51:14.734262 13783 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:51:14.735647 13769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:14.729421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57187 (local address 127.0.0.1:36175)
0805 22:51:14.729600 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:14.729608 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:14.729634 (+ 26us) server_negotiation.cc:407] Connection header received
0805 22:51:14.730446 (+ 812us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:14.730454 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:14.730512 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:14.730645 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:14.730910 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:14.732405 (+ 1495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:14.733534 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:14.734107 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:14.734209 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:14.734865 (+ 656us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:14.734870 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:14.734870 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:51:14.735102 (+ 232us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:14.735140 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:51:14.735155 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:14.735217 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:14.735344 (+ 127us) server_negotiation.cc:299] Negotiation successful
0805 22:51:14.735409 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":75,"threads_started":1}
I20260805 22:51:14.736331 13783 catalog_manager.cc:1347] Generated new cluster ID: 73174f8f5b65443784c611ee38f0dd8d
I20260805 22:51:14.736387 13783 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:51:14.739642 15234 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:51:14.744650 13769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:14.741233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34643 (local address 127.0.0.1:36175)
0805 22:51:14.741274 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:14.741276 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:14.741326 (+ 50us) server_negotiation.cc:407] Connection header received
0805 22:51:14.741383 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:14.741383 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:14.741394 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:14.741463 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:14.741594 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:14.742346 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:14.743346 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:14.743651 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:14.743715 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:14.744393 (+ 678us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:14.744394 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:14.744394 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:51:14.744400 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:14.744416 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:51:14.744421 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:14.744469 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:14.744532 (+ 63us) server_negotiation.cc:299] Negotiation successful
0805 22:51:14.744558 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260805 22:51:14.751204 13783 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:51:14.751780 13783 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:51:14.758031 13783 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e8d71230bc184a64a2a86fc9b0b91082: Generated new TSK 0
I20260805 22:51:14.758224 13783 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:51:14.760805 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 13673
2026-08-05T22:51:14Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1422 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970021300824-15234-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:51:14 dist-test-slave-gjrz krb5kdc[13806](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:51:14 dist-test-slave-gjrz krb5kdc[13806](info): set up 2 sockets
Aug 05 22:51:14 dist-test-slave-gjrz krb5kdc[13806](info): commencing operation
krb5kdc: starting...
W20260805 22:51:15.901252 15234 mini_kdc.cc:121] Time spent starting KDC: real 1.108s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Aug 05 22:51:15 dist-test-slave-gjrz krb5kdc[13806](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970275, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:51:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:51:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970021300824-15234-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970021300824-15234-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260805 22:51:16.046682 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970021300824-15234-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970021300824-15234-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970021300824-15234-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35661
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970021300824-15234-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38865
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35661
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:51:16.131402 13826 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:51:16.131640 13826 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:51:16.131672 13826 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:51:16.132880 13826 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:51:16.132931 13826 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:51:16.132951 13826 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:51:16.132966 13826 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:51:16.132982 13826 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:51:16.134552 13826 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38865
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970021300824-15234-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970021300824-15234-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35661
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970021300824-15234-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35661
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13826
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970021300824-15234-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:51:16.134825 13826 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:51:16.135062 13826 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:51:16.140264 13840 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:16.140264 13838 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:16.140288 13836 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:51:16.140528 13826 server_base.cc:1034] running on GCE node
I20260805 22:51:16.140782 13826 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:51:16.141080 13826 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:51:16.142242 13826 hybrid_clock.cc:648] HybridClock initialized: now 1785970276142220 us; error 34 us; skew 500 ppm
Aug 05 22:51:16 dist-test-slave-gjrz krb5kdc[13806](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970276, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:51:16.144855 13826 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260805 22:51:16.145300 13826 webserver.cc:460] Webserver started at http://127.0.0.1:37589/ using document root <none> and password file <none>
I20260805 22:51:16.145536 13826 fs_manager.cc:359] Metadata directory not provided
I20260805 22:51:16.145581 13826 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:51:16.145673 13826 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:51:16.146745 13826 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970021300824-15234-0/minicluster-data/master-0/data/instance:
uuid: "c507c831caea4c54bb88b74320c67646"
format_stamp: "Formatted at 2026-08-05 22:51:16 on dist-test-slave-gjrz"
server_key: "5cf4f848dbf8f8459a50adf03a976bf5"
server_key_iv: "25157b16f8714e9cd05abb86edc3303c"
server_key_version: "encryptionkey@0"
I20260805 22:51:16.147061 13826 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970021300824-15234-0/minicluster-data/master-0/wal/instance:
uuid: "c507c831caea4c54bb88b74320c67646"
format_stamp: "Formatted at 2026-08-05 22:51:16 on dist-test-slave-gjrz"
server_key: "5cf4f848dbf8f8459a50adf03a976bf5"
server_key_iv: "25157b16f8714e9cd05abb86edc3303c"
server_key_version: "encryptionkey@0"
I20260805 22:51:16.148396 13826 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260805 22:51:16.149274 13849 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:16.149494 13826 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:51:16.149583 13826 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970021300824-15234-0/minicluster-data/master-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970021300824-15234-0/minicluster-data/master-0/wal
uuid: "c507c831caea4c54bb88b74320c67646"
format_stamp: "Formatted at 2026-08-05 22:51:16 on dist-test-slave-gjrz"
server_key: "5cf4f848dbf8f8459a50adf03a976bf5"
server_key_iv: "25157b16f8714e9cd05abb86edc3303c"
server_key_version: "encryptionkey@0"
I20260805 22:51:16.149644 13826 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970021300824-15234-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970021300824-15234-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970021300824-15234-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:51:16.152953 13826 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:51:16.154975 13826 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:51:16.155084 13826 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:51:16.158778 13826 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35661
I20260805 22:51:16.158816 13914 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35661 every 8 connection(s)
I20260805 22:51:16.159121 13826 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
I20260805 22:51:16.160157 13915 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:51:16.162573 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 13826
I20260805 22:51:16.162599 13915 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c507c831caea4c54bb88b74320c67646: Bootstrap starting.
I20260805 22:51:16.162680 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970021300824-15234-0/minicluster-data/master-0/wal/instance
I20260805 22:51:16.162873 15234 external_mini_cluster.cc:1428] Setting key 76ded262f1d2d26fb07a87da10bd41df
I20260805 22:51:16.163297 13915 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c507c831caea4c54bb88b74320c67646: Neither blocks nor log segments found. Creating new log.
I20260805 22:51:16.163705 13915 log.cc:824] T 00000000000000000000000000000000 P c507c831caea4c54bb88b74320c67646: Log is configured to *not* fsync() on all Append() calls
I20260805 22:51:16.164476 13915 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c507c831caea4c54bb88b74320c67646: No bootstrap required, opened a new log
I20260805 22:51:16.165637 13918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:16.163411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57773 (local address 127.0.0.1:35661)
0805 22:51:16.163615 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:16.163624 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:16.163661 (+ 37us) server_negotiation.cc:407] Connection header received
0805 22:51:16.164216 (+ 555us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:16.164225 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:16.164262 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:16.164406 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:16.165210 (+ 804us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:16.165214 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:16.165215 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:51:16.165219 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:16.165264 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:51:16.165279 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:16.165369 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:16.165400 (+ 31us) server_negotiation.cc:299] Negotiation successful
0805 22:51:16.165441 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":89,"threads_started":1}
I20260805 22:51:16.166615 15234 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:51:16.166932 13915 raft_consensus.cc:348] T 00000000000000000000000000000000 P c507c831caea4c54bb88b74320c67646 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c507c831caea4c54bb88b74320c67646" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35661 } }
I20260805 22:51:16.167069 13915 raft_consensus.cc:374] T 00000000000000000000000000000000 P c507c831caea4c54bb88b74320c67646 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:51:16.167101 13915 raft_consensus.cc:729] T 00000000000000000000000000000000 P c507c831caea4c54bb88b74320c67646 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c507c831caea4c54bb88b74320c67646, State: Initialized, Role: FOLLOWER
I20260805 22:51:16.167217 13915 consensus_queue.cc:260] T 00000000000000000000000000000000 P c507c831caea4c54bb88b74320c67646 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c507c831caea4c54bb88b74320c67646" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35661 } }
I20260805 22:51:16.167341 13915 raft_consensus.cc:388] T 00000000000000000000000000000000 P c507c831caea4c54bb88b74320c67646 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:51:16.167380 13915 raft_consensus.cc:482] T 00000000000000000000000000000000 P c507c831caea4c54bb88b74320c67646 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:51:16.167430 13915 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c507c831caea4c54bb88b74320c67646 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:51:16.168154 13915 raft_consensus.cc:504] T 00000000000000000000000000000000 P c507c831caea4c54bb88b74320c67646 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c507c831caea4c54bb88b74320c67646" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35661 } }
I20260805 22:51:16.168257 13915 leader_election.cc:302] T 00000000000000000000000000000000 P c507c831caea4c54bb88b74320c67646 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c507c831caea4c54bb88b74320c67646; no voters:
I20260805 22:51:16.168407 13915 leader_election.cc:288] T 00000000000000000000000000000000 P c507c831caea4c54bb88b74320c67646 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:51:16.168447 13928 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c507c831caea4c54bb88b74320c67646 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:51:16.168593 13928 raft_consensus.cc:686] T 00000000000000000000000000000000 P c507c831caea4c54bb88b74320c67646 [term 1 LEADER]: Becoming Leader. State: Replica: c507c831caea4c54bb88b74320c67646, State: Running, Role: LEADER
I20260805 22:51:16.168661 13915 sys_catalog.cc:564] T 00000000000000000000000000000000 P c507c831caea4c54bb88b74320c67646 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:51:16.168681 13928 consensus_queue.cc:237] T 00000000000000000000000000000000 P c507c831caea4c54bb88b74320c67646 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c507c831caea4c54bb88b74320c67646" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35661 } }
I20260805 22:51:16.169006 13930 sys_catalog.cc:455] T 00000000000000000000000000000000 P c507c831caea4c54bb88b74320c67646 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c507c831caea4c54bb88b74320c67646" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c507c831caea4c54bb88b74320c67646" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35661 } } }
I20260805 22:51:16.169107 13930 sys_catalog.cc:458] T 00000000000000000000000000000000 P c507c831caea4c54bb88b74320c67646 [sys.catalog]: This master's current role is: LEADER
I20260805 22:51:16.169023 13931 sys_catalog.cc:455] T 00000000000000000000000000000000 P c507c831caea4c54bb88b74320c67646 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c507c831caea4c54bb88b74320c67646. Latest consensus state: current_term: 1 leader_uuid: "c507c831caea4c54bb88b74320c67646" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c507c831caea4c54bb88b74320c67646" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35661 } } }
I20260805 22:51:16.169190 13931 sys_catalog.cc:458] T 00000000000000000000000000000000 P c507c831caea4c54bb88b74320c67646 [sys.catalog]: This master's current role is: LEADER
W20260805 22:51:16.170378 13950 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c507c831caea4c54bb88b74320c67646: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260805 22:51:16.170428 13950 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260805 22:51:16.170482 13938 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:51:16.170639 13938 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:51:16.171131 13918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:16.168016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59257 (local address 127.0.0.1:35661)
0805 22:51:16.168050 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:16.168052 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:16.170138 (+ 2086us) server_negotiation.cc:407] Connection header received
0805 22:51:16.170232 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:16.170233 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:16.170239 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:16.170296 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:16.170921 (+ 625us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:16.170923 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:16.170923 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:51:16.170928 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:16.170944 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:51:16.170948 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:16.171004 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:16.171060 (+ 56us) server_negotiation.cc:299] Negotiation successful
0805 22:51:16.171073 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260805 22:51:16.172289 13938 catalog_manager.cc:1347] Generated new cluster ID: 6b263d29d737424f8e84e03f076c73be
I20260805 22:51:16.172333 13938 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:51:16.182353 13938 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:51:16.182524 13938 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:51:16.186627 13938 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c507c831caea4c54bb88b74320c67646: Generated new TSK 0
I20260805 22:51:16.186786 13938 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:51:16.191536 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 13826
2026-08-05T22:51:16Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1427 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970021300824-15234-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:51:16 dist-test-slave-gjrz krb5kdc[13955](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:51:16 dist-test-slave-gjrz krb5kdc[13955](info): set up 2 sockets
Aug 05 22:51:16 dist-test-slave-gjrz krb5kdc[13955](info): commencing operation
krb5kdc: starting...
W20260805 22:51:17.324842 15234 mini_kdc.cc:121] Time spent starting KDC: real 1.105s user 0.005s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Aug 05 22:51:17 dist-test-slave-gjrz krb5kdc[13955](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970277, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:51:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:51:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970021300824-15234-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970021300824-15234-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260805 22:51:17.450829 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970021300824-15234-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970021300824-15234-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970021300824-15234-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:32905
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970021300824-15234-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46687
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:32905
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:51:17.537869 13974 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:51:17.538121 13974 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:51:17.538156 13974 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:51:17.539405 13974 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:51:17.539453 13974 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:51:17.539472 13974 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:51:17.539489 13974 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:51:17.539506 13974 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:51:17.541103 13974 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46687
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970021300824-15234-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970021300824-15234-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:32905
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970021300824-15234-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:32905
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13974
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970021300824-15234-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:51:17.541378 13974 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:51:17.541605 13974 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:51:17.546679 13981 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:17.546674 13983 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:17.546706 13980 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:51:17.546679 13974 server_base.cc:1034] running on GCE node
I20260805 22:51:17.547123 13974 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:51:17.547443 13974 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:51:17.548615 13974 hybrid_clock.cc:648] HybridClock initialized: now 1785970277548592 us; error 32 us; skew 500 ppm
Aug 05 22:51:17 dist-test-slave-gjrz krb5kdc[13955](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970277, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:51:17.554383 13974 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260805 22:51:17.554849 13974 webserver.cc:460] Webserver started at http://127.0.0.1:41617/ using document root <none> and password file <none>
I20260805 22:51:17.555075 13974 fs_manager.cc:359] Metadata directory not provided
I20260805 22:51:17.555120 13974 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:51:17.555220 13974 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:51:17.556385 13974 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970021300824-15234-0/minicluster-data/master-0/data/instance:
uuid: "02728bb38b2e4c909e4305cbdecb4551"
format_stamp: "Formatted at 2026-08-05 22:51:17 on dist-test-slave-gjrz"
server_key: "b74416c3ea7fdd1faa2090e5ac81b0f7"
server_key_iv: "714d3b14a2550ae7a913cd2228cbd3b1"
server_key_version: "encryptionkey@0"
I20260805 22:51:17.556702 13974 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970021300824-15234-0/minicluster-data/master-0/wal/instance:
uuid: "02728bb38b2e4c909e4305cbdecb4551"
format_stamp: "Formatted at 2026-08-05 22:51:17 on dist-test-slave-gjrz"
server_key: "b74416c3ea7fdd1faa2090e5ac81b0f7"
server_key_iv: "714d3b14a2550ae7a913cd2228cbd3b1"
server_key_version: "encryptionkey@0"
I20260805 22:51:17.557996 13974 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260805 22:51:17.558735 13993 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:17.558904 13974 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260805 22:51:17.558998 13974 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970021300824-15234-0/minicluster-data/master-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970021300824-15234-0/minicluster-data/master-0/wal
uuid: "02728bb38b2e4c909e4305cbdecb4551"
format_stamp: "Formatted at 2026-08-05 22:51:17 on dist-test-slave-gjrz"
server_key: "b74416c3ea7fdd1faa2090e5ac81b0f7"
server_key_iv: "714d3b14a2550ae7a913cd2228cbd3b1"
server_key_version: "encryptionkey@0"
I20260805 22:51:17.559067 13974 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970021300824-15234-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970021300824-15234-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970021300824-15234-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:51:17.569497 13974 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:51:17.571425 13974 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:51:17.571548 13974 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:51:17.575474 13974 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:32905
I20260805 22:51:17.575522 14068 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:32905 every 8 connection(s)
I20260805 22:51:17.575861 13974 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
I20260805 22:51:17.576551 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 13974
I20260805 22:51:17.576666 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970021300824-15234-0/minicluster-data/master-0/wal/instance
I20260805 22:51:17.576838 14069 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:51:17.576864 15234 external_mini_cluster.cc:1428] Setting key 9d6e3ce9c055f735800abacf86ab9add
I20260805 22:51:17.580351 14069 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 02728bb38b2e4c909e4305cbdecb4551: Bootstrap starting.
I20260805 22:51:17.581020 14069 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 02728bb38b2e4c909e4305cbdecb4551: Neither blocks nor log segments found. Creating new log.
I20260805 22:51:17.581327 14069 log.cc:824] T 00000000000000000000000000000000 P 02728bb38b2e4c909e4305cbdecb4551: Log is configured to *not* fsync() on all Append() calls
I20260805 22:51:17.582183 14069 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 02728bb38b2e4c909e4305cbdecb4551: No bootstrap required, opened a new log
Aug 05 22:51:17 dist-test-slave-gjrz krb5kdc[13955](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970277, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260805 22:51:17.584246 14069 raft_consensus.cc:348] T 00000000000000000000000000000000 P 02728bb38b2e4c909e4305cbdecb4551 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02728bb38b2e4c909e4305cbdecb4551" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32905 } }
I20260805 22:51:17.584435 14069 raft_consensus.cc:374] T 00000000000000000000000000000000 P 02728bb38b2e4c909e4305cbdecb4551 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:51:17.584486 14069 raft_consensus.cc:729] T 00000000000000000000000000000000 P 02728bb38b2e4c909e4305cbdecb4551 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02728bb38b2e4c909e4305cbdecb4551, State: Initialized, Role: FOLLOWER
I20260805 22:51:17.584672 14069 consensus_queue.cc:260] T 00000000000000000000000000000000 P 02728bb38b2e4c909e4305cbdecb4551 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02728bb38b2e4c909e4305cbdecb4551" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32905 } }
I20260805 22:51:17.584772 14069 raft_consensus.cc:388] T 00000000000000000000000000000000 P 02728bb38b2e4c909e4305cbdecb4551 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:51:17.584812 14069 raft_consensus.cc:482] T 00000000000000000000000000000000 P 02728bb38b2e4c909e4305cbdecb4551 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:51:17.584863 14069 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 02728bb38b2e4c909e4305cbdecb4551 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:51:17.585609 14069 raft_consensus.cc:504] T 00000000000000000000000000000000 P 02728bb38b2e4c909e4305cbdecb4551 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02728bb38b2e4c909e4305cbdecb4551" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32905 } }
I20260805 22:51:17.585745 14069 leader_election.cc:302] T 00000000000000000000000000000000 P 02728bb38b2e4c909e4305cbdecb4551 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 02728bb38b2e4c909e4305cbdecb4551; no voters:
I20260805 22:51:17.585929 14069 leader_election.cc:288] T 00000000000000000000000000000000 P 02728bb38b2e4c909e4305cbdecb4551 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:51:17.585984 14077 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 02728bb38b2e4c909e4305cbdecb4551 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:51:17.586138 14077 raft_consensus.cc:686] T 00000000000000000000000000000000 P 02728bb38b2e4c909e4305cbdecb4551 [term 1 LEADER]: Becoming Leader. State: Replica: 02728bb38b2e4c909e4305cbdecb4551, State: Running, Role: LEADER
I20260805 22:51:17.586212 14069 sys_catalog.cc:564] T 00000000000000000000000000000000 P 02728bb38b2e4c909e4305cbdecb4551 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:51:17.586283 14077 consensus_queue.cc:237] T 00000000000000000000000000000000 P 02728bb38b2e4c909e4305cbdecb4551 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02728bb38b2e4c909e4305cbdecb4551" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32905 } }
I20260805 22:51:17.586704 14079 sys_catalog.cc:455] T 00000000000000000000000000000000 P 02728bb38b2e4c909e4305cbdecb4551 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 02728bb38b2e4c909e4305cbdecb4551. Latest consensus state: current_term: 1 leader_uuid: "02728bb38b2e4c909e4305cbdecb4551" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02728bb38b2e4c909e4305cbdecb4551" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32905 } } }
I20260805 22:51:17.586843 14079 sys_catalog.cc:458] T 00000000000000000000000000000000 P 02728bb38b2e4c909e4305cbdecb4551 [sys.catalog]: This master's current role is: LEADER
I20260805 22:51:17.587491 14078 sys_catalog.cc:455] T 00000000000000000000000000000000 P 02728bb38b2e4c909e4305cbdecb4551 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "02728bb38b2e4c909e4305cbdecb4551" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02728bb38b2e4c909e4305cbdecb4551" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32905 } } }
I20260805 22:51:17.587575 14078 sys_catalog.cc:458] T 00000000000000000000000000000000 P 02728bb38b2e4c909e4305cbdecb4551 [sys.catalog]: This master's current role is: LEADER
W20260805 22:51:17.588142 14101 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 02728bb38b2e4c909e4305cbdecb4551: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260805 22:51:17.588204 14101 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260805 22:51:17.588366 14074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:17.577389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.164:43455 (local address 127.0.0.1:32905)
0805 22:51:17.577582 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:17.577592 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:17.577627 (+ 35us) server_negotiation.cc:407] Connection header received
0805 22:51:17.578033 (+ 406us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:17.578043 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:17.578111 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:17.578274 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:17.578951 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:17.580325 (+ 1374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:17.581100 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:17.581682 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:17.581778 (+ 96us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:17.584089 (+ 2311us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:17.584093 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:17.584094 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:51:17.584108 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:17.586066 (+ 1958us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:17.586507 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:17.586510 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:17.586511 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:17.586620 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:17.586926 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:17.586927 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:17.586927 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:17.587285 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:17.587456 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:17.588019 (+ 563us) server_negotiation.cc:299] Negotiation successful
0805 22:51:17.588127 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":88,"threads_started":1}
I20260805 22:51:17.588433 14088 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:51:17.588598 14088 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:51:17.589390 15234 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:51:17.590317 14088 catalog_manager.cc:1347] Generated new cluster ID: f1f13707cfaa4305a69fc479a90fd492
I20260805 22:51:17.590420 14088 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:51:17.599155 14074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:17.591541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.164:47705 (local address 127.0.0.1:32905)
0805 22:51:17.591589 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:17.591591 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:17.591735 (+ 144us) server_negotiation.cc:407] Connection header received
0805 22:51:17.591798 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:17.591799 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:17.591809 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:17.591855 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:17.592502 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:17.593229 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:17.594231 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:17.594567 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:17.594622 (+ 55us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:17.596095 (+ 1473us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:17.596097 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:17.596098 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:51:17.596105 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:17.597646 (+ 1541us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:17.598283 (+ 637us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:17.598285 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:17.598285 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:17.598360 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:17.598616 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:17.598617 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:17.598617 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:17.598751 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:17.598845 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:17.598982 (+ 137us) server_negotiation.cc:299] Negotiation successful
0805 22:51:17.599056 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":19}
I20260805 22:51:17.607069 14088 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:51:17.607632 14088 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:51:17.615020 14088 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 02728bb38b2e4c909e4305cbdecb4551: Generated new TSK 0
I20260805 22:51:17.615216 14088 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:51:17.618912 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 13974
W20260805 22:51:17.637718 13953 connection.cc:535] client connection to 127.0.0.1:32905 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:32905): Connection reset by peer (error 104)
2026-08-05T22:51:17Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1431 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970021300824-15234-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:51:17 dist-test-slave-gjrz krb5kdc[14113](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:51:17 dist-test-slave-gjrz krb5kdc[14113](info): set up 2 sockets
Aug 05 22:51:17 dist-test-slave-gjrz krb5kdc[14113](info): commencing operation
krb5kdc: starting...
W20260805 22:51:18.755153 15234 mini_kdc.cc:121] Time spent starting KDC: real 1.104s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Aug 05 22:51:18 dist-test-slave-gjrz krb5kdc[14113](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970278, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:51:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:51:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970021300824-15234-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970021300824-15234-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260805 22:51:18.882869 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970021300824-15234-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970021300824-15234-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970021300824-15234-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43309
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970021300824-15234-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42815
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43309
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:51:18.968241 14132 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:51:18.968499 14132 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:51:18.968525 14132 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:51:18.969762 14132 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:51:18.969806 14132 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:51:18.969820 14132 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:51:18.969831 14132 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:51:18.969842 14132 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:51:18.971434 14132 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42815
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970021300824-15234-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970021300824-15234-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43309
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970021300824-15234-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43309
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14132
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970021300824-15234-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:51:18.971663 14132 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:51:18.971859 14132 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:51:18.976806 14138 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:51:18.976997 14132 server_base.cc:1034] running on GCE node
W20260805 22:51:18.976818 14141 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:18.976818 14139 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:51:18.977329 14132 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:51:18.977628 14132 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:51:18.978780 14132 hybrid_clock.cc:648] HybridClock initialized: now 1785970278978763 us; error 34 us; skew 500 ppm
Aug 05 22:51:18 dist-test-slave-gjrz krb5kdc[14113](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970278, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:51:18.981200 14132 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260805 22:51:18.981688 14132 webserver.cc:460] Webserver started at http://127.0.0.1:42211/ using document root <none> and password file <none>
I20260805 22:51:18.981925 14132 fs_manager.cc:359] Metadata directory not provided
I20260805 22:51:18.981976 14132 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:51:18.982100 14132 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:51:18.983166 14132 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970021300824-15234-0/minicluster-data/master-0/data/instance:
uuid: "b67d04e30b334bb2a3bab809553f2c97"
format_stamp: "Formatted at 2026-08-05 22:51:18 on dist-test-slave-gjrz"
server_key: "33d23abeca4956d2e005d8325db427c1"
server_key_iv: "7830e90b26831b0326385d49399a1f02"
server_key_version: "encryptionkey@0"
I20260805 22:51:18.983569 14132 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970021300824-15234-0/minicluster-data/master-0/wal/instance:
uuid: "b67d04e30b334bb2a3bab809553f2c97"
format_stamp: "Formatted at 2026-08-05 22:51:18 on dist-test-slave-gjrz"
server_key: "33d23abeca4956d2e005d8325db427c1"
server_key_iv: "7830e90b26831b0326385d49399a1f02"
server_key_version: "encryptionkey@0"
I20260805 22:51:18.984882 14132 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:51:18.985589 14154 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:18.985724 14132 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260805 22:51:18.985812 14132 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970021300824-15234-0/minicluster-data/master-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970021300824-15234-0/minicluster-data/master-0/wal
uuid: "b67d04e30b334bb2a3bab809553f2c97"
format_stamp: "Formatted at 2026-08-05 22:51:18 on dist-test-slave-gjrz"
server_key: "33d23abeca4956d2e005d8325db427c1"
server_key_iv: "7830e90b26831b0326385d49399a1f02"
server_key_version: "encryptionkey@0"
I20260805 22:51:18.985879 14132 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970021300824-15234-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970021300824-15234-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970021300824-15234-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:51:19.003489 14132 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:51:19.005725 14132 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:51:19.005879 14132 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:51:19.010403 14132 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43309
I20260805 22:51:19.010439 14225 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43309 every 8 connection(s)
I20260805 22:51:19.010813 14132 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
I20260805 22:51:19.011819 14228 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:51:19.014246 14228 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b67d04e30b334bb2a3bab809553f2c97: Bootstrap starting.
I20260805 22:51:19.014930 14228 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b67d04e30b334bb2a3bab809553f2c97: Neither blocks nor log segments found. Creating new log.
I20260805 22:51:19.015195 14228 log.cc:824] T 00000000000000000000000000000000 P b67d04e30b334bb2a3bab809553f2c97: Log is configured to *not* fsync() on all Append() calls
I20260805 22:51:19.015995 14228 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b67d04e30b334bb2a3bab809553f2c97: No bootstrap required, opened a new log
I20260805 22:51:19.017673 14228 raft_consensus.cc:348] T 00000000000000000000000000000000 P b67d04e30b334bb2a3bab809553f2c97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b67d04e30b334bb2a3bab809553f2c97" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43309 } }
I20260805 22:51:19.017839 14228 raft_consensus.cc:374] T 00000000000000000000000000000000 P b67d04e30b334bb2a3bab809553f2c97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:51:19.017863 14228 raft_consensus.cc:729] T 00000000000000000000000000000000 P b67d04e30b334bb2a3bab809553f2c97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b67d04e30b334bb2a3bab809553f2c97, State: Initialized, Role: FOLLOWER
I20260805 22:51:19.017992 14228 consensus_queue.cc:260] T 00000000000000000000000000000000 P b67d04e30b334bb2a3bab809553f2c97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b67d04e30b334bb2a3bab809553f2c97" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43309 } }
I20260805 22:51:19.018083 14228 raft_consensus.cc:388] T 00000000000000000000000000000000 P b67d04e30b334bb2a3bab809553f2c97 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:51:19.018114 14228 raft_consensus.cc:482] T 00000000000000000000000000000000 P b67d04e30b334bb2a3bab809553f2c97 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:51:19.018151 14228 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b67d04e30b334bb2a3bab809553f2c97 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:51:19.018734 14228 raft_consensus.cc:504] T 00000000000000000000000000000000 P b67d04e30b334bb2a3bab809553f2c97 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b67d04e30b334bb2a3bab809553f2c97" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43309 } }
I20260805 22:51:19.018847 14228 leader_election.cc:302] T 00000000000000000000000000000000 P b67d04e30b334bb2a3bab809553f2c97 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b67d04e30b334bb2a3bab809553f2c97; no voters:
I20260805 22:51:19.019057 14228 leader_election.cc:288] T 00000000000000000000000000000000 P b67d04e30b334bb2a3bab809553f2c97 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:51:19.019115 14232 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b67d04e30b334bb2a3bab809553f2c97 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:51:19.019140 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 14132
I20260805 22:51:19.019299 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970021300824-15234-0/minicluster-data/master-0/wal/instance
I20260805 22:51:19.019313 14232 raft_consensus.cc:686] T 00000000000000000000000000000000 P b67d04e30b334bb2a3bab809553f2c97 [term 1 LEADER]: Becoming Leader. State: Replica: b67d04e30b334bb2a3bab809553f2c97, State: Running, Role: LEADER
I20260805 22:51:19.019407 14228 sys_catalog.cc:564] T 00000000000000000000000000000000 P b67d04e30b334bb2a3bab809553f2c97 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:51:19.019416 14232 consensus_queue.cc:237] T 00000000000000000000000000000000 P b67d04e30b334bb2a3bab809553f2c97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b67d04e30b334bb2a3bab809553f2c97" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43309 } }
I20260805 22:51:19.019542 15234 external_mini_cluster.cc:1428] Setting key 19f81094e0637cf8ca2ff218779e0deb
I20260805 22:51:19.019961 14233 sys_catalog.cc:455] T 00000000000000000000000000000000 P b67d04e30b334bb2a3bab809553f2c97 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b67d04e30b334bb2a3bab809553f2c97" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b67d04e30b334bb2a3bab809553f2c97" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43309 } } }
I20260805 22:51:19.019997 14234 sys_catalog.cc:455] T 00000000000000000000000000000000 P b67d04e30b334bb2a3bab809553f2c97 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b67d04e30b334bb2a3bab809553f2c97. Latest consensus state: current_term: 1 leader_uuid: "b67d04e30b334bb2a3bab809553f2c97" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b67d04e30b334bb2a3bab809553f2c97" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43309 } } }
I20260805 22:51:19.020150 14234 sys_catalog.cc:458] T 00000000000000000000000000000000 P b67d04e30b334bb2a3bab809553f2c97 [sys.catalog]: This master's current role is: LEADER
I20260805 22:51:19.020357 14233 sys_catalog.cc:458] T 00000000000000000000000000000000 P b67d04e30b334bb2a3bab809553f2c97 [sys.catalog]: This master's current role is: LEADER
I20260805 22:51:19.020547 14246 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:51:19.021132 14246 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:51:19.022672 14246 catalog_manager.cc:1347] Generated new cluster ID: db238ffb9aaf4a9fa1df1ee3d564ebb4
I20260805 22:51:19.022722 14246 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:51:19.026350 14247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:19.020280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.164:60355 (local address 127.0.0.1:43309)
0805 22:51:19.020476 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:19.020487 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:19.020739 (+ 252us) server_negotiation.cc:407] Connection header received
0805 22:51:19.020878 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:19.020887 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:19.020981 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:19.021116 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:19.021479 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:19.022868 (+ 1389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:19.023982 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:19.024755 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:19.024887 (+ 132us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:19.025602 (+ 715us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:19.025607 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:19.025608 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:51:19.025821 (+ 213us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:19.025864 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:51:19.025881 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:19.026015 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:19.026083 (+ 68us) server_negotiation.cc:299] Negotiation successful
0805 22:51:19.026117 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":65,"threads_started":1}
I20260805 22:51:19.027838 15234 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:51:19.033360 14247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:19.029509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.164:55715 (local address 127.0.0.1:43309)
0805 22:51:19.029548 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:19.029550 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:19.029675 (+ 125us) server_negotiation.cc:407] Connection header received
0805 22:51:19.029725 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:19.029726 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:19.029739 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:19.029800 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:19.029936 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:19.030800 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:19.031987 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:19.032315 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:19.032381 (+ 66us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:19.033111 (+ 730us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:19.033113 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:19.033113 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:51:19.033119 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:19.033136 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:51:19.033141 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:19.033201 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:19.033258 (+ 57us) server_negotiation.cc:299] Negotiation successful
0805 22:51:19.033272 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260805 22:51:19.036773 14246 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:51:19.037551 14246 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:51:19.044072 14246 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b67d04e30b334bb2a3bab809553f2c97: Generated new TSK 0
I20260805 22:51:19.044273 14246 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:51:19.048774 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 14132
W20260805 22:51:19.069087 14111 connection.cc:535] client connection to 127.0.0.1:43309 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43309): Connection reset by peer (error 104)
2026-08-05T22:51:19Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1431 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970021300824-15234-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:51:19 dist-test-slave-gjrz krb5kdc[14273](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:51:19 dist-test-slave-gjrz krb5kdc[14273](info): set up 2 sockets
Aug 05 22:51:19 dist-test-slave-gjrz krb5kdc[14273](info): commencing operation
krb5kdc: starting...
W20260805 22:51:20.184257 15234 mini_kdc.cc:121] Time spent starting KDC: real 1.102s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Aug 05 22:51:20 dist-test-slave-gjrz krb5kdc[14273](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970280, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:51:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:51:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970021300824-15234-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970021300824-15234-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260805 22:51:20.311425 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970021300824-15234-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970021300824-15234-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970021300824-15234-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45243
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970021300824-15234-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43891
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45243
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:51:20.395776 14289 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:51:20.395999 14289 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:51:20.396023 14289 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:51:20.397259 14289 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:51:20.397313 14289 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:51:20.397326 14289 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:51:20.397337 14289 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:51:20.397347 14289 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:51:20.398909 14289 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43891
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970021300824-15234-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970021300824-15234-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45243
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970021300824-15234-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45243
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14289
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970021300824-15234-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:51:20.399143 14289 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:51:20.399366 14289 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:51:20.404385 14296 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:20.404381 14298 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:51:20.404422 14289 server_base.cc:1034] running on GCE node
W20260805 22:51:20.404412 14302 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:51:20.404982 14289 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:51:20.405308 14289 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:51:20.406445 14289 hybrid_clock.cc:648] HybridClock initialized: now 1785970280406437 us; error 31 us; skew 500 ppm
Aug 05 22:51:20 dist-test-slave-gjrz krb5kdc[14273](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970280, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:51:20.408905 14289 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260805 22:51:20.409376 14289 webserver.cc:460] Webserver started at http://127.0.0.1:39451/ using document root <none> and password file <none>
I20260805 22:51:20.409588 14289 fs_manager.cc:359] Metadata directory not provided
I20260805 22:51:20.409639 14289 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:51:20.409770 14289 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:51:20.410831 14289 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970021300824-15234-0/minicluster-data/master-0/data/instance:
uuid: "f583f12999a2412b8efd4961db388dbd"
format_stamp: "Formatted at 2026-08-05 22:51:20 on dist-test-slave-gjrz"
server_key: "d8534986b44f3ab2027e87acc744eed1"
server_key_iv: "48c0e81808315b7f83dd4db0d4f9be45"
server_key_version: "encryptionkey@0"
I20260805 22:51:20.411178 14289 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970021300824-15234-0/minicluster-data/master-0/wal/instance:
uuid: "f583f12999a2412b8efd4961db388dbd"
format_stamp: "Formatted at 2026-08-05 22:51:20 on dist-test-slave-gjrz"
server_key: "d8534986b44f3ab2027e87acc744eed1"
server_key_iv: "48c0e81808315b7f83dd4db0d4f9be45"
server_key_version: "encryptionkey@0"
I20260805 22:51:20.412530 14289 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:51:20.413270 14312 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:20.413427 14289 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260805 22:51:20.413516 14289 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970021300824-15234-0/minicluster-data/master-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970021300824-15234-0/minicluster-data/master-0/wal
uuid: "f583f12999a2412b8efd4961db388dbd"
format_stamp: "Formatted at 2026-08-05 22:51:20 on dist-test-slave-gjrz"
server_key: "d8534986b44f3ab2027e87acc744eed1"
server_key_iv: "48c0e81808315b7f83dd4db0d4f9be45"
server_key_version: "encryptionkey@0"
I20260805 22:51:20.413579 14289 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970021300824-15234-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970021300824-15234-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970021300824-15234-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:51:20.416975 14289 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:51:20.419083 14289 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:51:20.419229 14289 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:51:20.423409 14289 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45243
I20260805 22:51:20.423444 14386 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45243 every 8 connection(s)
I20260805 22:51:20.423796 14289 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
I20260805 22:51:20.424847 14391 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:51:20.427198 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 14289
I20260805 22:51:20.427361 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970021300824-15234-0/minicluster-data/master-0/wal/instance
I20260805 22:51:20.427392 14391 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f583f12999a2412b8efd4961db388dbd: Bootstrap starting.
I20260805 22:51:20.427590 15234 external_mini_cluster.cc:1428] Setting key f27963ac9e6510982854ad86ed6ec4fb
I20260805 22:51:20.428077 14391 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f583f12999a2412b8efd4961db388dbd: Neither blocks nor log segments found. Creating new log.
I20260805 22:51:20.428423 14391 log.cc:824] T 00000000000000000000000000000000 P f583f12999a2412b8efd4961db388dbd: Log is configured to *not* fsync() on all Append() calls
I20260805 22:51:20.429281 14391 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f583f12999a2412b8efd4961db388dbd: No bootstrap required, opened a new log
I20260805 22:51:20.430152 14394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:20.428105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.164:44647 (local address 127.0.0.1:45243)
0805 22:51:20.428297 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:20.428305 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:20.428332 (+ 27us) server_negotiation.cc:407] Connection header received
0805 22:51:20.428900 (+ 568us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:20.428911 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:20.428957 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:20.429083 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:20.429735 (+ 652us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:20.429739 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:20.429739 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:51:20.429743 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:20.429783 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:51:20.429793 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:20.429860 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:20.429916 (+ 56us) server_negotiation.cc:299] Negotiation successful
0805 22:51:20.429960 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":84,"threads_started":1}
I20260805 22:51:20.431309 15234 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:51:20.431736 14391 raft_consensus.cc:348] T 00000000000000000000000000000000 P f583f12999a2412b8efd4961db388dbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f583f12999a2412b8efd4961db388dbd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45243 } }
I20260805 22:51:20.431888 14391 raft_consensus.cc:374] T 00000000000000000000000000000000 P f583f12999a2412b8efd4961db388dbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:51:20.431910 14391 raft_consensus.cc:729] T 00000000000000000000000000000000 P f583f12999a2412b8efd4961db388dbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f583f12999a2412b8efd4961db388dbd, State: Initialized, Role: FOLLOWER
I20260805 22:51:20.432032 14391 consensus_queue.cc:260] T 00000000000000000000000000000000 P f583f12999a2412b8efd4961db388dbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f583f12999a2412b8efd4961db388dbd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45243 } }
I20260805 22:51:20.432121 14391 raft_consensus.cc:388] T 00000000000000000000000000000000 P f583f12999a2412b8efd4961db388dbd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:51:20.432147 14391 raft_consensus.cc:482] T 00000000000000000000000000000000 P f583f12999a2412b8efd4961db388dbd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:51:20.432195 14391 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f583f12999a2412b8efd4961db388dbd [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:51:20.432878 14391 raft_consensus.cc:504] T 00000000000000000000000000000000 P f583f12999a2412b8efd4961db388dbd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f583f12999a2412b8efd4961db388dbd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45243 } }
I20260805 22:51:20.433005 14391 leader_election.cc:302] T 00000000000000000000000000000000 P f583f12999a2412b8efd4961db388dbd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f583f12999a2412b8efd4961db388dbd; no voters:
I20260805 22:51:20.433192 14391 leader_election.cc:288] T 00000000000000000000000000000000 P f583f12999a2412b8efd4961db388dbd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:51:20.433220 14403 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f583f12999a2412b8efd4961db388dbd [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:51:20.433466 14391 sys_catalog.cc:564] T 00000000000000000000000000000000 P f583f12999a2412b8efd4961db388dbd [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:51:20.433670 14403 raft_consensus.cc:686] T 00000000000000000000000000000000 P f583f12999a2412b8efd4961db388dbd [term 1 LEADER]: Becoming Leader. State: Replica: f583f12999a2412b8efd4961db388dbd, State: Running, Role: LEADER
I20260805 22:51:20.433836 14403 consensus_queue.cc:237] T 00000000000000000000000000000000 P f583f12999a2412b8efd4961db388dbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f583f12999a2412b8efd4961db388dbd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45243 } }
I20260805 22:51:20.434000 14394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:20.432820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.164:41233 (local address 127.0.0.1:45243)
0805 22:51:20.432863 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:20.432865 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:20.432922 (+ 57us) server_negotiation.cc:407] Connection header received
0805 22:51:20.432994 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:20.432995 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:20.433000 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:20.433059 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:20.433703 (+ 644us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:20.433704 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:20.433704 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:51:20.433709 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:20.433723 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:51:20.433727 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:20.433916 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:20.433934 (+ 18us) server_negotiation.cc:299] Negotiation successful
0805 22:51:20.433947 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260805 22:51:20.434492 14404 sys_catalog.cc:455] T 00000000000000000000000000000000 P f583f12999a2412b8efd4961db388dbd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f583f12999a2412b8efd4961db388dbd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f583f12999a2412b8efd4961db388dbd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45243 } } }
I20260805 22:51:20.434599 14404 sys_catalog.cc:458] T 00000000000000000000000000000000 P f583f12999a2412b8efd4961db388dbd [sys.catalog]: This master's current role is: LEADER
I20260805 22:51:20.434798 14406 sys_catalog.cc:455] T 00000000000000000000000000000000 P f583f12999a2412b8efd4961db388dbd [sys.catalog]: SysCatalogTable state changed. Reason: New leader f583f12999a2412b8efd4961db388dbd. Latest consensus state: current_term: 1 leader_uuid: "f583f12999a2412b8efd4961db388dbd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f583f12999a2412b8efd4961db388dbd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45243 } } }
I20260805 22:51:20.434854 14406 sys_catalog.cc:458] T 00000000000000000000000000000000 P f583f12999a2412b8efd4961db388dbd [sys.catalog]: This master's current role is: LEADER
W20260805 22:51:20.435406 14421 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f583f12999a2412b8efd4961db388dbd: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260805 22:51:20.435456 14421 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260805 22:51:20.435518 14418 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:51:20.435701 14418 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:51:20.437229 14418 catalog_manager.cc:1347] Generated new cluster ID: 8c4336d95c6f4a1bbdf94e2b6bba86d4
I20260805 22:51:20.437276 14418 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:51:20.443718 14418 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:51:20.443881 14418 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:51:20.447535 14418 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f583f12999a2412b8efd4961db388dbd: Generated new TSK 0
I20260805 22:51:20.447703 14418 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:51:20.456091 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 14289
2026-08-05T22:51:20Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1402 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970021300824-15234-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:51:20 dist-test-slave-gjrz krb5kdc[14431](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:51:20 dist-test-slave-gjrz krb5kdc[14431](info): set up 2 sockets
Aug 05 22:51:20 dist-test-slave-gjrz krb5kdc[14431](info): commencing operation
krb5kdc: starting...
W20260805 22:51:21.589761 15234 mini_kdc.cc:121] Time spent starting KDC: real 1.105s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Aug 05 22:51:21 dist-test-slave-gjrz krb5kdc[14431](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970281, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:51:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:51:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970021300824-15234-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970021300824-15234-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260805 22:51:21.718487 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970021300824-15234-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970021300824-15234-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970021300824-15234-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43175
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970021300824-15234-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43175
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:51:21.802181 14454 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:51:21.802403 14454 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:51:21.802436 14454 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:51:21.803699 14454 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:51:21.803750 14454 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:51:21.803768 14454 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:51:21.803785 14454 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:51:21.803809 14454 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:51:21.805421 14454 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970021300824-15234-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970021300824-15234-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43175
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970021300824-15234-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43175
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14454
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970021300824-15234-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:51:21.805701 14454 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:51:21.805930 14454 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:51:21.811154 14467 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:21.811163 14463 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:51:21.811218 14454 server_base.cc:1034] running on GCE node
W20260805 22:51:21.811163 14462 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:51:21.811635 14454 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:51:21.811973 14454 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:51:21.813124 14454 hybrid_clock.cc:648] HybridClock initialized: now 1785970281813109 us; error 33 us; skew 500 ppm
Aug 05 22:51:21 dist-test-slave-gjrz krb5kdc[14431](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970281, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:51:21.816277 14454 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260805 22:51:21.816720 14454 webserver.cc:460] Webserver started at http://127.0.0.1:33985/ using document root <none> and password file <none>
I20260805 22:51:21.816952 14454 fs_manager.cc:359] Metadata directory not provided
I20260805 22:51:21.817011 14454 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:51:21.817142 14454 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:51:21.818218 14454 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970021300824-15234-0/minicluster-data/master-0/data/instance:
uuid: "d984139fc9324f0bb859ed8ec7587a32"
format_stamp: "Formatted at 2026-08-05 22:51:21 on dist-test-slave-gjrz"
server_key: "92cf3ca112d09670ff217467b10c295a"
server_key_iv: "3d32893ebedcb3086415cb148ae73f5f"
server_key_version: "encryptionkey@0"
I20260805 22:51:21.818562 14454 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970021300824-15234-0/minicluster-data/master-0/wal/instance:
uuid: "d984139fc9324f0bb859ed8ec7587a32"
format_stamp: "Formatted at 2026-08-05 22:51:21 on dist-test-slave-gjrz"
server_key: "92cf3ca112d09670ff217467b10c295a"
server_key_iv: "3d32893ebedcb3086415cb148ae73f5f"
server_key_version: "encryptionkey@0"
I20260805 22:51:21.820050 14454 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260805 22:51:21.820874 14481 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:21.821092 14454 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:51:21.821264 14454 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970021300824-15234-0/minicluster-data/master-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970021300824-15234-0/minicluster-data/master-0/wal
uuid: "d984139fc9324f0bb859ed8ec7587a32"
format_stamp: "Formatted at 2026-08-05 22:51:21 on dist-test-slave-gjrz"
server_key: "92cf3ca112d09670ff217467b10c295a"
server_key_iv: "3d32893ebedcb3086415cb148ae73f5f"
server_key_version: "encryptionkey@0"
I20260805 22:51:21.821350 14454 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970021300824-15234-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970021300824-15234-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970021300824-15234-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:51:21.832234 14454 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:51:21.834165 14454 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:51:21.834324 14454 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:51:21.838419 14454 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43175
I20260805 22:51:21.838460 14546 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43175 every 8 connection(s)
I20260805 22:51:21.838848 14454 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
I20260805 22:51:21.839824 14547 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:51:21.842202 14547 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d984139fc9324f0bb859ed8ec7587a32: Bootstrap starting.
I20260805 22:51:21.842808 14547 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d984139fc9324f0bb859ed8ec7587a32: Neither blocks nor log segments found. Creating new log.
I20260805 22:51:21.843086 14547 log.cc:824] T 00000000000000000000000000000000 P d984139fc9324f0bb859ed8ec7587a32: Log is configured to *not* fsync() on all Append() calls
I20260805 22:51:21.843847 14547 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d984139fc9324f0bb859ed8ec7587a32: No bootstrap required, opened a new log
I20260805 22:51:21.844318 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 14454
I20260805 22:51:21.844426 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970021300824-15234-0/minicluster-data/master-0/wal/instance
I20260805 22:51:21.844604 15234 external_mini_cluster.cc:1428] Setting key b8e5168b38fabc5ad50b5e4d9b260370
I20260805 22:51:21.846405 14547 raft_consensus.cc:348] T 00000000000000000000000000000000 P d984139fc9324f0bb859ed8ec7587a32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d984139fc9324f0bb859ed8ec7587a32" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43175 } }
I20260805 22:51:21.846597 14547 raft_consensus.cc:374] T 00000000000000000000000000000000 P d984139fc9324f0bb859ed8ec7587a32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:51:21.846683 14547 raft_consensus.cc:729] T 00000000000000000000000000000000 P d984139fc9324f0bb859ed8ec7587a32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d984139fc9324f0bb859ed8ec7587a32, State: Initialized, Role: FOLLOWER
I20260805 22:51:21.846828 14547 consensus_queue.cc:260] T 00000000000000000000000000000000 P d984139fc9324f0bb859ed8ec7587a32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d984139fc9324f0bb859ed8ec7587a32" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43175 } }
I20260805 22:51:21.846907 14547 raft_consensus.cc:388] T 00000000000000000000000000000000 P d984139fc9324f0bb859ed8ec7587a32 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:51:21.846930 14547 raft_consensus.cc:482] T 00000000000000000000000000000000 P d984139fc9324f0bb859ed8ec7587a32 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:51:21.846976 14547 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d984139fc9324f0bb859ed8ec7587a32 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:51:21.847746 14547 raft_consensus.cc:504] T 00000000000000000000000000000000 P d984139fc9324f0bb859ed8ec7587a32 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d984139fc9324f0bb859ed8ec7587a32" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43175 } }
I20260805 22:51:21.847865 14547 leader_election.cc:302] T 00000000000000000000000000000000 P d984139fc9324f0bb859ed8ec7587a32 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d984139fc9324f0bb859ed8ec7587a32; no voters:
I20260805 22:51:21.848033 14547 leader_election.cc:288] T 00000000000000000000000000000000 P d984139fc9324f0bb859ed8ec7587a32 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:51:21.848096 14554 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d984139fc9324f0bb859ed8ec7587a32 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:51:21.848318 14547 sys_catalog.cc:564] T 00000000000000000000000000000000 P d984139fc9324f0bb859ed8ec7587a32 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:51:21.848337 14554 raft_consensus.cc:686] T 00000000000000000000000000000000 P d984139fc9324f0bb859ed8ec7587a32 [term 1 LEADER]: Becoming Leader. State: Replica: d984139fc9324f0bb859ed8ec7587a32, State: Running, Role: LEADER
I20260805 22:51:21.848433 14554 consensus_queue.cc:237] T 00000000000000000000000000000000 P d984139fc9324f0bb859ed8ec7587a32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d984139fc9324f0bb859ed8ec7587a32" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43175 } }
I20260805 22:51:21.848822 14554 sys_catalog.cc:455] T 00000000000000000000000000000000 P d984139fc9324f0bb859ed8ec7587a32 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d984139fc9324f0bb859ed8ec7587a32. Latest consensus state: current_term: 1 leader_uuid: "d984139fc9324f0bb859ed8ec7587a32" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d984139fc9324f0bb859ed8ec7587a32" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43175 } } }
I20260805 22:51:21.848888 14555 sys_catalog.cc:455] T 00000000000000000000000000000000 P d984139fc9324f0bb859ed8ec7587a32 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d984139fc9324f0bb859ed8ec7587a32" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d984139fc9324f0bb859ed8ec7587a32" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43175 } } }
I20260805 22:51:21.848964 14554 sys_catalog.cc:458] T 00000000000000000000000000000000 P d984139fc9324f0bb859ed8ec7587a32 [sys.catalog]: This master's current role is: LEADER
I20260805 22:51:21.848970 14555 sys_catalog.cc:458] T 00000000000000000000000000000000 P d984139fc9324f0bb859ed8ec7587a32 [sys.catalog]: This master's current role is: LEADER
I20260805 22:51:21.849265 14568 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:51:21.850054 14568 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 05 22:51:21 dist-test-slave-gjrz krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970281, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260805 22:51:21.852876 14568 catalog_manager.cc:1347] Generated new cluster ID: 1b78309a4f5146628e426fa2fcf11056
I20260805 22:51:21.852921 14568 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:51:21.857990 14553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:21.845162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.164:57859 (local address 127.0.0.1:43175)
0805 22:51:21.845373 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:21.845384 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:21.845423 (+ 39us) server_negotiation.cc:407] Connection header received
0805 22:51:21.846320 (+ 897us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:21.846332 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:21.846406 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:21.846573 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:21.847342 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:21.848712 (+ 1370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:21.849846 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:21.850420 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:21.850530 (+ 110us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:21.853329 (+ 2799us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:21.853334 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:21.853334 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:51:21.853347 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:21.855888 (+ 2541us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:21.856406 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:21.856409 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:21.856409 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:21.856523 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:21.856756 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:21.856757 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:21.856757 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:21.857061 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:21.857548 (+ 487us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:21.857649 (+ 101us) server_negotiation.cc:299] Negotiation successful
0805 22:51:21.857759 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":105,"threads_started":1}
I20260805 22:51:21.859174 15234 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:51:21.861431 14568 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:51:21.862123 14568 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:51:21.867631 14568 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d984139fc9324f0bb859ed8ec7587a32: Generated new TSK 0
I20260805 22:51:21.867830 14568 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:51:21.868288 14553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:21.860668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.164:37525 (local address 127.0.0.1:43175)
0805 22:51:21.860705 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:21.860707 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:21.860838 (+ 131us) server_negotiation.cc:407] Connection header received
0805 22:51:21.860903 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:21.860904 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:21.860913 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:21.860972 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:21.861604 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:21.862315 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:21.863378 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:21.863701 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:21.863759 (+ 58us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:21.865266 (+ 1507us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:21.865267 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:21.865267 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:51:21.865273 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:21.866868 (+ 1595us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:21.867392 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:21.867393 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:21.867394 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:21.867461 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:21.867690 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:21.867691 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:21.867691 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:21.867827 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:21.867927 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:21.868172 (+ 245us) server_negotiation.cc:299] Negotiation successful
0805 22:51:21.868232 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260805 22:51:21.870383 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 14454
W20260805 22:51:21.886140 14427 connection.cc:535] client connection to 127.0.0.1:43175 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43175): Connection reset by peer (error 104)
2026-08-05T22:51:21Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1415 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970021300824-15234-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:51:21 dist-test-slave-gjrz krb5kdc[14590](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:51:21 dist-test-slave-gjrz krb5kdc[14590](info): set up 2 sockets
Aug 05 22:51:21 dist-test-slave-gjrz krb5kdc[14590](info): commencing operation
krb5kdc: starting...
W20260805 22:51:23.019590 15234 mini_kdc.cc:121] Time spent starting KDC: real 1.120s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Aug 05 22:51:23 dist-test-slave-gjrz krb5kdc[14590](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970283, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:51:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:51:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970021300824-15234-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970021300824-15234-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260805 22:51:23.146509 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970021300824-15234-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970021300824-15234-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970021300824-15234-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37197
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970021300824-15234-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45619
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37197
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:51:23.228786 14611 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:51:23.229008 14611 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:51:23.229030 14611 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:51:23.230188 14611 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:51:23.230235 14611 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:51:23.230248 14611 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:51:23.230259 14611 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:51:23.230269 14611 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:51:23.231792 14611 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45619
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970021300824-15234-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970021300824-15234-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37197
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970021300824-15234-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37197
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14611
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970021300824-15234-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:51:23.232030 14611 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:51:23.232246 14611 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:51:23.236971 14626 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:23.237021 14622 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:23.236986 14619 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:51:23.237301 14611 server_base.cc:1034] running on GCE node
I20260805 22:51:23.237542 14611 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:51:23.237841 14611 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:51:23.238988 14611 hybrid_clock.cc:648] HybridClock initialized: now 1785970283238970 us; error 35 us; skew 500 ppm
Aug 05 22:51:23 dist-test-slave-gjrz krb5kdc[14590](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970283, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:51:23.245719 14611 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260805 22:51:23.246222 14611 webserver.cc:460] Webserver started at http://127.0.0.1:45115/ using document root <none> and password file <none>
I20260805 22:51:23.246438 14611 fs_manager.cc:359] Metadata directory not provided
I20260805 22:51:23.246492 14611 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:51:23.246609 14611 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:51:23.247788 14611 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970021300824-15234-0/minicluster-data/master-0/data/instance:
uuid: "44e0a3cde9dd4ca78265dc995103c8e5"
format_stamp: "Formatted at 2026-08-05 22:51:23 on dist-test-slave-gjrz"
server_key: "669eb0e91f7d6294a5d8591c7b46bace"
server_key_iv: "07ebcdc12a8a9a62c2e8ff7db31d0ea4"
server_key_version: "encryptionkey@0"
I20260805 22:51:23.248133 14611 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970021300824-15234-0/minicluster-data/master-0/wal/instance:
uuid: "44e0a3cde9dd4ca78265dc995103c8e5"
format_stamp: "Formatted at 2026-08-05 22:51:23 on dist-test-slave-gjrz"
server_key: "669eb0e91f7d6294a5d8591c7b46bace"
server_key_iv: "07ebcdc12a8a9a62c2e8ff7db31d0ea4"
server_key_version: "encryptionkey@0"
I20260805 22:51:23.249521 14611 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260805 22:51:23.250344 14640 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:23.250532 14611 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:51:23.250625 14611 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970021300824-15234-0/minicluster-data/master-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970021300824-15234-0/minicluster-data/master-0/wal
uuid: "44e0a3cde9dd4ca78265dc995103c8e5"
format_stamp: "Formatted at 2026-08-05 22:51:23 on dist-test-slave-gjrz"
server_key: "669eb0e91f7d6294a5d8591c7b46bace"
server_key_iv: "07ebcdc12a8a9a62c2e8ff7db31d0ea4"
server_key_version: "encryptionkey@0"
I20260805 22:51:23.250690 14611 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970021300824-15234-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970021300824-15234-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970021300824-15234-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:51:23.259928 14611 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:51:23.261912 14611 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:51:23.262068 14611 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:51:23.266106 14611 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37197
I20260805 22:51:23.266141 14712 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37197 every 8 connection(s)
I20260805 22:51:23.266492 14611 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
I20260805 22:51:23.267372 14714 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:51:23.269796 14714 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 44e0a3cde9dd4ca78265dc995103c8e5: Bootstrap starting.
I20260805 22:51:23.270381 14714 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 44e0a3cde9dd4ca78265dc995103c8e5: Neither blocks nor log segments found. Creating new log.
I20260805 22:51:23.270656 14714 log.cc:824] T 00000000000000000000000000000000 P 44e0a3cde9dd4ca78265dc995103c8e5: Log is configured to *not* fsync() on all Append() calls
I20260805 22:51:23.271401 14714 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 44e0a3cde9dd4ca78265dc995103c8e5: No bootstrap required, opened a new log
I20260805 22:51:23.272370 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 14611
I20260805 22:51:23.272495 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970021300824-15234-0/minicluster-data/master-0/wal/instance
I20260805 22:51:23.272712 15234 external_mini_cluster.cc:1428] Setting key 4cb49ac3355748be8ff27336516c90e4
I20260805 22:51:23.273367 14714 raft_consensus.cc:348] T 00000000000000000000000000000000 P 44e0a3cde9dd4ca78265dc995103c8e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44e0a3cde9dd4ca78265dc995103c8e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37197 } }
I20260805 22:51:23.273537 14714 raft_consensus.cc:374] T 00000000000000000000000000000000 P 44e0a3cde9dd4ca78265dc995103c8e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:51:23.273571 14714 raft_consensus.cc:729] T 00000000000000000000000000000000 P 44e0a3cde9dd4ca78265dc995103c8e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44e0a3cde9dd4ca78265dc995103c8e5, State: Initialized, Role: FOLLOWER
I20260805 22:51:23.273701 14714 consensus_queue.cc:260] T 00000000000000000000000000000000 P 44e0a3cde9dd4ca78265dc995103c8e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44e0a3cde9dd4ca78265dc995103c8e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37197 } }
I20260805 22:51:23.273768 14714 raft_consensus.cc:388] T 00000000000000000000000000000000 P 44e0a3cde9dd4ca78265dc995103c8e5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:51:23.273790 14714 raft_consensus.cc:482] T 00000000000000000000000000000000 P 44e0a3cde9dd4ca78265dc995103c8e5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:51:23.273837 14714 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 44e0a3cde9dd4ca78265dc995103c8e5 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:51:23.274909 14714 raft_consensus.cc:504] T 00000000000000000000000000000000 P 44e0a3cde9dd4ca78265dc995103c8e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44e0a3cde9dd4ca78265dc995103c8e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37197 } }
I20260805 22:51:23.275003 14714 leader_election.cc:302] T 00000000000000000000000000000000 P 44e0a3cde9dd4ca78265dc995103c8e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 44e0a3cde9dd4ca78265dc995103c8e5; no voters:
I20260805 22:51:23.275146 14714 leader_election.cc:288] T 00000000000000000000000000000000 P 44e0a3cde9dd4ca78265dc995103c8e5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:51:23.275197 14723 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 44e0a3cde9dd4ca78265dc995103c8e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:51:23.275400 14723 raft_consensus.cc:686] T 00000000000000000000000000000000 P 44e0a3cde9dd4ca78265dc995103c8e5 [term 1 LEADER]: Becoming Leader. State: Replica: 44e0a3cde9dd4ca78265dc995103c8e5, State: Running, Role: LEADER
I20260805 22:51:23.275434 14714 sys_catalog.cc:564] T 00000000000000000000000000000000 P 44e0a3cde9dd4ca78265dc995103c8e5 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:51:23.275558 14723 consensus_queue.cc:237] T 00000000000000000000000000000000 P 44e0a3cde9dd4ca78265dc995103c8e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44e0a3cde9dd4ca78265dc995103c8e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37197 } }
I20260805 22:51:23.276350 14724 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44e0a3cde9dd4ca78265dc995103c8e5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "44e0a3cde9dd4ca78265dc995103c8e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44e0a3cde9dd4ca78265dc995103c8e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37197 } } }
I20260805 22:51:23.276358 14725 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44e0a3cde9dd4ca78265dc995103c8e5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 44e0a3cde9dd4ca78265dc995103c8e5. Latest consensus state: current_term: 1 leader_uuid: "44e0a3cde9dd4ca78265dc995103c8e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44e0a3cde9dd4ca78265dc995103c8e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37197 } } }
I20260805 22:51:23.276517 14724 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44e0a3cde9dd4ca78265dc995103c8e5 [sys.catalog]: This master's current role is: LEADER
I20260805 22:51:23.276523 14725 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44e0a3cde9dd4ca78265dc995103c8e5 [sys.catalog]: This master's current role is: LEADER
I20260805 22:51:23.276789 14733 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:51:23.277309 14733 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:51:23.279085 14722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:23.273282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.164:38543 (local address 127.0.0.1:37197)
0805 22:51:23.273492 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:23.273500 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:23.273530 (+ 30us) server_negotiation.cc:407] Connection header received
0805 22:51:23.273657 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:23.273664 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:23.273714 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:23.273843 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:23.274186 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:23.275164 (+ 978us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:23.276361 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:23.277005 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:23.277113 (+ 108us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:23.278316 (+ 1203us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:23.278320 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:23.278321 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:51:23.278583 (+ 262us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:23.278618 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:51:23.278631 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:23.278722 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:23.278848 (+ 126us) server_negotiation.cc:299] Negotiation successful
0805 22:51:23.278876 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":104,"threads_started":1}
I20260805 22:51:23.279109 14733 catalog_manager.cc:1347] Generated new cluster ID: 41efa9e4808246e6bdff3cb465c8ce5b
I20260805 22:51:23.279155 14733 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:51:23.279990 15234 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:51:23.284155 14722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:23.281283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.164:37927 (local address 127.0.0.1:37197)
0805 22:51:23.281370 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:23.281372 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:23.281469 (+ 97us) server_negotiation.cc:407] Connection header received
0805 22:51:23.281526 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:23.281527 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:23.281537 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:23.281577 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:23.281705 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:23.282282 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:23.282986 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:23.283213 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:23.283293 (+ 80us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:23.283908 (+ 615us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:23.283909 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:23.283910 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:51:23.283915 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:23.283930 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:51:23.283934 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:23.283985 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:23.284060 (+ 75us) server_negotiation.cc:299] Negotiation successful
0805 22:51:23.284073 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260805 22:51:23.299475 14733 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:51:23.300048 14733 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:51:23.310659 14733 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 44e0a3cde9dd4ca78265dc995103c8e5: Generated new TSK 0
I20260805 22:51:23.310895 14733 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:51:23.318197 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 14611
W20260805 22:51:23.339494 14587 connection.cc:535] client connection to 127.0.0.1:37197 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37197): Connection reset by peer (error 104)
2026-08-05T22:51:23Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1453 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970021300824-15234-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:51:23 dist-test-slave-gjrz krb5kdc[14756](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:51:23 dist-test-slave-gjrz krb5kdc[14756](info): set up 2 sockets
Aug 05 22:51:23 dist-test-slave-gjrz krb5kdc[14756](info): commencing operation
krb5kdc: starting...
W20260805 22:51:24.458072 15234 mini_kdc.cc:121] Time spent starting KDC: real 1.105s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Aug 05 22:51:24 dist-test-slave-gjrz krb5kdc[14756](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970284, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:51:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:51:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970021300824-15234-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970021300824-15234-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260805 22:51:24.585434 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970021300824-15234-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970021300824-15234-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970021300824-15234-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41115
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970021300824-15234-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41115
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:51:24.667973 14776 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:51:24.668190 14776 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:51:24.668212 14776 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:51:24.669349 14776 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:51:24.669392 14776 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:51:24.669405 14776 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:51:24.669417 14776 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:51:24.669440 14776 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:51:24.670974 14776 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970021300824-15234-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970021300824-15234-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41115
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970021300824-15234-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41115
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14776
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970021300824-15234-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:51:24.671224 14776 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:51:24.671458 14776 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:51:24.676200 14785 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:24.676210 14781 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:51:24.676263 14776 server_base.cc:1034] running on GCE node
W20260805 22:51:24.676220 14788 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:51:24.676587 14776 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:51:24.676844 14776 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:51:24.677999 14776 hybrid_clock.cc:648] HybridClock initialized: now 1785970284677972 us; error 35 us; skew 500 ppm
Aug 05 22:51:24 dist-test-slave-gjrz krb5kdc[14756](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970284, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:51:24.680501 14776 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260805 22:51:24.680939 14776 webserver.cc:460] Webserver started at http://127.0.0.1:39437/ using document root <none> and password file <none>
I20260805 22:51:24.681155 14776 fs_manager.cc:359] Metadata directory not provided
I20260805 22:51:24.681205 14776 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:51:24.681335 14776 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:51:24.682397 14776 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970021300824-15234-0/minicluster-data/master-0/data/instance:
uuid: "8609ac34de3a4f67b518401fb2b8a3dd"
format_stamp: "Formatted at 2026-08-05 22:51:24 on dist-test-slave-gjrz"
server_key: "5b3d977b1cc0902dc983dbdf838ff008"
server_key_iv: "f4442826a1c4982aa88b1f32b9e09165"
server_key_version: "encryptionkey@0"
I20260805 22:51:24.682744 14776 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970021300824-15234-0/minicluster-data/master-0/wal/instance:
uuid: "8609ac34de3a4f67b518401fb2b8a3dd"
format_stamp: "Formatted at 2026-08-05 22:51:24 on dist-test-slave-gjrz"
server_key: "5b3d977b1cc0902dc983dbdf838ff008"
server_key_iv: "f4442826a1c4982aa88b1f32b9e09165"
server_key_version: "encryptionkey@0"
I20260805 22:51:24.684150 14776 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260805 22:51:24.684903 14795 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:24.685052 14776 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:24.685139 14776 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970021300824-15234-0/minicluster-data/master-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970021300824-15234-0/minicluster-data/master-0/wal
uuid: "8609ac34de3a4f67b518401fb2b8a3dd"
format_stamp: "Formatted at 2026-08-05 22:51:24 on dist-test-slave-gjrz"
server_key: "5b3d977b1cc0902dc983dbdf838ff008"
server_key_iv: "f4442826a1c4982aa88b1f32b9e09165"
server_key_version: "encryptionkey@0"
I20260805 22:51:24.685213 14776 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970021300824-15234-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970021300824-15234-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970021300824-15234-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:51:24.688633 14776 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:51:24.690460 14776 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:51:24.690587 14776 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:51:24.694418 14776 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41115
I20260805 22:51:24.694458 14872 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41115 every 8 connection(s)
I20260805 22:51:24.694757 14776 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
I20260805 22:51:24.695797 14874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:51:24.698036 14874 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8609ac34de3a4f67b518401fb2b8a3dd: Bootstrap starting.
I20260805 22:51:24.698593 14874 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8609ac34de3a4f67b518401fb2b8a3dd: Neither blocks nor log segments found. Creating new log.
I20260805 22:51:24.698822 14874 log.cc:824] T 00000000000000000000000000000000 P 8609ac34de3a4f67b518401fb2b8a3dd: Log is configured to *not* fsync() on all Append() calls
I20260805 22:51:24.699558 14874 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8609ac34de3a4f67b518401fb2b8a3dd: No bootstrap required, opened a new log
I20260805 22:51:24.701145 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 14776
I20260805 22:51:24.701251 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970021300824-15234-0/minicluster-data/master-0/wal/instance
I20260805 22:51:24.701151 14874 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8609ac34de3a4f67b518401fb2b8a3dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8609ac34de3a4f67b518401fb2b8a3dd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41115 } }
I20260805 22:51:24.701323 14874 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8609ac34de3a4f67b518401fb2b8a3dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:51:24.701368 14874 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8609ac34de3a4f67b518401fb2b8a3dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8609ac34de3a4f67b518401fb2b8a3dd, State: Initialized, Role: FOLLOWER
I20260805 22:51:24.701459 15234 external_mini_cluster.cc:1428] Setting key 7117bd5136eaba07e3a9f1f5a9a5da22
I20260805 22:51:24.701520 14874 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8609ac34de3a4f67b518401fb2b8a3dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8609ac34de3a4f67b518401fb2b8a3dd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41115 } }
I20260805 22:51:24.701603 14874 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8609ac34de3a4f67b518401fb2b8a3dd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:51:24.701642 14874 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8609ac34de3a4f67b518401fb2b8a3dd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:51:24.701682 14874 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8609ac34de3a4f67b518401fb2b8a3dd [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:51:24.702713 14874 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8609ac34de3a4f67b518401fb2b8a3dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8609ac34de3a4f67b518401fb2b8a3dd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41115 } }
I20260805 22:51:24.702821 14874 leader_election.cc:302] T 00000000000000000000000000000000 P 8609ac34de3a4f67b518401fb2b8a3dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8609ac34de3a4f67b518401fb2b8a3dd; no voters:
I20260805 22:51:24.702981 14874 leader_election.cc:288] T 00000000000000000000000000000000 P 8609ac34de3a4f67b518401fb2b8a3dd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:51:24.703024 14881 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8609ac34de3a4f67b518401fb2b8a3dd [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:51:24.703130 14881 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8609ac34de3a4f67b518401fb2b8a3dd [term 1 LEADER]: Becoming Leader. State: Replica: 8609ac34de3a4f67b518401fb2b8a3dd, State: Running, Role: LEADER
I20260805 22:51:24.703253 14874 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8609ac34de3a4f67b518401fb2b8a3dd [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:51:24.703325 14881 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8609ac34de3a4f67b518401fb2b8a3dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8609ac34de3a4f67b518401fb2b8a3dd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41115 } }
I20260805 22:51:24.703727 14880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:24.701971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.164:54803 (local address 127.0.0.1:41115)
0805 22:51:24.702149 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:24.702159 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:24.702185 (+ 26us) server_negotiation.cc:407] Connection header received
0805 22:51:24.702289 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:24.702295 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:24.702319 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:24.702428 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:24.703120 (+ 692us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:24.703124 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:24.703124 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:51:24.703129 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:24.703176 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:51:24.703191 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:24.703252 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:24.703501 (+ 249us) server_negotiation.cc:299] Negotiation successful
0805 22:51:24.703549 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":84,"threads_started":1}
I20260805 22:51:24.703706 14883 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8609ac34de3a4f67b518401fb2b8a3dd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8609ac34de3a4f67b518401fb2b8a3dd. Latest consensus state: current_term: 1 leader_uuid: "8609ac34de3a4f67b518401fb2b8a3dd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8609ac34de3a4f67b518401fb2b8a3dd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41115 } } }
I20260805 22:51:24.703794 14882 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8609ac34de3a4f67b518401fb2b8a3dd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8609ac34de3a4f67b518401fb2b8a3dd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8609ac34de3a4f67b518401fb2b8a3dd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41115 } } }
I20260805 22:51:24.703972 14883 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8609ac34de3a4f67b518401fb2b8a3dd [sys.catalog]: This master's current role is: LEADER
I20260805 22:51:24.704013 14882 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8609ac34de3a4f67b518401fb2b8a3dd [sys.catalog]: This master's current role is: LEADER
W20260805 22:51:24.705121 14900 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8609ac34de3a4f67b518401fb2b8a3dd: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260805 22:51:24.705156 15234 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260805 22:51:24.705193 14900 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260805 22:51:24.706264 14891 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:51:24.706516 14891 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:51:24.707636 14880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:24.706587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.164:60067 (local address 127.0.0.1:41115)
0805 22:51:24.706628 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:24.706629 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:24.706640 (+ 11us) server_negotiation.cc:407] Connection header received
0805 22:51:24.706707 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:24.706708 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:24.706713 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:24.706774 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:24.707404 (+ 630us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:24.707406 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:24.707406 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:51:24.707410 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:24.707426 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:51:24.707431 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:24.707492 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:24.707561 (+ 69us) server_negotiation.cc:299] Negotiation successful
0805 22:51:24.707575 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260805 22:51:24.708410 14891 catalog_manager.cc:1347] Generated new cluster ID: 50ce6aae9b3e40849b80cbdddb56ab79
I20260805 22:51:24.708462 14891 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:51:24.729707 14891 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:51:24.730005 14891 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:51:24.732227 14891 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8609ac34de3a4f67b518401fb2b8a3dd: Generated new TSK 0
I20260805 22:51:24.732421 14891 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:51:24.736579 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 14776
2026-08-05T22:51:24Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1411 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970021300824-15234-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:51:24 dist-test-slave-gjrz krb5kdc[14920](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:51:24 dist-test-slave-gjrz krb5kdc[14920](info): set up 2 sockets
Aug 05 22:51:24 dist-test-slave-gjrz krb5kdc[14920](info): commencing operation
krb5kdc: starting...
W20260805 22:51:25.866760 15234 mini_kdc.cc:121] Time spent starting KDC: real 1.102s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Aug 05 22:51:25 dist-test-slave-gjrz krb5kdc[14920](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970285, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:51:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:51:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.224.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab.
Entry for principal kudu/127.14.224.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab.
I20260805 22:51:25.994500 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970021300824-15234-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970021300824-15234-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970021300824-15234-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:34149
--webserver_interface=127.14.224.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:35419
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.224.190:34149
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:51:26.092638 14949 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:51:26.092859 14949 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:51:26.092890 14949 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:51:26.094090 14949 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:51:26.094135 14949 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:51:26.094154 14949 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:51:26.094172 14949 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:51:26.094188 14949 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:51:26.095851 14949 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:35419
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970021300824-15234-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970021300824-15234-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.224.190:34149
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:34149
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.224.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14949
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970021300824-15234-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:51:26.096109 14949 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:51:26.096318 14949 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:51:26.100992 14961 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:26.101033 14964 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:51:26.101200 14949 server_base.cc:1034] running on GCE node
W20260805 22:51:26.101099 14958 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:51:26.101514 14949 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:51:26.101811 14949 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:51:26.102952 14949 hybrid_clock.cc:648] HybridClock initialized: now 1785970286102946 us; error 33 us; skew 500 ppm
Aug 05 22:51:26 dist-test-slave-gjrz krb5kdc[14920](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970286, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:51:26.105443 14949 init.cc:377] Logged in from keytab as kudu/127.14.224.190@KRBTEST.COM (short username kudu)
I20260805 22:51:26.105921 14949 webserver.cc:460] Webserver started at http://127.14.224.190:45819/ using document root <none> and password file <none>
I20260805 22:51:26.106127 14949 fs_manager.cc:359] Metadata directory not provided
I20260805 22:51:26.106176 14949 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:51:26.106308 14949 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:51:26.107473 14949 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970021300824-15234-0/minicluster-data/master-0/data/instance:
uuid: "afa4a2ca4e004b8ba329cf7b6349b324"
format_stamp: "Formatted at 2026-08-05 22:51:26 on dist-test-slave-gjrz"
server_key: "5d2fb508722725d9665511e7e790f916"
server_key_iv: "12867c2d08e908c5f5f77c5dd9538cb0"
server_key_version: "encryptionkey@0"
I20260805 22:51:26.107831 14949 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970021300824-15234-0/minicluster-data/master-0/wal/instance:
uuid: "afa4a2ca4e004b8ba329cf7b6349b324"
format_stamp: "Formatted at 2026-08-05 22:51:26 on dist-test-slave-gjrz"
server_key: "5d2fb508722725d9665511e7e790f916"
server_key_iv: "12867c2d08e908c5f5f77c5dd9538cb0"
server_key_version: "encryptionkey@0"
I20260805 22:51:26.109212 14949 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:51:26.109984 14973 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:26.110143 14949 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260805 22:51:26.110234 14949 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970021300824-15234-0/minicluster-data/master-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970021300824-15234-0/minicluster-data/master-0/wal
uuid: "afa4a2ca4e004b8ba329cf7b6349b324"
format_stamp: "Formatted at 2026-08-05 22:51:26 on dist-test-slave-gjrz"
server_key: "5d2fb508722725d9665511e7e790f916"
server_key_iv: "12867c2d08e908c5f5f77c5dd9538cb0"
server_key_version: "encryptionkey@0"
I20260805 22:51:26.110299 14949 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970021300824-15234-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970021300824-15234-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970021300824-15234-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:51:26.122262 14949 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:51:26.124476 14949 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:51:26.124626 14949 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:51:26.128554 14949 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.190:34149
I20260805 22:51:26.128592 15049 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.190:34149 every 8 connection(s)
I20260805 22:51:26.128944 14949 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
I20260805 22:51:26.129837 15051 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:51:26.130236 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 14949
I20260805 22:51:26.130362 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970021300824-15234-0/minicluster-data/master-0/wal/instance
I20260805 22:51:26.130580 15234 external_mini_cluster.cc:1428] Setting key 77059f22580d0ff34c7f3bcdcdbad33c
I20260805 22:51:26.132875 15051 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P afa4a2ca4e004b8ba329cf7b6349b324: Bootstrap starting.
I20260805 22:51:26.133632 15051 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P afa4a2ca4e004b8ba329cf7b6349b324: Neither blocks nor log segments found. Creating new log.
I20260805 22:51:26.133946 15051 log.cc:824] T 00000000000000000000000000000000 P afa4a2ca4e004b8ba329cf7b6349b324: Log is configured to *not* fsync() on all Append() calls
I20260805 22:51:26.134727 15051 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P afa4a2ca4e004b8ba329cf7b6349b324: No bootstrap required, opened a new log
I20260805 22:51:26.136986 15051 raft_consensus.cc:348] T 00000000000000000000000000000000 P afa4a2ca4e004b8ba329cf7b6349b324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afa4a2ca4e004b8ba329cf7b6349b324" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 34149 } }
I20260805 22:51:26.137172 15051 raft_consensus.cc:374] T 00000000000000000000000000000000 P afa4a2ca4e004b8ba329cf7b6349b324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:51:26.137212 15051 raft_consensus.cc:729] T 00000000000000000000000000000000 P afa4a2ca4e004b8ba329cf7b6349b324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afa4a2ca4e004b8ba329cf7b6349b324, State: Initialized, Role: FOLLOWER
I20260805 22:51:26.137356 15051 consensus_queue.cc:260] T 00000000000000000000000000000000 P afa4a2ca4e004b8ba329cf7b6349b324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afa4a2ca4e004b8ba329cf7b6349b324" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 34149 } }
I20260805 22:51:26.137444 15051 raft_consensus.cc:388] T 00000000000000000000000000000000 P afa4a2ca4e004b8ba329cf7b6349b324 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:51:26.137476 15051 raft_consensus.cc:482] T 00000000000000000000000000000000 P afa4a2ca4e004b8ba329cf7b6349b324 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:51:26.137602 15051 raft_consensus.cc:3037] T 00000000000000000000000000000000 P afa4a2ca4e004b8ba329cf7b6349b324 [term 0 FOLLOWER]: Advancing to term 1
Aug 05 22:51:26 dist-test-slave-gjrz krb5kdc[14920](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970285, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:51:26.138399 15051 raft_consensus.cc:504] T 00000000000000000000000000000000 P afa4a2ca4e004b8ba329cf7b6349b324 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afa4a2ca4e004b8ba329cf7b6349b324" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 34149 } }
I20260805 22:51:26.138533 15051 leader_election.cc:302] T 00000000000000000000000000000000 P afa4a2ca4e004b8ba329cf7b6349b324 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: afa4a2ca4e004b8ba329cf7b6349b324; no voters:
I20260805 22:51:26.138746 15051 leader_election.cc:288] T 00000000000000000000000000000000 P afa4a2ca4e004b8ba329cf7b6349b324 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:51:26.138998 15060 raft_consensus.cc:2781] T 00000000000000000000000000000000 P afa4a2ca4e004b8ba329cf7b6349b324 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:51:26.139178 15051 sys_catalog.cc:564] T 00000000000000000000000000000000 P afa4a2ca4e004b8ba329cf7b6349b324 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:51:26.139230 15060 raft_consensus.cc:686] T 00000000000000000000000000000000 P afa4a2ca4e004b8ba329cf7b6349b324 [term 1 LEADER]: Becoming Leader. State: Replica: afa4a2ca4e004b8ba329cf7b6349b324, State: Running, Role: LEADER
I20260805 22:51:26.139400 15060 consensus_queue.cc:237] T 00000000000000000000000000000000 P afa4a2ca4e004b8ba329cf7b6349b324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afa4a2ca4e004b8ba329cf7b6349b324" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 34149 } }
I20260805 22:51:26.139770 15059 sys_catalog.cc:455] T 00000000000000000000000000000000 P afa4a2ca4e004b8ba329cf7b6349b324 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "afa4a2ca4e004b8ba329cf7b6349b324" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afa4a2ca4e004b8ba329cf7b6349b324" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 34149 } } }
I20260805 22:51:26.139897 15059 sys_catalog.cc:458] T 00000000000000000000000000000000 P afa4a2ca4e004b8ba329cf7b6349b324 [sys.catalog]: This master's current role is: LEADER
I20260805 22:51:26.140161 15063 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:51:26.140796 15061 sys_catalog.cc:455] T 00000000000000000000000000000000 P afa4a2ca4e004b8ba329cf7b6349b324 [sys.catalog]: SysCatalogTable state changed. Reason: New leader afa4a2ca4e004b8ba329cf7b6349b324. Latest consensus state: current_term: 1 leader_uuid: "afa4a2ca4e004b8ba329cf7b6349b324" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afa4a2ca4e004b8ba329cf7b6349b324" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 34149 } } }
I20260805 22:51:26.140947 15061 sys_catalog.cc:458] T 00000000000000000000000000000000 P afa4a2ca4e004b8ba329cf7b6349b324 [sys.catalog]: This master's current role is: LEADER
I20260805 22:51:26.140970 15063 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:51:26.142273 15055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:26.131131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32977 (local address 127.14.224.190:34149)
0805 22:51:26.131356 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:26.131366 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:26.131404 (+ 38us) server_negotiation.cc:407] Connection header received
0805 22:51:26.131928 (+ 524us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:26.131937 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:26.131999 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:26.132163 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:26.132760 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:26.134130 (+ 1370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:26.134983 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:26.135627 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:26.135748 (+ 121us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:26.138489 (+ 2741us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:26.138494 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:26.138495 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:51:26.138510 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:26.140673 (+ 2163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:26.141150 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:26.141154 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:26.141154 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:26.141247 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:26.141464 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:26.141465 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:26.141465 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:26.141708 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:26.141857 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:26.141997 (+ 140us) server_negotiation.cc:299] Negotiation successful
0805 22:51:26.142100 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":87,"threads_started":1}
I20260805 22:51:26.143357 15234 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:51:26.145583 15063 catalog_manager.cc:1347] Generated new cluster ID: eb3206f3591247d8b7a1d19b6f6c581d
I20260805 22:51:26.145635 15063 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:51:26.151780 15063 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:51:26.152302 15063 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:51:26.153136 15055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:26.144765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50219 (local address 127.14.224.190:34149)
0805 22:51:26.144807 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:26.144809 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:26.144900 (+ 91us) server_negotiation.cc:407] Connection header received
0805 22:51:26.145000 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:26.145001 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:26.145011 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:26.145041 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:26.145817 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:26.146909 (+ 1092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:26.148023 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:26.148344 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:26.148389 (+ 45us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:26.150042 (+ 1653us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:26.150043 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:26.150043 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:51:26.150051 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:26.151740 (+ 1689us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:26.152204 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:26.152206 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:26.152206 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:26.152268 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:26.152517 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:26.152518 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:26.152518 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:26.152646 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:26.152724 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:26.152966 (+ 242us) server_negotiation.cc:299] Negotiation successful
0805 22:51:26.153039 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260805 22:51:26.159152 15063 catalog_manager.cc:5868] T 00000000000000000000000000000000 P afa4a2ca4e004b8ba329cf7b6349b324: Generated new TSK 0
I20260805 22:51:26.159389 15063 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:51:26.161672 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 14949
W20260805 22:51:26.175323 14916 connection.cc:535] client connection to 127.14.224.190:34149 recv error: Network error: failed to read from TLS socket (remote: 127.14.224.190:34149): Connection reset by peer (error 104)
2026-08-05T22:51:26Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1424 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970021300824-15234-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:51:26 dist-test-slave-gjrz krb5kdc[15093](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:51:26 dist-test-slave-gjrz krb5kdc[15093](info): set up 2 sockets
Aug 05 22:51:26 dist-test-slave-gjrz krb5kdc[15093](info): commencing operation
krb5kdc: starting...
W20260805 22:51:27.310463 15234 mini_kdc.cc:121] Time spent starting KDC: real 1.121s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Aug 05 22:51:27 dist-test-slave-gjrz krb5kdc[15093](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970287, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:51:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:51:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.224.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab.
Entry for principal kudu/127.14.224.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab.
I20260805 22:51:27.441895 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970021300824-15234-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970021300824-15234-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970021300824-15234-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:35215
--webserver_interface=127.14.224.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:34997
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.224.190:35215
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:51:27.527769 15114 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:51:27.527992 15114 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:51:27.528016 15114 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:51:27.529222 15114 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:51:27.529273 15114 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:51:27.529286 15114 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:51:27.529299 15114 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:51:27.529309 15114 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:51:27.530862 15114 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:34997
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970021300824-15234-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970021300824-15234-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.224.190:35215
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:35215
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.224.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15114
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970021300824-15234-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:51:27.531118 15114 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:51:27.531360 15114 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:51:27.536192 15124 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:27.536192 15126 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:27.536213 15122 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:51:27.536368 15114 server_base.cc:1034] running on GCE node
I20260805 22:51:27.536608 15114 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:51:27.536890 15114 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:51:27.538031 15114 hybrid_clock.cc:648] HybridClock initialized: now 1785970287538023 us; error 30 us; skew 500 ppm
Aug 05 22:51:27 dist-test-slave-gjrz krb5kdc[15093](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970287, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:51:27.540591 15114 init.cc:377] Logged in from keytab as kudu/127.14.224.190@KRBTEST.COM (short username kudu)
I20260805 22:51:27.540997 15114 webserver.cc:460] Webserver started at http://127.14.224.190:37909/ using document root <none> and password file <none>
I20260805 22:51:27.541203 15114 fs_manager.cc:359] Metadata directory not provided
I20260805 22:51:27.541244 15114 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:51:27.541338 15114 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:51:27.542385 15114 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970021300824-15234-0/minicluster-data/master-0/data/instance:
uuid: "5c9c1cc665384f4fa524a4287a02b357"
format_stamp: "Formatted at 2026-08-05 22:51:27 on dist-test-slave-gjrz"
server_key: "34560ece1555ec7cfb24f1954bc2a642"
server_key_iv: "373c845aad167f51840c783fcbe07c59"
server_key_version: "encryptionkey@0"
I20260805 22:51:27.542689 15114 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970021300824-15234-0/minicluster-data/master-0/wal/instance:
uuid: "5c9c1cc665384f4fa524a4287a02b357"
format_stamp: "Formatted at 2026-08-05 22:51:27 on dist-test-slave-gjrz"
server_key: "34560ece1555ec7cfb24f1954bc2a642"
server_key_iv: "373c845aad167f51840c783fcbe07c59"
server_key_version: "encryptionkey@0"
I20260805 22:51:27.543977 15114 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260805 22:51:27.544672 15134 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:27.544823 15114 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260805 22:51:27.544905 15114 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970021300824-15234-0/minicluster-data/master-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970021300824-15234-0/minicluster-data/master-0/wal
uuid: "5c9c1cc665384f4fa524a4287a02b357"
format_stamp: "Formatted at 2026-08-05 22:51:27 on dist-test-slave-gjrz"
server_key: "34560ece1555ec7cfb24f1954bc2a642"
server_key_iv: "373c845aad167f51840c783fcbe07c59"
server_key_version: "encryptionkey@0"
I20260805 22:51:27.544973 15114 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970021300824-15234-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970021300824-15234-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970021300824-15234-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:51:27.567409 15114 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:51:27.569650 15114 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:51:27.569782 15114 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:51:27.573793 15114 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.190:35215
I20260805 22:51:27.573845 15206 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.190:35215 every 8 connection(s)
I20260805 22:51:27.574194 15114 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
I20260805 22:51:27.575168 15207 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:51:27.577622 15207 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c9c1cc665384f4fa524a4287a02b357: Bootstrap starting.
I20260805 22:51:27.578109 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 15114
I20260805 22:51:27.578213 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970021300824-15234-0/minicluster-data/master-0/wal/instance
I20260805 22:51:27.578290 15207 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5c9c1cc665384f4fa524a4287a02b357: Neither blocks nor log segments found. Creating new log.
I20260805 22:51:27.578416 15234 external_mini_cluster.cc:1428] Setting key 1e7c24e43f7fc656d10edbbf61e88c68
I20260805 22:51:27.578594 15207 log.cc:824] T 00000000000000000000000000000000 P 5c9c1cc665384f4fa524a4287a02b357: Log is configured to *not* fsync() on all Append() calls
I20260805 22:51:27.579397 15207 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c9c1cc665384f4fa524a4287a02b357: No bootstrap required, opened a new log
I20260805 22:51:27.581583 15207 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5c9c1cc665384f4fa524a4287a02b357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c9c1cc665384f4fa524a4287a02b357" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 35215 } }
I20260805 22:51:27.581769 15207 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5c9c1cc665384f4fa524a4287a02b357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:51:27.581800 15207 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5c9c1cc665384f4fa524a4287a02b357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c9c1cc665384f4fa524a4287a02b357, State: Initialized, Role: FOLLOWER
I20260805 22:51:27.581947 15207 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5c9c1cc665384f4fa524a4287a02b357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c9c1cc665384f4fa524a4287a02b357" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 35215 } }
I20260805 22:51:27.582031 15207 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5c9c1cc665384f4fa524a4287a02b357 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:51:27.582072 15207 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5c9c1cc665384f4fa524a4287a02b357 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:51:27.582157 15207 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5c9c1cc665384f4fa524a4287a02b357 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:51:27.582808 15207 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5c9c1cc665384f4fa524a4287a02b357 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c9c1cc665384f4fa524a4287a02b357" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 35215 } }
I20260805 22:51:27.582937 15207 leader_election.cc:302] T 00000000000000000000000000000000 P 5c9c1cc665384f4fa524a4287a02b357 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5c9c1cc665384f4fa524a4287a02b357; no voters:
I20260805 22:51:27.583124 15207 leader_election.cc:288] T 00000000000000000000000000000000 P 5c9c1cc665384f4fa524a4287a02b357 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:51:27.583156 15212 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5c9c1cc665384f4fa524a4287a02b357 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:51:27.583308 15212 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5c9c1cc665384f4fa524a4287a02b357 [term 1 LEADER]: Becoming Leader. State: Replica: 5c9c1cc665384f4fa524a4287a02b357, State: Running, Role: LEADER
I20260805 22:51:27.583421 15207 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5c9c1cc665384f4fa524a4287a02b357 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:51:27.583438 15212 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5c9c1cc665384f4fa524a4287a02b357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c9c1cc665384f4fa524a4287a02b357" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 35215 } }
I20260805 22:51:27.583877 15213 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c9c1cc665384f4fa524a4287a02b357 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5c9c1cc665384f4fa524a4287a02b357" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c9c1cc665384f4fa524a4287a02b357" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 35215 } } }
I20260805 22:51:27.583907 15215 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c9c1cc665384f4fa524a4287a02b357 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5c9c1cc665384f4fa524a4287a02b357. Latest consensus state: current_term: 1 leader_uuid: "5c9c1cc665384f4fa524a4287a02b357" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c9c1cc665384f4fa524a4287a02b357" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 35215 } } }
I20260805 22:51:27.584120 15215 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c9c1cc665384f4fa524a4287a02b357 [sys.catalog]: This master's current role is: LEADER
I20260805 22:51:27.584033 15213 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c9c1cc665384f4fa524a4287a02b357 [sys.catalog]: This master's current role is: LEADER
I20260805 22:51:27.584343 15224 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:51:27.585238 15224 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:51:27.585430 15211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:27.578897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34011 (local address 127.14.224.190:35215)
0805 22:51:27.579080 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:27.579097 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:27.579130 (+ 33us) server_negotiation.cc:407] Connection header received
0805 22:51:27.579682 (+ 552us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:27.579690 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:27.579741 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:27.579856 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:27.580126 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:27.580994 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:27.582118 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:27.582632 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:27.582717 (+ 85us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:27.584487 (+ 1770us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:27.584492 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:27.584492 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:51:27.584698 (+ 206us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:27.584740 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:51:27.584756 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:27.584834 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:27.585177 (+ 343us) server_negotiation.cc:299] Negotiation successful
0805 22:51:27.585206 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":80,"threads_started":1}
I20260805 22:51:27.586546 15234 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:51:27.586997 15224 catalog_manager.cc:1347] Generated new cluster ID: b97bc4dcfa8e46d1b3a4c35d2235550c
I20260805 22:51:27.587044 15224 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:51:27.594733 15211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:27.591753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38153 (local address 127.14.224.190:35215)
0805 22:51:27.591800 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:27.591802 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:27.591964 (+ 162us) server_negotiation.cc:407] Connection header received
0805 22:51:27.592026 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:27.592027 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:27.592040 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:27.592097 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:27.592253 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:27.592764 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:27.593523 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:27.593737 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:27.593795 (+ 58us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:27.594482 (+ 687us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:27.594484 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:27.594484 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:51:27.594490 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:27.594507 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:51:27.594511 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:27.594554 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:27.594627 (+ 73us) server_negotiation.cc:299] Negotiation successful
0805 22:51:27.594639 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260805 22:51:27.605490 15224 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:51:27.606050 15224 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:51:27.612993 15224 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5c9c1cc665384f4fa524a4287a02b357: Generated new TSK 0
I20260805 22:51:27.613194 15224 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:51:27.615520 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 15114
W20260805 22:51:27.630256 15090 connection.cc:535] client connection to 127.14.224.190:35215 recv error: Network error: failed to read from TLS socket (remote: 127.14.224.190:35215): Connection reset by peer (error 104)
2026-08-05T22:51:27Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1454 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970021300824-15234-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:51:27 dist-test-slave-gjrz krb5kdc[15258](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:51:27 dist-test-slave-gjrz krb5kdc[15258](info): set up 2 sockets
Aug 05 22:51:27 dist-test-slave-gjrz krb5kdc[15258](info): commencing operation
krb5kdc: starting...
W20260805 22:51:28.747256 15234 mini_kdc.cc:121] Time spent starting KDC: real 1.103s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Aug 05 22:51:28 dist-test-slave-gjrz krb5kdc[15258](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970288, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:51:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:51:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.224.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab.
Entry for principal kudu/127.14.224.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab.
I20260805 22:51:28.878950 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970021300824-15234-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970021300824-15234-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970021300824-15234-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:39671
--webserver_interface=127.14.224.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:46253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.224.190:39671
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:51:28.963773 15274 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:51:28.964004 15274 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:51:28.964027 15274 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:51:28.965231 15274 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:51:28.965279 15274 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:51:28.965292 15274 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:51:28.965305 15274 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:51:28.965328 15274 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:51:28.967172 15274 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:46253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970021300824-15234-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970021300824-15234-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.224.190:39671
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:39671
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.224.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15274
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970021300824-15234-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:51:28.967487 15274 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:51:28.967712 15274 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:51:28.972777 15287 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:28.972785 15289 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:51:28.972816 15274 server_base.cc:1034] running on GCE node
W20260805 22:51:28.972786 15284 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:51:28.973237 15274 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:51:28.973539 15274 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:51:28.974681 15274 hybrid_clock.cc:648] HybridClock initialized: now 1785970288974667 us; error 30 us; skew 500 ppm
Aug 05 22:51:28 dist-test-slave-gjrz krb5kdc[15258](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970288, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:51:28.982430 15274 init.cc:377] Logged in from keytab as kudu/127.14.224.190@KRBTEST.COM (short username kudu)
I20260805 22:51:28.982928 15274 webserver.cc:460] Webserver started at http://127.14.224.190:46705/ using document root <none> and password file <none>
I20260805 22:51:28.983167 15274 fs_manager.cc:359] Metadata directory not provided
I20260805 22:51:28.983214 15274 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:51:28.983358 15274 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:51:28.984525 15274 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970021300824-15234-0/minicluster-data/master-0/data/instance:
uuid: "e35ef6395a64431eb89fdc25f7a85704"
format_stamp: "Formatted at 2026-08-05 22:51:28 on dist-test-slave-gjrz"
server_key: "ce2a844b4e90dab5bee7ac6a89f80b06"
server_key_iv: "941cde53cc762faf3aa040e10f5675cf"
server_key_version: "encryptionkey@0"
I20260805 22:51:28.984880 15274 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970021300824-15234-0/minicluster-data/master-0/wal/instance:
uuid: "e35ef6395a64431eb89fdc25f7a85704"
format_stamp: "Formatted at 2026-08-05 22:51:28 on dist-test-slave-gjrz"
server_key: "ce2a844b4e90dab5bee7ac6a89f80b06"
server_key_iv: "941cde53cc762faf3aa040e10f5675cf"
server_key_version: "encryptionkey@0"
I20260805 22:51:28.986227 15274 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260805 22:51:28.986934 15298 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:28.987082 15274 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260805 22:51:28.987177 15274 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970021300824-15234-0/minicluster-data/master-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970021300824-15234-0/minicluster-data/master-0/wal
uuid: "e35ef6395a64431eb89fdc25f7a85704"
format_stamp: "Formatted at 2026-08-05 22:51:28 on dist-test-slave-gjrz"
server_key: "ce2a844b4e90dab5bee7ac6a89f80b06"
server_key_iv: "941cde53cc762faf3aa040e10f5675cf"
server_key_version: "encryptionkey@0"
I20260805 22:51:28.987246 15274 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970021300824-15234-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970021300824-15234-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970021300824-15234-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:51:28.990859 15274 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:51:28.993153 15274 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:51:28.993300 15274 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:51:28.997155 15274 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.190:39671
I20260805 22:51:28.997189 15365 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.190:39671 every 8 connection(s)
I20260805 22:51:28.997524 15274 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
I20260805 22:51:28.998523 15368 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:51:29.000988 15368 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e35ef6395a64431eb89fdc25f7a85704: Bootstrap starting.
I20260805 22:51:29.001590 15368 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e35ef6395a64431eb89fdc25f7a85704: Neither blocks nor log segments found. Creating new log.
I20260805 22:51:29.001823 15368 log.cc:824] T 00000000000000000000000000000000 P e35ef6395a64431eb89fdc25f7a85704: Log is configured to *not* fsync() on all Append() calls
I20260805 22:51:29.002592 15368 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e35ef6395a64431eb89fdc25f7a85704: No bootstrap required, opened a new log
I20260805 22:51:29.004297 15368 raft_consensus.cc:348] T 00000000000000000000000000000000 P e35ef6395a64431eb89fdc25f7a85704 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e35ef6395a64431eb89fdc25f7a85704" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 39671 } }
I20260805 22:51:29.004455 15368 raft_consensus.cc:374] T 00000000000000000000000000000000 P e35ef6395a64431eb89fdc25f7a85704 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:51:29.004477 15368 raft_consensus.cc:729] T 00000000000000000000000000000000 P e35ef6395a64431eb89fdc25f7a85704 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e35ef6395a64431eb89fdc25f7a85704, State: Initialized, Role: FOLLOWER
I20260805 22:51:29.004595 15368 consensus_queue.cc:260] T 00000000000000000000000000000000 P e35ef6395a64431eb89fdc25f7a85704 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e35ef6395a64431eb89fdc25f7a85704" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 39671 } }
I20260805 22:51:29.004649 15368 raft_consensus.cc:388] T 00000000000000000000000000000000 P e35ef6395a64431eb89fdc25f7a85704 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:51:29.004669 15368 raft_consensus.cc:482] T 00000000000000000000000000000000 P e35ef6395a64431eb89fdc25f7a85704 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:51:29.004699 15368 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e35ef6395a64431eb89fdc25f7a85704 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:51:29.004981 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 15274
I20260805 22:51:29.005115 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970021300824-15234-0/minicluster-data/master-0/wal/instance
I20260805 22:51:29.005334 15234 external_mini_cluster.cc:1428] Setting key e400ae6164baf09f94cd8640a3d2212c
I20260805 22:51:29.005849 15368 raft_consensus.cc:504] T 00000000000000000000000000000000 P e35ef6395a64431eb89fdc25f7a85704 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e35ef6395a64431eb89fdc25f7a85704" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 39671 } }
I20260805 22:51:29.005980 15368 leader_election.cc:302] T 00000000000000000000000000000000 P e35ef6395a64431eb89fdc25f7a85704 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e35ef6395a64431eb89fdc25f7a85704; no voters:
I20260805 22:51:29.006165 15368 leader_election.cc:288] T 00000000000000000000000000000000 P e35ef6395a64431eb89fdc25f7a85704 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:51:29.006198 15377 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e35ef6395a64431eb89fdc25f7a85704 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:51:29.006359 15377 raft_consensus.cc:686] T 00000000000000000000000000000000 P e35ef6395a64431eb89fdc25f7a85704 [term 1 LEADER]: Becoming Leader. State: Replica: e35ef6395a64431eb89fdc25f7a85704, State: Running, Role: LEADER
I20260805 22:51:29.006430 15368 sys_catalog.cc:564] T 00000000000000000000000000000000 P e35ef6395a64431eb89fdc25f7a85704 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:51:29.006520 15377 consensus_queue.cc:237] T 00000000000000000000000000000000 P e35ef6395a64431eb89fdc25f7a85704 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e35ef6395a64431eb89fdc25f7a85704" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 39671 } }
I20260805 22:51:29.007467 15378 sys_catalog.cc:455] T 00000000000000000000000000000000 P e35ef6395a64431eb89fdc25f7a85704 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e35ef6395a64431eb89fdc25f7a85704" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e35ef6395a64431eb89fdc25f7a85704" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 39671 } } }
I20260805 22:51:29.007570 15378 sys_catalog.cc:458] T 00000000000000000000000000000000 P e35ef6395a64431eb89fdc25f7a85704 [sys.catalog]: This master's current role is: LEADER
I20260805 22:51:29.007788 15374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:29.005858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56253 (local address 127.14.224.190:39671)
0805 22:51:29.006081 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:29.006091 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:29.006121 (+ 30us) server_negotiation.cc:407] Connection header received
0805 22:51:29.006248 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:29.006257 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:29.006290 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:29.006731 (+ 441us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:29.007107 (+ 376us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:29.007111 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:29.007111 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:51:29.007115 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:29.007154 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:51:29.007169 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:29.007479 (+ 310us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:29.007512 (+ 33us) server_negotiation.cc:299] Negotiation successful
0805 22:51:29.007555 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":88,"threads_started":1}
I20260805 22:51:29.008060 15381 sys_catalog.cc:455] T 00000000000000000000000000000000 P e35ef6395a64431eb89fdc25f7a85704 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e35ef6395a64431eb89fdc25f7a85704. Latest consensus state: current_term: 1 leader_uuid: "e35ef6395a64431eb89fdc25f7a85704" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e35ef6395a64431eb89fdc25f7a85704" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 39671 } } }
I20260805 22:51:29.008157 15381 sys_catalog.cc:458] T 00000000000000000000000000000000 P e35ef6395a64431eb89fdc25f7a85704 [sys.catalog]: This master's current role is: LEADER
W20260805 22:51:29.008322 15401 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e35ef6395a64431eb89fdc25f7a85704: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260805 22:51:29.008359 15401 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260805 22:51:29.008405 15400 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:51:29.008565 15400 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:51:29.009543 15234 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:51:29.010108 15400 catalog_manager.cc:1347] Generated new cluster ID: 29981f35cf304b2cbd4451a50ff3c5da
I20260805 22:51:29.010165 15400 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:51:29.012019 15374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:29.010940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52899 (local address 127.14.224.190:39671)
0805 22:51:29.010997 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:29.010999 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:29.011112 (+ 113us) server_negotiation.cc:407] Connection header received
0805 22:51:29.011170 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:29.011170 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:29.011176 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:29.011221 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:29.011819 (+ 598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:29.011820 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:29.011820 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:51:29.011824 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:29.011840 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:51:29.011845 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:29.011894 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:29.011943 (+ 49us) server_negotiation.cc:299] Negotiation successful
0805 22:51:29.011956 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260805 22:51:29.020406 15400 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:51:29.020601 15400 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:51:29.025916 15400 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e35ef6395a64431eb89fdc25f7a85704: Generated new TSK 0
I20260805 22:51:29.026118 15400 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:51:29.031253 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 15274
2026-08-05T22:51:29Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1416 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970021300824-15234-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:51:29 dist-test-slave-gjrz krb5kdc[15414](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:51:29 dist-test-slave-gjrz krb5kdc[15414](info): set up 2 sockets
Aug 05 22:51:29 dist-test-slave-gjrz krb5kdc[15414](info): commencing operation
krb5kdc: starting...
W20260805 22:51:30.166600 15234 mini_kdc.cc:121] Time spent starting KDC: real 1.107s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Aug 05 22:51:30 dist-test-slave-gjrz krb5kdc[15414](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970290, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:51:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:51:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.224.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab.
Entry for principal kudu/127.14.224.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab.
I20260805 22:51:30.295351 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970021300824-15234-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970021300824-15234-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970021300824-15234-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:44387
--webserver_interface=127.14.224.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:46183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.224.190:44387
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:51:30.379864 15431 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:51:30.380102 15431 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:51:30.380127 15431 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:51:30.381314 15431 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:51:30.381361 15431 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:51:30.381382 15431 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:51:30.381393 15431 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:51:30.381404 15431 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:51:30.382987 15431 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:46183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970021300824-15234-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970021300824-15234-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.224.190:44387
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:44387
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.224.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15431
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970021300824-15234-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:51:30.383217 15431 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:51:30.383472 15431 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:51:30.388502 15436 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:30.388515 15437 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:30.388522 15440 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:51:30.388564 15431 server_base.cc:1034] running on GCE node
I20260805 22:51:30.388998 15431 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:51:30.389305 15431 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:51:30.390455 15431 hybrid_clock.cc:648] HybridClock initialized: now 1785970290390442 us; error 36 us; skew 500 ppm
Aug 05 22:51:30 dist-test-slave-gjrz krb5kdc[15414](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970290, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:51:30.392979 15431 init.cc:377] Logged in from keytab as kudu/127.14.224.190@KRBTEST.COM (short username kudu)
I20260805 22:51:30.393443 15431 webserver.cc:460] Webserver started at http://127.14.224.190:44751/ using document root <none> and password file <none>
I20260805 22:51:30.393671 15431 fs_manager.cc:359] Metadata directory not provided
I20260805 22:51:30.393719 15431 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:51:30.393849 15431 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:51:30.394959 15431 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970021300824-15234-0/minicluster-data/master-0/data/instance:
uuid: "dae7a3e88f18498ba9ce6c4aa1d10eea"
format_stamp: "Formatted at 2026-08-05 22:51:30 on dist-test-slave-gjrz"
server_key: "7f126713cc149fa5596a6ce6928bb4f8"
server_key_iv: "61c7521ea9367e122112c3634fc3c5f0"
server_key_version: "encryptionkey@0"
I20260805 22:51:30.395354 15431 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970021300824-15234-0/minicluster-data/master-0/wal/instance:
uuid: "dae7a3e88f18498ba9ce6c4aa1d10eea"
format_stamp: "Formatted at 2026-08-05 22:51:30 on dist-test-slave-gjrz"
server_key: "7f126713cc149fa5596a6ce6928bb4f8"
server_key_iv: "61c7521ea9367e122112c3634fc3c5f0"
server_key_version: "encryptionkey@0"
I20260805 22:51:30.396716 15431 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:51:30.397516 15449 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:30.397678 15431 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:51:30.397768 15431 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970021300824-15234-0/minicluster-data/master-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970021300824-15234-0/minicluster-data/master-0/wal
uuid: "dae7a3e88f18498ba9ce6c4aa1d10eea"
format_stamp: "Formatted at 2026-08-05 22:51:30 on dist-test-slave-gjrz"
server_key: "7f126713cc149fa5596a6ce6928bb4f8"
server_key_iv: "61c7521ea9367e122112c3634fc3c5f0"
server_key_version: "encryptionkey@0"
I20260805 22:51:30.397833 15431 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970021300824-15234-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970021300824-15234-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970021300824-15234-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:51:30.409492 15431 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:51:30.411621 15431 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:51:30.411760 15431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:51:30.415695 15431 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.190:44387
I20260805 22:51:30.415733 15523 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.190:44387 every 8 connection(s)
I20260805 22:51:30.416071 15431 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
I20260805 22:51:30.416909 15524 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:51:30.419235 15524 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dae7a3e88f18498ba9ce6c4aa1d10eea: Bootstrap starting.
I20260805 22:51:30.419852 15524 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dae7a3e88f18498ba9ce6c4aa1d10eea: Neither blocks nor log segments found. Creating new log.
I20260805 22:51:30.420118 15524 log.cc:824] T 00000000000000000000000000000000 P dae7a3e88f18498ba9ce6c4aa1d10eea: Log is configured to *not* fsync() on all Append() calls
I20260805 22:51:30.420837 15524 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dae7a3e88f18498ba9ce6c4aa1d10eea: No bootstrap required, opened a new log
I20260805 22:51:30.420989 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 15431
I20260805 22:51:30.421113 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970021300824-15234-0/minicluster-data/master-0/wal/instance
I20260805 22:51:30.421380 15234 external_mini_cluster.cc:1428] Setting key 55384d39e63eb58f734046ccb8a19ed2
I20260805 22:51:30.422916 15524 raft_consensus.cc:348] T 00000000000000000000000000000000 P dae7a3e88f18498ba9ce6c4aa1d10eea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dae7a3e88f18498ba9ce6c4aa1d10eea" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 44387 } }
I20260805 22:51:30.423098 15524 raft_consensus.cc:374] T 00000000000000000000000000000000 P dae7a3e88f18498ba9ce6c4aa1d10eea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:51:30.423138 15524 raft_consensus.cc:729] T 00000000000000000000000000000000 P dae7a3e88f18498ba9ce6c4aa1d10eea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dae7a3e88f18498ba9ce6c4aa1d10eea, State: Initialized, Role: FOLLOWER
I20260805 22:51:30.423300 15524 consensus_queue.cc:260] T 00000000000000000000000000000000 P dae7a3e88f18498ba9ce6c4aa1d10eea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dae7a3e88f18498ba9ce6c4aa1d10eea" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 44387 } }
I20260805 22:51:30.423393 15524 raft_consensus.cc:388] T 00000000000000000000000000000000 P dae7a3e88f18498ba9ce6c4aa1d10eea [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:51:30.423432 15524 raft_consensus.cc:482] T 00000000000000000000000000000000 P dae7a3e88f18498ba9ce6c4aa1d10eea [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:51:30.423482 15524 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dae7a3e88f18498ba9ce6c4aa1d10eea [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:51:30.424470 15524 raft_consensus.cc:504] T 00000000000000000000000000000000 P dae7a3e88f18498ba9ce6c4aa1d10eea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dae7a3e88f18498ba9ce6c4aa1d10eea" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 44387 } }
I20260805 22:51:30.424582 15524 leader_election.cc:302] T 00000000000000000000000000000000 P dae7a3e88f18498ba9ce6c4aa1d10eea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dae7a3e88f18498ba9ce6c4aa1d10eea; no voters:
I20260805 22:51:30.424748 15524 leader_election.cc:288] T 00000000000000000000000000000000 P dae7a3e88f18498ba9ce6c4aa1d10eea [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:51:30.424784 15536 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dae7a3e88f18498ba9ce6c4aa1d10eea [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:51:30.424981 15536 raft_consensus.cc:686] T 00000000000000000000000000000000 P dae7a3e88f18498ba9ce6c4aa1d10eea [term 1 LEADER]: Becoming Leader. State: Replica: dae7a3e88f18498ba9ce6c4aa1d10eea, State: Running, Role: LEADER
I20260805 22:51:30.425028 15524 sys_catalog.cc:564] T 00000000000000000000000000000000 P dae7a3e88f18498ba9ce6c4aa1d10eea [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:51:30.425173 15536 consensus_queue.cc:237] T 00000000000000000000000000000000 P dae7a3e88f18498ba9ce6c4aa1d10eea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dae7a3e88f18498ba9ce6c4aa1d10eea" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 44387 } }
I20260805 22:51:30.425688 15539 sys_catalog.cc:455] T 00000000000000000000000000000000 P dae7a3e88f18498ba9ce6c4aa1d10eea [sys.catalog]: SysCatalogTable state changed. Reason: New leader dae7a3e88f18498ba9ce6c4aa1d10eea. Latest consensus state: current_term: 1 leader_uuid: "dae7a3e88f18498ba9ce6c4aa1d10eea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dae7a3e88f18498ba9ce6c4aa1d10eea" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 44387 } } }
I20260805 22:51:30.425791 15539 sys_catalog.cc:458] T 00000000000000000000000000000000 P dae7a3e88f18498ba9ce6c4aa1d10eea [sys.catalog]: This master's current role is: LEADER
I20260805 22:51:30.425997 15537 sys_catalog.cc:455] T 00000000000000000000000000000000 P dae7a3e88f18498ba9ce6c4aa1d10eea [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dae7a3e88f18498ba9ce6c4aa1d10eea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dae7a3e88f18498ba9ce6c4aa1d10eea" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 44387 } } }
I20260805 22:51:30.426355 15537 sys_catalog.cc:458] T 00000000000000000000000000000000 P dae7a3e88f18498ba9ce6c4aa1d10eea [sys.catalog]: This master's current role is: LEADER
I20260805 22:51:30.426477 15551 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:51:30.427166 15551 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 05 22:51:30 dist-test-slave-gjrz krb5kdc[15414](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970290, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:51:30.429345 15551 catalog_manager.cc:1347] Generated new cluster ID: a2412c059e4a43ee884ae943f174a0b1
I20260805 22:51:30.429401 15551 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:51:30.432416 15535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:30.421944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44251 (local address 127.14.224.190:44387)
0805 22:51:30.422122 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:30.422131 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:30.422158 (+ 27us) server_negotiation.cc:407] Connection header received
0805 22:51:30.422876 (+ 718us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:30.422882 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:30.422930 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:30.423045 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:30.423885 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:30.424904 (+ 1019us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:30.425840 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:30.426447 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:30.426938 (+ 491us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:30.429254 (+ 2316us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:30.429257 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:30.429258 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:51:30.429268 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:30.430876 (+ 1608us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:30.431227 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:30.431230 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:30.431231 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:30.431392 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:30.431579 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:30.431579 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:30.431580 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:30.431830 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:30.431979 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:30.432089 (+ 110us) server_negotiation.cc:299] Negotiation successful
0805 22:51:30.432232 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":74,"threads_started":1}
I20260805 22:51:30.433630 15234 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:51:30.439867 15551 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:51:30.440647 15551 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:51:30.441278 15535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:30.434996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37277 (local address 127.14.224.190:44387)
0805 22:51:30.435049 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:30.435051 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:30.435413 (+ 362us) server_negotiation.cc:407] Connection header received
0805 22:51:30.435475 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:30.435476 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:30.435486 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:30.435532 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:30.436063 (+ 531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:30.436534 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:30.437200 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:30.437427 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:30.437482 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:30.438699 (+ 1217us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:30.438701 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:30.438701 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:51:30.438710 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:30.440247 (+ 1537us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:30.440563 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:30.440564 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:30.440564 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:30.440621 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:30.440787 (+ 166us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:30.440788 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:30.440788 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:30.440901 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:30.441000 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:30.441102 (+ 102us) server_negotiation.cc:299] Negotiation successful
0805 22:51:30.441192 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260805 22:51:30.455979 15551 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dae7a3e88f18498ba9ce6c4aa1d10eea: Generated new TSK 0
I20260805 22:51:30.456197 15551 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:51:30.460451 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 15431
2026-08-05T22:51:30Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1433 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970021300824-15234-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:51:30 dist-test-slave-gjrz krb5kdc[15573](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:51:30 dist-test-slave-gjrz krb5kdc[15573](info): set up 2 sockets
Aug 05 22:51:30 dist-test-slave-gjrz krb5kdc[15573](info): commencing operation
krb5kdc: starting...
W20260805 22:51:31.594473 15234 mini_kdc.cc:121] Time spent starting KDC: real 1.101s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Aug 05 22:51:31 dist-test-slave-gjrz krb5kdc[15573](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970291, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:51:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:51:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.224.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab.
Entry for principal kudu/127.14.224.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab.
I20260805 22:51:31.719666 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970021300824-15234-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970021300824-15234-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970021300824-15234-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:38859
--webserver_interface=127.14.224.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:39127
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.224.190:38859
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:51:31.804057 15592 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:51:31.804301 15592 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:51:31.804325 15592 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:51:31.805611 15592 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:51:31.805670 15592 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:51:31.805684 15592 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:51:31.805696 15592 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:51:31.805707 15592 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:51:31.807345 15592 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:39127
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970021300824-15234-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970021300824-15234-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.224.190:38859
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:38859
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.224.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15592
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970021300824-15234-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:51:31.807608 15592 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:51:31.807842 15592 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:51:31.812844 15604 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:31.812839 15598 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:31.812844 15599 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:51:31.812876 15592 server_base.cc:1034] running on GCE node
I20260805 22:51:31.813321 15592 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:51:31.813638 15592 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:51:31.814782 15592 hybrid_clock.cc:648] HybridClock initialized: now 1785970291814769 us; error 35 us; skew 500 ppm
Aug 05 22:51:31 dist-test-slave-gjrz krb5kdc[15573](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970291, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:51:31.817348 15592 init.cc:377] Logged in from keytab as kudu/127.14.224.190@KRBTEST.COM (short username kudu)
I20260805 22:51:31.817807 15592 webserver.cc:460] Webserver started at http://127.14.224.190:39073/ using document root <none> and password file <none>
I20260805 22:51:31.818039 15592 fs_manager.cc:359] Metadata directory not provided
I20260805 22:51:31.818092 15592 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:51:31.818225 15592 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:51:31.819376 15592 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970021300824-15234-0/minicluster-data/master-0/data/instance:
uuid: "58547d0a4c884760a04a11291f8bfafa"
format_stamp: "Formatted at 2026-08-05 22:51:31 on dist-test-slave-gjrz"
server_key: "d6172228a4050d7b64a16150eb2958c2"
server_key_iv: "259cf5a68aed6164156ff13866f2cf3f"
server_key_version: "encryptionkey@0"
I20260805 22:51:31.819753 15592 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970021300824-15234-0/minicluster-data/master-0/wal/instance:
uuid: "58547d0a4c884760a04a11291f8bfafa"
format_stamp: "Formatted at 2026-08-05 22:51:31 on dist-test-slave-gjrz"
server_key: "d6172228a4050d7b64a16150eb2958c2"
server_key_iv: "259cf5a68aed6164156ff13866f2cf3f"
server_key_version: "encryptionkey@0"
I20260805 22:51:31.821175 15592 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260805 22:51:31.822710 15613 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:31.823055 15592 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:51:31.823169 15592 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970021300824-15234-0/minicluster-data/master-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970021300824-15234-0/minicluster-data/master-0/wal
uuid: "58547d0a4c884760a04a11291f8bfafa"
format_stamp: "Formatted at 2026-08-05 22:51:31 on dist-test-slave-gjrz"
server_key: "d6172228a4050d7b64a16150eb2958c2"
server_key_iv: "259cf5a68aed6164156ff13866f2cf3f"
server_key_version: "encryptionkey@0"
I20260805 22:51:31.823287 15592 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970021300824-15234-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970021300824-15234-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970021300824-15234-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:51:31.830837 15592 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:51:31.832795 15592 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:51:31.832943 15592 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:51:31.836833 15592 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.190:38859
I20260805 22:51:31.836879 15680 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.190:38859 every 8 connection(s)
I20260805 22:51:31.837217 15592 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
I20260805 22:51:31.838124 15681 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:51:31.840593 15681 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 58547d0a4c884760a04a11291f8bfafa: Bootstrap starting.
I20260805 22:51:31.841187 15681 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 58547d0a4c884760a04a11291f8bfafa: Neither blocks nor log segments found. Creating new log.
I20260805 22:51:31.841444 15681 log.cc:824] T 00000000000000000000000000000000 P 58547d0a4c884760a04a11291f8bfafa: Log is configured to *not* fsync() on all Append() calls
I20260805 22:51:31.842161 15681 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 58547d0a4c884760a04a11291f8bfafa: No bootstrap required, opened a new log
I20260805 22:51:31.844677 15681 raft_consensus.cc:348] T 00000000000000000000000000000000 P 58547d0a4c884760a04a11291f8bfafa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58547d0a4c884760a04a11291f8bfafa" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 38859 } }
I20260805 22:51:31.844843 15681 raft_consensus.cc:374] T 00000000000000000000000000000000 P 58547d0a4c884760a04a11291f8bfafa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:51:31.844866 15681 raft_consensus.cc:729] T 00000000000000000000000000000000 P 58547d0a4c884760a04a11291f8bfafa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58547d0a4c884760a04a11291f8bfafa, State: Initialized, Role: FOLLOWER
I20260805 22:51:31.845059 15681 consensus_queue.cc:260] T 00000000000000000000000000000000 P 58547d0a4c884760a04a11291f8bfafa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58547d0a4c884760a04a11291f8bfafa" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 38859 } }
I20260805 22:51:31.845134 15681 raft_consensus.cc:388] T 00000000000000000000000000000000 P 58547d0a4c884760a04a11291f8bfafa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:51:31.845155 15681 raft_consensus.cc:482] T 00000000000000000000000000000000 P 58547d0a4c884760a04a11291f8bfafa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:51:31.845201 15681 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 58547d0a4c884760a04a11291f8bfafa [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:51:31.845435 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 15592
I20260805 22:51:31.845548 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970021300824-15234-0/minicluster-data/master-0/wal/instance
I20260805 22:51:31.845726 15234 external_mini_cluster.cc:1428] Setting key fc3d08028e2f27514e8b4b7ac10372e8
I20260805 22:51:31.846412 15681 raft_consensus.cc:504] T 00000000000000000000000000000000 P 58547d0a4c884760a04a11291f8bfafa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58547d0a4c884760a04a11291f8bfafa" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 38859 } }
I20260805 22:51:31.846534 15681 leader_election.cc:302] T 00000000000000000000000000000000 P 58547d0a4c884760a04a11291f8bfafa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 58547d0a4c884760a04a11291f8bfafa; no voters:
I20260805 22:51:31.846720 15681 leader_election.cc:288] T 00000000000000000000000000000000 P 58547d0a4c884760a04a11291f8bfafa [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:51:31.846755 15689 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 58547d0a4c884760a04a11291f8bfafa [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:51:31.846905 15689 raft_consensus.cc:686] T 00000000000000000000000000000000 P 58547d0a4c884760a04a11291f8bfafa [term 1 LEADER]: Becoming Leader. State: Replica: 58547d0a4c884760a04a11291f8bfafa, State: Running, Role: LEADER
I20260805 22:51:31.847010 15681 sys_catalog.cc:564] T 00000000000000000000000000000000 P 58547d0a4c884760a04a11291f8bfafa [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:51:31.847055 15689 consensus_queue.cc:237] T 00000000000000000000000000000000 P 58547d0a4c884760a04a11291f8bfafa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58547d0a4c884760a04a11291f8bfafa" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 38859 } }
I20260805 22:51:31.847431 15689 sys_catalog.cc:455] T 00000000000000000000000000000000 P 58547d0a4c884760a04a11291f8bfafa [sys.catalog]: SysCatalogTable state changed. Reason: New leader 58547d0a4c884760a04a11291f8bfafa. Latest consensus state: current_term: 1 leader_uuid: "58547d0a4c884760a04a11291f8bfafa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58547d0a4c884760a04a11291f8bfafa" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 38859 } } }
I20260805 22:51:31.847441 15691 sys_catalog.cc:455] T 00000000000000000000000000000000 P 58547d0a4c884760a04a11291f8bfafa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "58547d0a4c884760a04a11291f8bfafa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58547d0a4c884760a04a11291f8bfafa" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 38859 } } }
I20260805 22:51:31.847674 15691 sys_catalog.cc:458] T 00000000000000000000000000000000 P 58547d0a4c884760a04a11291f8bfafa [sys.catalog]: This master's current role is: LEADER
I20260805 22:51:31.847599 15689 sys_catalog.cc:458] T 00000000000000000000000000000000 P 58547d0a4c884760a04a11291f8bfafa [sys.catalog]: This master's current role is: LEADER
I20260805 22:51:31.847998 15702 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:51:31.848718 15702 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:51:31.851215 15702 catalog_manager.cc:1347] Generated new cluster ID: 9069d22707e04e0d9ae09fc2ca90d116
I20260805 22:51:31.851289 15702 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:51:31.852227 15686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:31.846262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39867 (local address 127.14.224.190:38859)
0805 22:51:31.846462 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:31.846471 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:31.846507 (+ 36us) server_negotiation.cc:407] Connection header received
0805 22:51:31.846647 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:31.846654 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:31.846705 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:31.847103 (+ 398us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:31.847219 (+ 116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:31.848732 (+ 1513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:31.849922 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:31.850530 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:31.850638 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:31.851515 (+ 877us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:31.851519 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:31.851519 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:51:31.851720 (+ 201us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:31.851759 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:51:31.851776 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:31.851840 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:31.851935 (+ 95us) server_negotiation.cc:299] Negotiation successful
0805 22:51:31.851999 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":90,"threads_started":1}
I20260805 22:51:31.853166 15234 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:51:31.855979 15702 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:51:31.856624 15702 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:51:31.858117 15686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:31.854698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45281 (local address 127.14.224.190:38859)
0805 22:51:31.854746 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:31.854748 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:31.854815 (+ 67us) server_negotiation.cc:407] Connection header received
0805 22:51:31.854887 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:31.854888 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:31.854897 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:31.854959 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:31.855097 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:31.855744 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:31.856769 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:31.857118 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:31.857195 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:31.857852 (+ 657us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:31.857853 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:31.857853 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:51:31.857859 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:31.857879 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:51:31.857883 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:31.857937 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:31.857988 (+ 51us) server_negotiation.cc:299] Negotiation successful
0805 22:51:31.858033 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260805 22:51:31.862011 15702 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 58547d0a4c884760a04a11291f8bfafa: Generated new TSK 0
I20260805 22:51:31.862180 15702 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:51:31.866452 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 15592
2026-08-05T22:51:31Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1400 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970021300824-15234-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:51:31 dist-test-slave-gjrz krb5kdc[15731](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:51:31 dist-test-slave-gjrz krb5kdc[15731](info): set up 2 sockets
Aug 05 22:51:31 dist-test-slave-gjrz krb5kdc[15731](info): commencing operation
krb5kdc: starting...
W20260805 22:51:33.012944 15234 mini_kdc.cc:121] Time spent starting KDC: real 1.119s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Aug 05 22:51:33 dist-test-slave-gjrz krb5kdc[15731](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970293, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:51:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:51:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.224.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab.
Entry for principal kudu/127.14.224.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab.
I20260805 22:51:33.142526 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970021300824-15234-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970021300824-15234-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970021300824-15234-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:46277
--webserver_interface=127.14.224.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:38533
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.224.190:46277
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:51:33.231036 15747 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:51:33.231377 15747 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:51:33.231411 15747 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:51:33.232961 15747 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:51:33.233031 15747 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:51:33.233052 15747 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:51:33.233071 15747 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:51:33.233147 15747 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:51:33.235124 15747 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:38533
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970021300824-15234-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970021300824-15234-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.224.190:46277
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:46277
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.224.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15747
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970021300824-15234-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:51:33.235430 15747 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:51:33.235641 15747 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:51:33.240520 15754 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:51:33.240540 15747 server_base.cc:1034] running on GCE node
W20260805 22:51:33.240513 15753 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:33.240513 15756 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:51:33.241008 15747 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:51:33.241297 15747 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:51:33.242472 15747 hybrid_clock.cc:648] HybridClock initialized: now 1785970293242445 us; error 33 us; skew 500 ppm
Aug 05 22:51:33 dist-test-slave-gjrz krb5kdc[15731](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970293, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:51:33.245224 15747 init.cc:377] Logged in from keytab as kudu/127.14.224.190@KRBTEST.COM (short username kudu)
I20260805 22:51:33.245718 15747 webserver.cc:460] Webserver started at http://127.14.224.190:42927/ using document root <none> and password file <none>
I20260805 22:51:33.245949 15747 fs_manager.cc:359] Metadata directory not provided
I20260805 22:51:33.245997 15747 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:51:33.246133 15747 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:51:33.247220 15747 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970021300824-15234-0/minicluster-data/master-0/data/instance:
uuid: "27e0542c33354b60bf79c4877cf07748"
format_stamp: "Formatted at 2026-08-05 22:51:33 on dist-test-slave-gjrz"
server_key: "668bd3490698e72a9181313184628899"
server_key_iv: "92b456ba7cd2c398f7195d108d95a36f"
server_key_version: "encryptionkey@0"
I20260805 22:51:33.247644 15747 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970021300824-15234-0/minicluster-data/master-0/wal/instance:
uuid: "27e0542c33354b60bf79c4877cf07748"
format_stamp: "Formatted at 2026-08-05 22:51:33 on dist-test-slave-gjrz"
server_key: "668bd3490698e72a9181313184628899"
server_key_iv: "92b456ba7cd2c398f7195d108d95a36f"
server_key_version: "encryptionkey@0"
I20260805 22:51:33.248979 15747 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:51:33.249703 15766 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:33.249864 15747 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260805 22:51:33.249953 15747 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970021300824-15234-0/minicluster-data/master-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970021300824-15234-0/minicluster-data/master-0/wal
uuid: "27e0542c33354b60bf79c4877cf07748"
format_stamp: "Formatted at 2026-08-05 22:51:33 on dist-test-slave-gjrz"
server_key: "668bd3490698e72a9181313184628899"
server_key_iv: "92b456ba7cd2c398f7195d108d95a36f"
server_key_version: "encryptionkey@0"
I20260805 22:51:33.250031 15747 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970021300824-15234-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970021300824-15234-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970021300824-15234-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:51:33.253644 15747 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:51:33.255892 15747 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:51:33.256016 15747 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:51:33.259966 15747 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.190:46277
I20260805 22:51:33.260007 15829 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.190:46277 every 8 connection(s)
I20260805 22:51:33.260325 15747 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
I20260805 22:51:33.261348 15830 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:51:33.263789 15830 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 27e0542c33354b60bf79c4877cf07748: Bootstrap starting.
I20260805 22:51:33.264356 15830 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 27e0542c33354b60bf79c4877cf07748: Neither blocks nor log segments found. Creating new log.
I20260805 22:51:33.264597 15830 log.cc:824] T 00000000000000000000000000000000 P 27e0542c33354b60bf79c4877cf07748: Log is configured to *not* fsync() on all Append() calls
I20260805 22:51:33.265329 15830 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 27e0542c33354b60bf79c4877cf07748: No bootstrap required, opened a new log
I20260805 22:51:33.266927 15830 raft_consensus.cc:348] T 00000000000000000000000000000000 P 27e0542c33354b60bf79c4877cf07748 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27e0542c33354b60bf79c4877cf07748" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 46277 } }
I20260805 22:51:33.267086 15830 raft_consensus.cc:374] T 00000000000000000000000000000000 P 27e0542c33354b60bf79c4877cf07748 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:51:33.267108 15830 raft_consensus.cc:729] T 00000000000000000000000000000000 P 27e0542c33354b60bf79c4877cf07748 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27e0542c33354b60bf79c4877cf07748, State: Initialized, Role: FOLLOWER
I20260805 22:51:33.267232 15830 consensus_queue.cc:260] T 00000000000000000000000000000000 P 27e0542c33354b60bf79c4877cf07748 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27e0542c33354b60bf79c4877cf07748" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 46277 } }
I20260805 22:51:33.267333 15830 raft_consensus.cc:388] T 00000000000000000000000000000000 P 27e0542c33354b60bf79c4877cf07748 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:51:33.267369 15830 raft_consensus.cc:482] T 00000000000000000000000000000000 P 27e0542c33354b60bf79c4877cf07748 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:51:33.267421 15830 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 27e0542c33354b60bf79c4877cf07748 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:51:33.268347 15830 raft_consensus.cc:504] T 00000000000000000000000000000000 P 27e0542c33354b60bf79c4877cf07748 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27e0542c33354b60bf79c4877cf07748" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 46277 } }
I20260805 22:51:33.268505 15830 leader_election.cc:302] T 00000000000000000000000000000000 P 27e0542c33354b60bf79c4877cf07748 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 27e0542c33354b60bf79c4877cf07748; no voters:
I20260805 22:51:33.268584 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 15747
I20260805 22:51:33.268702 15830 leader_election.cc:288] T 00000000000000000000000000000000 P 27e0542c33354b60bf79c4877cf07748 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:51:33.268729 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970021300824-15234-0/minicluster-data/master-0/wal/instance
I20260805 22:51:33.268748 15835 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 27e0542c33354b60bf79c4877cf07748 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:51:33.268918 15835 raft_consensus.cc:686] T 00000000000000000000000000000000 P 27e0542c33354b60bf79c4877cf07748 [term 1 LEADER]: Becoming Leader. State: Replica: 27e0542c33354b60bf79c4877cf07748, State: Running, Role: LEADER
I20260805 22:51:33.268942 15234 external_mini_cluster.cc:1428] Setting key 4ca1f9632cb2cd00bbab1b1bae48a2b3
I20260805 22:51:33.269006 15830 sys_catalog.cc:564] T 00000000000000000000000000000000 P 27e0542c33354b60bf79c4877cf07748 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:51:33.269052 15835 consensus_queue.cc:237] T 00000000000000000000000000000000 P 27e0542c33354b60bf79c4877cf07748 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27e0542c33354b60bf79c4877cf07748" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 46277 } }
I20260805 22:51:33.269405 15835 sys_catalog.cc:455] T 00000000000000000000000000000000 P 27e0542c33354b60bf79c4877cf07748 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 27e0542c33354b60bf79c4877cf07748. Latest consensus state: current_term: 1 leader_uuid: "27e0542c33354b60bf79c4877cf07748" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27e0542c33354b60bf79c4877cf07748" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 46277 } } }
I20260805 22:51:33.269500 15835 sys_catalog.cc:458] T 00000000000000000000000000000000 P 27e0542c33354b60bf79c4877cf07748 [sys.catalog]: This master's current role is: LEADER
I20260805 22:51:33.269665 15837 sys_catalog.cc:455] T 00000000000000000000000000000000 P 27e0542c33354b60bf79c4877cf07748 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "27e0542c33354b60bf79c4877cf07748" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27e0542c33354b60bf79c4877cf07748" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 46277 } } }
I20260805 22:51:33.269804 15837 sys_catalog.cc:458] T 00000000000000000000000000000000 P 27e0542c33354b60bf79c4877cf07748 [sys.catalog]: This master's current role is: LEADER
I20260805 22:51:33.270448 15843 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:51:33.271163 15843 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:51:33.271339 15841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:33.269451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41245 (local address 127.14.224.190:46277)
0805 22:51:33.269728 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:33.269738 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:33.269777 (+ 39us) server_negotiation.cc:407] Connection header received
0805 22:51:33.269909 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:33.269917 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:33.269950 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:33.270091 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:33.270822 (+ 731us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:33.270825 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:33.270826 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:51:33.270831 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:33.270870 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:51:33.270882 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:33.270941 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:33.271021 (+ 80us) server_negotiation.cc:299] Negotiation successful
0805 22:51:33.271063 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":220,"thread_start_us":70,"threads_started":1}
I20260805 22:51:33.272480 15234 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:51:33.272831 15843 catalog_manager.cc:1347] Generated new cluster ID: 314e4e8bf39e4ae2b4d6b7bd9a628745
I20260805 22:51:33.272876 15843 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:51:33.275163 15841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:33.274165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35449 (local address 127.14.224.190:46277)
0805 22:51:33.274204 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:33.274206 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:33.274216 (+ 10us) server_negotiation.cc:407] Connection header received
0805 22:51:33.274296 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:33.274296 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:33.274302 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:33.274358 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:33.274956 (+ 598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:33.274958 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:33.274958 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:51:33.274962 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:33.274978 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:51:33.274982 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:33.275033 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:33.275087 (+ 54us) server_negotiation.cc:299] Negotiation successful
0805 22:51:33.275098 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260805 22:51:33.277789 15843 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:51:33.277973 15843 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:51:33.287472 15843 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 27e0542c33354b60bf79c4877cf07748: Generated new TSK 0
I20260805 22:51:33.287703 15843 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:51:33.290452 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 15747
2026-08-05T22:51:33Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1440 ms)
[----------] 18 tests from AuthTokenIssuingTest (25664 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:51:33 dist-test-slave-gjrz krb5kdc[15870](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:51:33 dist-test-slave-gjrz krb5kdc[15870](info): set up 2 sockets
Aug 05 22:51:33 dist-test-slave-gjrz krb5kdc[15870](info): commencing operation
krb5kdc: starting...
W20260805 22:51:34.444644 15234 mini_kdc.cc:121] Time spent starting KDC: real 1.110s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Aug 05 22:51:34 dist-test-slave-gjrz krb5kdc[15870](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970294, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:51:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:51:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.224.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab.
Entry for principal kudu/127.14.224.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab.
I20260805 22:51:34.574088 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:41743
--webserver_interface=127.14.224.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:38989
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.224.190:41743,127.14.224.189:42591,127.14.224.188:41525
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:51:34.659037 15895 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260805 22:51:34.659325 15895 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:51:34.659354 15895 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:51:34.659395 15895 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:51:34.660687 15895 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:51:34.660740 15895 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:51:34.660759 15895 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:51:34.660775 15895 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:51:34.660791 15895 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:51:34.662444 15895 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:38989
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.224.190:41743,127.14.224.189:42591,127.14.224.188:41525
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:41743
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.224.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15895
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:51:34.662727 15895 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:51:34.662968 15895 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:51:34.668512 15905 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:34.668380 15900 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:34.668380 15901 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:51:34.668478 15895 server_base.cc:1034] running on GCE node
I20260805 22:51:34.669121 15895 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:51:34.669437 15895 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:51:34.670624 15895 hybrid_clock.cc:648] HybridClock initialized: now 1785970294670609 us; error 30 us; skew 500 ppm
Aug 05 22:51:34 dist-test-slave-gjrz krb5kdc[15870](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970294, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:51:34.676713 15895 init.cc:377] Logged in from keytab as kudu/127.14.224.190@KRBTEST.COM (short username kudu)
I20260805 22:51:34.677253 15895 webserver.cc:460] Webserver started at http://127.14.224.190:40741/ using document root <none> and password file <none>
I20260805 22:51:34.677510 15895 fs_manager.cc:359] Metadata directory not provided
I20260805 22:51:34.677563 15895 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:51:34.677693 15895 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:51:34.678828 15895 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/minicluster-data/master-0/data/instance:
uuid: "7415b0d62ea0497890c3b7c0ea19d616"
format_stamp: "Formatted at 2026-08-05 22:51:34 on dist-test-slave-gjrz"
server_key: "5cd40ced9feab2a569646900987c7168"
server_key_iv: "713889f944d215716e304ea520e807c8"
server_key_version: "encryptionkey@0"
I20260805 22:51:34.679172 15895 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/minicluster-data/master-0/wal/instance:
uuid: "7415b0d62ea0497890c3b7c0ea19d616"
format_stamp: "Formatted at 2026-08-05 22:51:34 on dist-test-slave-gjrz"
server_key: "5cd40ced9feab2a569646900987c7168"
server_key_iv: "713889f944d215716e304ea520e807c8"
server_key_version: "encryptionkey@0"
I20260805 22:51:34.680656 15895 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:51:34.681489 15913 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:34.681646 15895 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:51:34.681738 15895 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/minicluster-data/master-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/minicluster-data/master-0/wal
uuid: "7415b0d62ea0497890c3b7c0ea19d616"
format_stamp: "Formatted at 2026-08-05 22:51:34 on dist-test-slave-gjrz"
server_key: "5cd40ced9feab2a569646900987c7168"
server_key_iv: "713889f944d215716e304ea520e807c8"
server_key_version: "encryptionkey@0"
I20260805 22:51:34.681804 15895 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:51:34.693447 15895 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:51:34.695650 15895 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:51:34.695815 15895 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:51:34.699878 15895 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.190:41743
I20260805 22:51:34.699925 15984 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.190:41743 every 8 connection(s)
I20260805 22:51:34.700311 15895 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
I20260805 22:51:34.701224 15986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:51:34.702934 15986 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.224.190" port: 41743 } has no permanent_uuid. Determining permanent_uuid...
Aug 05 22:51:34 dist-test-slave-gjrz krb5kdc[15870](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970294, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.190@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:51:34.710248 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 15895
I20260805 22:51:34.710362 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/minicluster-data/master-0/wal/instance
I20260805 22:51:34.710566 15234 external_mini_cluster.cc:1428] Setting key 76fe26c7b5c0988f434e432ab2565b42
I20260805 22:51:34.712880 15988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:34.703699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34056 (local address 127.14.224.190:41743)
0805 22:51:34.703894 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:34.703904 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:34.703991 (+ 87us) server_negotiation.cc:407] Connection header received
0805 22:51:34.704525 (+ 534us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:34.704528 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:34.704546 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:34.704629 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:34.705152 (+ 523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:34.705961 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:34.706994 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:34.707384 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:34.707469 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:34.709509 (+ 2040us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:34.709517 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:34.709518 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:51:34.709525 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:34.711218 (+ 1693us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:34.711632 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:34.711636 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:34.711636 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:34.711747 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:34.711937 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:34.711937 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:34.711938 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:34.712235 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:34.712323 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:34.712597 (+ 274us) server_negotiation.cc:299] Negotiation successful
0805 22:51:34.712709 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":90,"threads_started":1}
I20260805 22:51:34.712986 15989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:34.703699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:41743 (local address 127.0.0.1:34056)
0805 22:51:34.703894 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:34.703924 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0805 22:51:34.704392 (+ 468us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:51:34.704641 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:51:34.704643 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:51:34.704896 (+ 253us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:51:34.705061 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:34.705065 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:34.706074 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:34.706075 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:34.706897 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:34.706900 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:34.707475 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:34.707476 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:34.707541 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:34.708047 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:51:34.708056 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:51:34.709420 (+ 1364us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:51:34.711344 (+ 1924us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:51:34.711352 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:51:34.711354 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:51:34.711557 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:51:34.711808 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:51:34.711808 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:51:34.711808 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:51:34.711884 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:51:34.712335 (+ 451us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:51:34.712345 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:51:34.712434 (+ 89us) client_negotiation.cc:769] Sending connection context
0805 22:51:34.712548 (+ 114us) client_negotiation.cc:240] Negotiation successful
0805 22:51:34.712808 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"mutex_wait_us":86,"thread_start_us":94,"threads_started":1}
I20260805 22:51:34.713979 15986 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.224.189" port: 42591 } has no permanent_uuid. Determining permanent_uuid...
I20260805 22:51:34.714371 15989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:34.714242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.189:42591 (local address 127.0.0.1:51160)
0805 22:51:34.714292 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:34.714345 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.189:42591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260805 22:51:34.714524 15918 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.224.189:42591: connect: Connection refused (error 111)
I20260805 22:51:34.714995 15989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:34.714871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.189:42591 (local address 127.0.0.1:51164)
0805 22:51:34.714927 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:34.714971 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.189:42591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260805 22:51:34.715102 15986 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.224.189:42591: Network error: Client connection negotiation failed: client connection to 127.14.224.189:42591: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.14.224.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.189.keytab.
Entry for principal kudu/127.14.224.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.189.keytab.
I20260805 22:51:34.738606 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.189:42591
--webserver_interface=127.14.224.189
--webserver_port=0
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.189.keytab
--principal=kudu/127.14.224.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:38989
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.224.190:41743,127.14.224.189:42591,127.14.224.188:41525
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 22:51:34.764345 15986 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.224.189" port: 42591 } attempt: 1
I20260805 22:51:34.764910 15989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:34.764759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.189:42591 (local address 127.0.0.1:51176)
0805 22:51:34.764825 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:34.764876 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.189:42591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260805 22:51:34.765244 15989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:34.765156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.189:42591 (local address 127.0.0.1:51184)
0805 22:51:34.765197 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:34.765226 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.189:42591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260805 22:51:34.765324 15986 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.224.189:42591: Network error: Client connection negotiation failed: client connection to 127.14.224.189:42591: connect: Connection refused (error 111)
W20260805 22:51:34.822978 15997 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260805 22:51:34.823227 15997 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:51:34.823244 15997 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:51:34.823293 15997 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:51:34.824584 15997 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:51:34.824635 15997 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:51:34.824651 15997 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:51:34.824661 15997 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:51:34.824674 15997 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:51:34.826323 15997 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:38989
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.14.224.190:41743,127.14.224.189:42591,127.14.224.188:41525
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.189.keytab
--principal=kudu/127.14.224.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.189:42591
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.14.224.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15997
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:51:34.826607 15997 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:51:34.826838 15997 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:51:34.831950 16006 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:34.831939 16004 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:34.831939 16002 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:51:34.832441 15997 server_base.cc:1034] running on GCE node
I20260805 22:51:34.832744 15997 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:51:34.833087 15997 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:51:34.833477 15986 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.224.189" port: 42591 } attempt: 2
I20260805 22:51:34.833840 15989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:34.833729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.189:42591 (local address 127.0.0.1:51194)
0805 22:51:34.833780 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:34.833811 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.189:42591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260805 22:51:34.834134 15989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:34.834051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.189:42591 (local address 127.0.0.1:51204)
0805 22:51:34.834089 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:34.834112 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.189:42591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260805 22:51:34.834208 15986 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.224.189:42591: Network error: Client connection negotiation failed: client connection to 127.14.224.189:42591: connect: Connection refused (error 111)
I20260805 22:51:34.834239 15997 hybrid_clock.cc:648] HybridClock initialized: now 1785970294834215 us; error 35 us; skew 500 ppm
Aug 05 22:51:34 dist-test-slave-gjrz krb5kdc[15870](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970294, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:51:34.836879 15997 init.cc:377] Logged in from keytab as kudu/127.14.224.189@KRBTEST.COM (short username kudu)
I20260805 22:51:34.837363 15997 webserver.cc:460] Webserver started at http://127.14.224.189:41813/ using document root <none> and password file <none>
I20260805 22:51:34.837575 15997 fs_manager.cc:359] Metadata directory not provided
I20260805 22:51:34.837618 15997 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:51:34.837709 15997 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:51:34.838776 15997 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/minicluster-data/master-1/data/instance:
uuid: "c43e1f1e2ee04d1bb83c518864b083e4"
format_stamp: "Formatted at 2026-08-05 22:51:34 on dist-test-slave-gjrz"
server_key: "bdf15d38febb46f1e599ed824703adb1"
server_key_iv: "b05248151429f8c3ed9959eea3251bba"
server_key_version: "encryptionkey@0"
I20260805 22:51:34.839097 15997 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/minicluster-data/master-1/wal/instance:
uuid: "c43e1f1e2ee04d1bb83c518864b083e4"
format_stamp: "Formatted at 2026-08-05 22:51:34 on dist-test-slave-gjrz"
server_key: "bdf15d38febb46f1e599ed824703adb1"
server_key_iv: "b05248151429f8c3ed9959eea3251bba"
server_key_version: "encryptionkey@0"
I20260805 22:51:34.840449 15997 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260805 22:51:34.841162 16014 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:34.841341 15997 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260805 22:51:34.841436 15997 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/minicluster-data/master-1/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/minicluster-data/master-1/wal
uuid: "c43e1f1e2ee04d1bb83c518864b083e4"
format_stamp: "Formatted at 2026-08-05 22:51:34 on dist-test-slave-gjrz"
server_key: "bdf15d38febb46f1e599ed824703adb1"
server_key_iv: "b05248151429f8c3ed9959eea3251bba"
server_key_version: "encryptionkey@0"
I20260805 22:51:34.841504 15997 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:51:34.856418 15997 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:51:34.858253 15997 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:51:34.858367 15997 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:51:34.862895 15997 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.189:42591
I20260805 22:51:34.862934 16086 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.189:42591 every 8 connection(s)
I20260805 22:51:34.863325 15997 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/minicluster-data/master-1/data/info.pb
I20260805 22:51:34.864259 16088 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:51:34.864686 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 15997
I20260805 22:51:34.864768 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/minicluster-data/master-1/wal/instance
I20260805 22:51:34.864939 15234 external_mini_cluster.cc:1428] Setting key 97db7712d4916cdbcfb3c7a86d29879b
I20260805 22:51:34.865995 16088 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.224.190" port: 41743 } has no permanent_uuid. Determining permanent_uuid...
Aug 05 22:51:34 dist-test-slave-gjrz krb5kdc[15870](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970294, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.189@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.14.224.188@KRBTEST.COM; defaulting to no policy
I20260805 22:51:34.875861 15988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:34.866823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34058 (local address 127.14.224.190:41743)
0805 22:51:34.866899 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:34.866901 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:34.867178 (+ 277us) server_negotiation.cc:407] Connection header received
0805 22:51:34.867904 (+ 726us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:34.867905 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:34.867921 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:34.867978 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:34.868661 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:34.869396 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:34.870384 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:34.870699 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:34.870782 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:34.872930 (+ 2148us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:34.872932 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:34.872933 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:51:34.872943 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:34.874311 (+ 1368us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:34.874829 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:34.874831 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:34.874831 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:34.874897 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:34.875193 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:34.875194 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:34.875194 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:34.875340 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:34.875395 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:34.875705 (+ 310us) server_negotiation.cc:299] Negotiation successful
0805 22:51:34.875789 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260805 22:51:34.876196 16092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:34.866813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:41743 (local address 127.0.0.1:34058)
0805 22:51:34.867019 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:34.867076 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0805 22:51:34.867772 (+ 696us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:51:34.868059 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:51:34.868063 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:51:34.868329 (+ 266us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:51:34.868558 (+ 229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:34.868563 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:34.869498 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:34.869499 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:34.870292 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:34.870294 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:34.870786 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:34.870787 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:34.870904 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:34.871448 (+ 544us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:51:34.871457 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:51:34.872827 (+ 1370us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:51:34.874419 (+ 1592us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:51:34.874429 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:51:34.874431 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:51:34.874749 (+ 318us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:51:34.874999 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:51:34.875000 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:51:34.875001 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:51:34.875137 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:51:34.875408 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:51:34.875416 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:51:34.875563 (+ 147us) client_negotiation.cc:769] Sending connection context
0805 22:51:34.875670 (+ 107us) client_negotiation.cc:240] Negotiation successful
0805 22:51:34.875820 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":92,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.188@KRBTEST.COM" created.
I20260805 22:51:34.876928 16088 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.224.189" port: 42591 } has no permanent_uuid. Determining permanent_uuid...
Aug 05 22:51:34 dist-test-slave-gjrz krb5kdc[15870](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970294, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.189@KRBTEST.COM for kudu/127.14.224.189@KRBTEST.COM
I20260805 22:51:34.885823 16092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:34.877272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.189:42591 (local address 127.0.0.1:51210)
0805 22:51:34.877325 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:34.877339 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0805 22:51:34.877389 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:51:34.879082 (+ 1693us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:51:34.879083 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:51:34.879228 (+ 145us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:51:34.879326 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:34.879328 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:34.880201 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:34.880202 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:34.880694 (+ 492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:34.880695 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:34.881221 (+ 526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:34.881222 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:34.881287 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:34.881700 (+ 413us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:51:34.881706 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:51:34.882950 (+ 1244us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:51:34.884646 (+ 1696us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:51:34.884647 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:51:34.884647 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:51:34.884829 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:51:34.885034 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:51:34.885035 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:51:34.885035 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:51:34.885084 (+ 49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:51:34.885445 (+ 361us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:51:34.885447 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:51:34.885505 (+ 58us) client_negotiation.cc:769] Sending connection context
0805 22:51:34.885583 (+ 78us) client_negotiation.cc:240] Negotiation successful
0805 22:51:34.885714 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260805 22:51:34.885923 16096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:34.878762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51210 (local address 127.14.224.189:42591)
0805 22:51:34.878938 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:34.878944 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:34.878965 (+ 21us) server_negotiation.cc:407] Connection header received
0805 22:51:34.878987 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:34.878988 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:34.879000 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:34.879071 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:34.879400 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:34.880120 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:34.880764 (+ 644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:34.881154 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:34.881218 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:34.883031 (+ 1813us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:34.883043 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:34.883043 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:51:34.883050 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:34.884570 (+ 1520us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:34.884905 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:34.884909 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:34.884910 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:34.884973 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:34.885162 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:34.885163 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:34.885163 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:34.885326 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:34.885395 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:34.885625 (+ 230us) server_negotiation.cc:299] Negotiation successful
0805 22:51:34.885802 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":74,"server-negotiator.queue_time_us":143,"thread_start_us":92,"threads_started":1}
I20260805 22:51:34.886713 16088 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.224.188" port: 41525 } has no permanent_uuid. Determining permanent_uuid...
I20260805 22:51:34.887147 16092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:34.887016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.188:41525 (local address 127.0.0.1:38276)
0805 22:51:34.887067 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:34.887122 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.188:41525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260805 22:51:34.887312 16016 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.224.188:41525: connect: Connection refused (error 111)
I20260805 22:51:34.887786 16092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:34.887685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.188:41525 (local address 127.0.0.1:38280)
0805 22:51:34.887732 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:34.887760 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.188:41525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260805 22:51:34.887890 16088 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.224.188:41525: Network error: Client connection negotiation failed: client connection to 127.14.224.188:41525: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.188.keytab.
Entry for principal kudu/127.14.224.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.188.keytab.
I20260805 22:51:34.894820 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.188:41525
--webserver_interface=127.14.224.188
--webserver_port=0
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.188.keytab
--principal=kudu/127.14.224.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:38989
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.224.190:41743,127.14.224.189:42591,127.14.224.188:41525
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 22:51:34.925375 15986 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.224.189" port: 42591 } attempt: 3
Aug 05 22:51:34 dist-test-slave-gjrz krb5kdc[15870](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970294, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.190@KRBTEST.COM for kudu/127.14.224.189@KRBTEST.COM
I20260805 22:51:34.933153 15989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:34.925792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.189:42591 (local address 127.0.0.1:51220)
0805 22:51:34.925856 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:34.925868 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:51:34.925910 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:51:34.926249 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:51:34.926251 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:51:34.926416 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:51:34.926485 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:34.926487 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:34.927453 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:34.927455 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:34.927989 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:34.927991 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:34.928472 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:34.928472 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:34.928527 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:34.928964 (+ 437us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:51:34.928969 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:51:34.930354 (+ 1385us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:51:34.932065 (+ 1711us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:51:34.932066 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:51:34.932067 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:51:34.932244 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:51:34.932472 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:51:34.932478 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:51:34.932479 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:51:34.932548 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:51:34.932857 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:51:34.932858 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:51:34.932907 (+ 49us) client_negotiation.cc:769] Sending connection context
0805 22:51:34.932989 (+ 82us) client_negotiation.cc:240] Negotiation successful
0805 22:51:34.933080 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260805 22:51:34.933204 16096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:34.925989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51220 (local address 127.14.224.189:42591)
0805 22:51:34.926054 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:34.926056 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:34.926068 (+ 12us) server_negotiation.cc:407] Connection header received
0805 22:51:34.926101 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:34.926102 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:34.926116 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:34.926197 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:34.926572 (+ 375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:34.927368 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:34.928069 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:34.928405 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:34.928477 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:34.930449 (+ 1972us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:34.930450 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:34.930451 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:51:34.930459 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:34.931962 (+ 1503us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:34.932318 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:34.932319 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:34.932319 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:34.932383 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:34.932623 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:34.932624 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:34.932624 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:34.932769 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:34.932841 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:34.933024 (+ 183us) server_negotiation.cc:299] Negotiation successful
0805 22:51:34.933110 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260805 22:51:34.933678 15986 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.224.188" port: 41525 } has no permanent_uuid. Determining permanent_uuid...
I20260805 22:51:34.934052 15989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:34.933954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.188:41525 (local address 127.0.0.1:38282)
0805 22:51:34.934000 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:34.934030 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.188:41525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260805 22:51:34.934444 15989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:34.934320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.188:41525 (local address 127.0.0.1:38290)
0805 22:51:34.934388 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:34.934421 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.188:41525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260805 22:51:34.934564 15986 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.224.188:41525: Network error: Client connection negotiation failed: client connection to 127.14.224.188:41525: connect: Connection refused (error 111)
I20260805 22:51:34.937129 16088 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.224.188" port: 41525 } attempt: 1
I20260805 22:51:34.937583 16092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:34.937435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.188:41525 (local address 127.0.0.1:38302)
0805 22:51:34.937517 (+ 82us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:34.937556 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.188:41525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260805 22:51:34.937907 16092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:34.937817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.188:41525 (local address 127.0.0.1:38312)
0805 22:51:34.937861 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:34.937887 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.188:41525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260805 22:51:34.937999 16088 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.224.188:41525: Network error: Client connection negotiation failed: client connection to 127.14.224.188:41525: connect: Connection refused (error 111)
I20260805 22:51:34.965739 15986 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.224.188" port: 41525 } attempt: 1
I20260805 22:51:34.966235 15989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:34.966116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.188:41525 (local address 127.0.0.1:38326)
0805 22:51:34.966174 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:34.966207 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.188:41525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260805 22:51:34.966629 15989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:34.966487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.188:41525 (local address 127.0.0.1:38332)
0805 22:51:34.966551 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:34.966596 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.188:41525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260805 22:51:34.966779 15986 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.224.188:41525: Network error: Client connection negotiation failed: client connection to 127.14.224.188:41525: connect: Connection refused (error 111)
W20260805 22:51:34.981762 16098 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260805 22:51:34.982010 16098 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:51:34.982028 16098 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:51:34.982049 16098 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:51:34.983326 16098 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:51:34.983383 16098 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:51:34.983395 16098 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:51:34.983407 16098 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:51:34.983421 16098 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:51:34.985086 16098 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:38989
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.14.224.190:41743,127.14.224.189:42591,127.14.224.188:41525
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.188.keytab
--principal=kudu/127.14.224.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.188:41525
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.14.224.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16098
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:51:34.985357 16098 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:51:34.985590 16098 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:51:34.990427 16110 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:34.990427 16104 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:34.990445 16107 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:51:34.990707 16098 server_base.cc:1034] running on GCE node
I20260805 22:51:34.990969 16098 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:51:34.991320 16098 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:51:34.992493 16098 hybrid_clock.cc:648] HybridClock initialized: now 1785970294992473 us; error 36 us; skew 500 ppm
Aug 05 22:51:34 dist-test-slave-gjrz krb5kdc[15870](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970294, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:51:34.995012 16098 init.cc:377] Logged in from keytab as kudu/127.14.224.188@KRBTEST.COM (short username kudu)
I20260805 22:51:34.995523 16098 webserver.cc:460] Webserver started at http://127.14.224.188:34645/ using document root <none> and password file <none>
I20260805 22:51:34.995748 16098 fs_manager.cc:359] Metadata directory not provided
I20260805 22:51:34.995801 16098 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:51:34.995936 16098 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:51:34.997052 16098 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/minicluster-data/master-2/data/instance:
uuid: "26e613cd24d540d6b0ac02bdfeb1fc54"
format_stamp: "Formatted at 2026-08-05 22:51:34 on dist-test-slave-gjrz"
server_key: "3073246446477c7132686cb48cd0aec1"
server_key_iv: "63116743ccc01cf1cab37c5abb7e080d"
server_key_version: "encryptionkey@0"
I20260805 22:51:34.997408 16098 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/minicluster-data/master-2/wal/instance:
uuid: "26e613cd24d540d6b0ac02bdfeb1fc54"
format_stamp: "Formatted at 2026-08-05 22:51:34 on dist-test-slave-gjrz"
server_key: "3073246446477c7132686cb48cd0aec1"
server_key_iv: "63116743ccc01cf1cab37c5abb7e080d"
server_key_version: "encryptionkey@0"
I20260805 22:51:34.998739 16098 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260805 22:51:34.999500 16122 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:34.999644 16098 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260805 22:51:34.999732 16098 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/minicluster-data/master-2/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/minicluster-data/master-2/wal
uuid: "26e613cd24d540d6b0ac02bdfeb1fc54"
format_stamp: "Formatted at 2026-08-05 22:51:34 on dist-test-slave-gjrz"
server_key: "3073246446477c7132686cb48cd0aec1"
server_key_iv: "63116743ccc01cf1cab37c5abb7e080d"
server_key_version: "encryptionkey@0"
I20260805 22:51:34.999795 16098 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:51:35.006146 16088 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.224.188" port: 41525 } attempt: 2
I20260805 22:51:35.006596 16092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:35.006449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.188:41525 (local address 127.0.0.1:38336)
0805 22:51:35.006520 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:35.006563 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.188:41525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260805 22:51:35.006994 16092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:35.006871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.188:41525 (local address 127.0.0.1:38340)
0805 22:51:35.006908 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:35.006934 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.188:41525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260805 22:51:35.007081 16088 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.224.188:41525: Network error: Client connection negotiation failed: client connection to 127.14.224.188:41525: connect: Connection refused (error 111)
I20260805 22:51:35.007720 16098 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:51:35.009505 16098 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:51:35.009634 16098 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:51:35.013393 16098 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.188:41525
I20260805 22:51:35.013435 16200 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.188:41525 every 8 connection(s)
I20260805 22:51:35.013767 16098 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/minicluster-data/master-2/data/info.pb
I20260805 22:51:35.014647 16202 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:51:35.016469 16202 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.224.190" port: 41743 } has no permanent_uuid. Determining permanent_uuid...
I20260805 22:51:35.020879 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 16098
I20260805 22:51:35.020983 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970021300824-15234-0/minicluster-data/master-2/wal/instance
I20260805 22:51:35.021152 15234 external_mini_cluster.cc:1428] Setting key 1a590e4e6c6d565b1842469ea6fa84eb
Aug 05 22:51:35 dist-test-slave-gjrz krb5kdc[15870](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970294, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.188@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:51:35.025962 15988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:35.017220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34070 (local address 127.14.224.190:41743)
0805 22:51:35.017274 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:35.017276 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:35.017479 (+ 203us) server_negotiation.cc:407] Connection header received
0805 22:51:35.017960 (+ 481us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:35.017961 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:35.017974 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:35.018039 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:35.018658 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:35.019137 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:35.020158 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:35.020343 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:35.020397 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:35.022952 (+ 2555us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:35.022954 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:35.022954 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:51:35.022964 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:35.024536 (+ 1572us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:35.024976 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:35.024977 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:35.024978 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:35.025040 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:35.025289 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:35.025289 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:35.025289 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:35.025425 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:35.025510 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:35.025774 (+ 264us) server_negotiation.cc:299] Negotiation successful
0805 22:51:35.025861 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260805 22:51:35.026023 16204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:35.017170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:41743 (local address 127.0.0.1:34070)
0805 22:51:35.017347 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:35.017389 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0805 22:51:35.017844 (+ 455us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:51:35.018102 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:51:35.018105 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:51:35.018356 (+ 251us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:51:35.018581 (+ 225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:35.018585 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:35.019235 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:35.019236 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:35.020079 (+ 843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:35.020082 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:35.020407 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:35.020408 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:35.020512 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:35.021051 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:51:35.021062 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:51:35.022856 (+ 1794us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:51:35.024602 (+ 1746us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:51:35.024607 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:51:35.024610 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:51:35.024913 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:51:35.025101 (+ 188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:51:35.025101 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:51:35.025101 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:51:35.025223 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:51:35.025514 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:51:35.025519 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:51:35.025646 (+ 127us) client_negotiation.cc:769] Sending connection context
0805 22:51:35.025734 (+ 88us) client_negotiation.cc:240] Negotiation successful
0805 22:51:35.025851 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":74,"threads_started":1}
I20260805 22:51:35.026589 16202 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.224.189" port: 42591 } has no permanent_uuid. Determining permanent_uuid...
Aug 05 22:51:35 dist-test-slave-gjrz krb5kdc[15870](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970294, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.224.188@KRBTEST.COM
Aug 05 22:51:35 dist-test-slave-gjrz krb5kdc[15870](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970294, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.188@KRBTEST.COM for kudu/127.14.224.189@KRBTEST.COM
I20260805 22:51:35.030794 16206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:35.021553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38352 (local address 127.14.224.188:41525)
0805 22:51:35.021756 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:35.021761 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:35.021790 (+ 29us) server_negotiation.cc:407] Connection header received
0805 22:51:35.021844 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:35.021846 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:35.021863 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:35.021935 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:35.022656 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:35.023469 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:35.024462 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:35.024869 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:35.024941 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:35.027425 (+ 2484us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:35.027432 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:35.027432 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:51:35.027438 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:35.029140 (+ 1702us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:35.029467 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:35.029470 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:35.029471 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:35.029543 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:35.029711 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:35.029712 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:35.029713 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:35.029849 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:35.030007 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:35.030609 (+ 602us) server_negotiation.cc:299] Negotiation successful
0805 22:51:35.030689 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":79,"threads_started":1}
I20260805 22:51:35.033803 16204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:35.026854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.189:42591 (local address 127.0.0.1:51232)
0805 22:51:35.026894 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:35.026905 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:51:35.026942 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:51:35.027095 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:51:35.027096 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:51:35.027209 (+ 113us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:51:35.027256 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:35.027258 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:35.027981 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:35.027982 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:35.028724 (+ 742us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:35.028726 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:35.029075 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:35.029076 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:35.029151 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:35.029470 (+ 319us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:51:35.029474 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:51:35.030593 (+ 1119us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:51:35.032704 (+ 2111us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:51:35.032705 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:51:35.032706 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:51:35.032926 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:51:35.033182 (+ 256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:51:35.033183 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:51:35.033183 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:51:35.033246 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:51:35.033502 (+ 256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:51:35.033502 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:51:35.033547 (+ 45us) client_negotiation.cc:769] Sending connection context
0805 22:51:35.033607 (+ 60us) client_negotiation.cc:240] Negotiation successful
0805 22:51:35.033707 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23}
I20260805 22:51:35.033820 16096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:35.026937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51232 (local address 127.14.224.189:42591)
0805 22:51:35.026985 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:35.026987 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:35.026995 (+ 8us) server_negotiation.cc:407] Connection header received
0805 22:51:35.027021 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:35.027022 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:35.027031 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:35.027093 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:35.027348 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:35.027903 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:35.028801 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:35.029007 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:35.029059 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:35.030692 (+ 1633us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:35.030693 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:35.030693 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:51:35.030701 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:35.032626 (+ 1925us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:35.033025 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:35.033027 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:35.033027 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:35.033089 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:35.033303 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:35.033304 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:35.033305 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:35.033439 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:35.033500 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:35.033639 (+ 139us) server_negotiation.cc:299] Negotiation successful
0805 22:51:35.033737 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260805 22:51:35.034333 16202 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.224.188" port: 41525 } has no permanent_uuid. Determining permanent_uuid...
Aug 05 22:51:35 dist-test-slave-gjrz krb5kdc[15870](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970294, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
Aug 05 22:51:35 dist-test-slave-gjrz krb5kdc[15870](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970294, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.188@KRBTEST.COM for kudu/127.14.224.188@KRBTEST.COM
I20260805 22:51:35.038383 15988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:35.031635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34080 (local address 127.14.224.190:41743)
0805 22:51:35.031704 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:35.031707 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:35.031814 (+ 107us) server_negotiation.cc:407] Connection header received
0805 22:51:35.031868 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:35.031869 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:35.031880 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:35.031925 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:35.032394 (+ 469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:35.032987 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:35.033610 (+ 623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:35.033829 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:35.033882 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:35.036120 (+ 2238us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:35.036121 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:35.036122 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:51:35.036130 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:35.037369 (+ 1239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:35.037675 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:35.037676 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:35.037676 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:35.037733 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:35.037888 (+ 155us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:35.037889 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:35.037890 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:35.038017 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:35.038185 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:35.038220 (+ 35us) server_negotiation.cc:299] Negotiation successful
0805 22:51:35.038294 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260805 22:51:35.040743 16204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:35.034578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.188:41525 (local address 127.0.0.1:38358)
0805 22:51:35.034626 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:35.034636 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0805 22:51:35.034671 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:51:35.034831 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:51:35.034832 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:51:35.034975 (+ 143us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:51:35.035008 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:35.035009 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:35.035702 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:35.035703 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:35.036235 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:35.036238 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:35.036646 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:35.036647 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:35.036689 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:35.037074 (+ 385us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:51:35.037079 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:51:35.038162 (+ 1083us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:51:35.039820 (+ 1658us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:51:35.039821 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:51:35.039822 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:51:35.040041 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:51:35.040217 (+ 176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:51:35.040217 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:51:35.040217 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:51:35.040265 (+ 48us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:51:35.040476 (+ 211us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:51:35.040476 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:51:35.040508 (+ 32us) client_negotiation.cc:769] Sending connection context
0805 22:51:35.040551 (+ 43us) client_negotiation.cc:240] Negotiation successful
0805 22:51:35.040615 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260805 22:51:35.040792 16206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:35.034643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38358 (local address 127.14.224.188:41525)
0805 22:51:35.034684 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:35.034686 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:35.034712 (+ 26us) server_negotiation.cc:407] Connection header received
0805 22:51:35.034732 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:35.034733 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:35.034767 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:35.034813 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:35.035071 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:35.035628 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:35.036313 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:35.036565 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:35.036637 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:35.038235 (+ 1598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:35.038236 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:35.038236 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:51:35.038242 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:35.039750 (+ 1508us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:35.040099 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:35.040100 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:35.040100 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:35.040158 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:35.040308 (+ 150us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:35.040309 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:35.040309 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:35.040423 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:35.040484 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:35.040572 (+ 88us) server_negotiation.cc:299] Negotiation successful
0805 22:51:35.040670 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":21,"server-negotiator.queue_time_us":21}
I20260805 22:51:35.041931 15986 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.224.188" port: 41525 } attempt: 2
I20260805 22:51:35.042445 16202 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 26e613cd24d540d6b0ac02bdfeb1fc54: Bootstrap starting.
I20260805 22:51:35.043257 16202 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 26e613cd24d540d6b0ac02bdfeb1fc54: Neither blocks nor log segments found. Creating new log.
Aug 05 22:51:35 dist-test-slave-gjrz krb5kdc[15870](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970294, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.224.189@KRBTEST.COM
I20260805 22:51:35.043604 16202 log.cc:824] T 00000000000000000000000000000000 P 26e613cd24d540d6b0ac02bdfeb1fc54: Log is configured to *not* fsync() on all Append() calls
I20260805 22:51:35.044492 16202 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 26e613cd24d540d6b0ac02bdfeb1fc54: No bootstrap required, opened a new log
I20260805 22:51:35.046350 16202 raft_consensus.cc:348] T 00000000000000000000000000000000 P 26e613cd24d540d6b0ac02bdfeb1fc54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7415b0d62ea0497890c3b7c0ea19d616" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 41743 } } peers { permanent_uuid: "c43e1f1e2ee04d1bb83c518864b083e4" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 42591 } } peers { permanent_uuid: "26e613cd24d540d6b0ac02bdfeb1fc54" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 41525 } }
I20260805 22:51:35.046530 16202 raft_consensus.cc:729] T 00000000000000000000000000000000 P 26e613cd24d540d6b0ac02bdfeb1fc54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26e613cd24d540d6b0ac02bdfeb1fc54, State: Initialized, Role: FOLLOWER
I20260805 22:51:35.046620 16202 consensus_queue.cc:260] T 00000000000000000000000000000000 P 26e613cd24d540d6b0ac02bdfeb1fc54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7415b0d62ea0497890c3b7c0ea19d616" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 41743 } } peers { permanent_uuid: "c43e1f1e2ee04d1bb83c518864b083e4" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 42591 } } peers { permanent_uuid: "26e613cd24d540d6b0ac02bdfeb1fc54" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 41525 } }
Aug 05 22:51:35 dist-test-slave-gjrz krb5kdc[15870](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970294, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.190@KRBTEST.COM for kudu/127.14.224.188@KRBTEST.COM
I20260805 22:51:35.046933 16202 sys_catalog.cc:564] T 00000000000000000000000000000000 P 26e613cd24d540d6b0ac02bdfeb1fc54 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:51:35.046895 16208 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26e613cd24d540d6b0ac02bdfeb1fc54 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7415b0d62ea0497890c3b7c0ea19d616" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 41743 } } peers { permanent_uuid: "c43e1f1e2ee04d1bb83c518864b083e4" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 42591 } } peers { permanent_uuid: "26e613cd24d540d6b0ac02bdfeb1fc54" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 41525 } } }
I20260805 22:51:35.047133 16208 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26e613cd24d540d6b0ac02bdfeb1fc54 [sys.catalog]: This master's current role is: FOLLOWER
I20260805 22:51:35.047343 16096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:35.039360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51246 (local address 127.14.224.189:42591)
0805 22:51:35.039399 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:35.039401 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:35.039408 (+ 7us) server_negotiation.cc:407] Connection header received
0805 22:51:35.039432 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:35.039433 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:35.039443 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:35.039519 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:35.039963 (+ 444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:35.040595 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:35.041453 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:35.041692 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:35.041763 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:35.043928 (+ 2165us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:35.043929 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:35.043929 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:51:35.043937 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:35.045576 (+ 1639us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:35.046158 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:35.046159 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:35.046159 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:35.046222 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:35.046419 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:35.046420 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:35.046421 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:35.046546 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:35.046716 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:35.047138 (+ 422us) server_negotiation.cc:299] Negotiation successful
0805 22:51:35.047223 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260805 22:51:35.048867 15234 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260805 22:51:35.048909 16222 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 26e613cd24d540d6b0ac02bdfeb1fc54: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260805 22:51:35.048960 16222 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260805 22:51:35.050339 15989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:35.042154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.188:41525 (local address 127.0.0.1:38372)
0805 22:51:35.042201 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:35.042213 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:51:35.042255 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:51:35.043487 (+ 1232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:51:35.043489 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:51:35.043623 (+ 134us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:51:35.043660 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:35.043662 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:35.044460 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:35.044461 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:35.045105 (+ 644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:35.045108 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:35.045485 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:35.045486 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:35.045545 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:35.045865 (+ 320us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:51:35.045871 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:51:35.047303 (+ 1432us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:51:35.049238 (+ 1935us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:51:35.049239 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:51:35.049240 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:51:35.049464 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:51:35.049670 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:51:35.049671 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:51:35.049672 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:51:35.049738 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:51:35.050051 (+ 313us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:51:35.050052 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:51:35.050096 (+ 44us) client_negotiation.cc:769] Sending connection context
0805 22:51:35.050151 (+ 55us) client_negotiation.cc:240] Negotiation successful
0805 22:51:35.050251 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25}
I20260805 22:51:35.050693 16206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:35.042250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38372 (local address 127.14.224.188:41525)
0805 22:51:35.043352 (+ 1102us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:35.043354 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:35.043363 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:51:35.043381 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:35.043382 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:35.043392 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:35.043463 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:35.043735 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:35.044381 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:35.045182 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:35.045422 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:35.045477 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:35.047390 (+ 1913us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:35.047392 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:35.047392 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:51:35.047400 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:35.049157 (+ 1757us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:35.049540 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:35.049541 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:35.049542 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:35.049601 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:35.049811 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:35.049812 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:35.049813 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:35.049965 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:35.050022 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:35.050537 (+ 515us) server_negotiation.cc:299] Negotiation successful
0805 22:51:35.050614 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1080}
I20260805 22:51:35.049866 15950 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "7415b0d62ea0497890c3b7c0ea19d616"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34080
I20260805 22:51:35.052165 15986 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7415b0d62ea0497890c3b7c0ea19d616: Bootstrap starting.
I20260805 22:51:35.049726 16098 master_runner.cc:186] Error getting master registration for 127.14.224.190:41743: OK, instance_id { permanent_uuid: "7415b0d62ea0497890c3b7c0ea19d616" instance_seqno: 1785970294698660 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260805 22:51:35.052837 16098 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260805 22:51:35.052922 15986 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7415b0d62ea0497890c3b7c0ea19d616: Neither blocks nor log segments found. Creating new log.
I20260805 22:51:35.053187 15986 log.cc:824] T 00000000000000000000000000000000 P 7415b0d62ea0497890c3b7c0ea19d616: Log is configured to *not* fsync() on all Append() calls
I20260805 22:51:35.053886 15986 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7415b0d62ea0497890c3b7c0ea19d616: No bootstrap required, opened a new log
I20260805 22:51:35.054857 15986 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7415b0d62ea0497890c3b7c0ea19d616 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7415b0d62ea0497890c3b7c0ea19d616" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 41743 } } peers { permanent_uuid: "c43e1f1e2ee04d1bb83c518864b083e4" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 42591 } } peers { permanent_uuid: "26e613cd24d540d6b0ac02bdfeb1fc54" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 41525 } }
I20260805 22:51:35.054967 15986 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7415b0d62ea0497890c3b7c0ea19d616 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7415b0d62ea0497890c3b7c0ea19d616, State: Initialized, Role: FOLLOWER
I20260805 22:51:35.055027 15986 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7415b0d62ea0497890c3b7c0ea19d616 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7415b0d62ea0497890c3b7c0ea19d616" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 41743 } } peers { permanent_uuid: "c43e1f1e2ee04d1bb83c518864b083e4" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 42591 } } peers { permanent_uuid: "26e613cd24d540d6b0ac02bdfeb1fc54" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 41525 } }
I20260805 22:51:35.055294 16225 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7415b0d62ea0497890c3b7c0ea19d616 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7415b0d62ea0497890c3b7c0ea19d616" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 41743 } } peers { permanent_uuid: "c43e1f1e2ee04d1bb83c518864b083e4" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 42591 } } peers { permanent_uuid: "26e613cd24d540d6b0ac02bdfeb1fc54" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 41525 } } }
I20260805 22:51:35.055378 16225 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7415b0d62ea0497890c3b7c0ea19d616 [sys.catalog]: This master's current role is: FOLLOWER
I20260805 22:51:35.055380 15986 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7415b0d62ea0497890c3b7c0ea19d616 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:51:35.055449 15950 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7415b0d62ea0497890c3b7c0ea19d616 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260805 22:51:35.056643 15950 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7415b0d62ea0497890c3b7c0ea19d616 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:51:35.057251 15950 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7415b0d62ea0497890c3b7c0ea19d616 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7415b0d62ea0497890c3b7c0ea19d616" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 41743 } } peers { permanent_uuid: "c43e1f1e2ee04d1bb83c518864b083e4" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 42591 } } peers { permanent_uuid: "26e613cd24d540d6b0ac02bdfeb1fc54" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 41525 } }
I20260805 22:51:35.058073 16158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7415b0d62ea0497890c3b7c0ea19d616" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "26e613cd24d540d6b0ac02bdfeb1fc54"
I20260805 22:51:35.058204 16158 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 26e613cd24d540d6b0ac02bdfeb1fc54 [term 0 FOLLOWER]: Advancing to term 1
W20260805 22:51:35.058478 16237 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7415b0d62ea0497890c3b7c0ea19d616: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260805 22:51:35.058537 16237 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260805 22:51:35.059005 16158 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 26e613cd24d540d6b0ac02bdfeb1fc54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7415b0d62ea0497890c3b7c0ea19d616 in term 1.
I20260805 22:51:35.057525 15950 leader_election.cc:288] T 00000000000000000000000000000000 P 7415b0d62ea0497890c3b7c0ea19d616 [CANDIDATE]: Term 1 election: Requested vote from peers c43e1f1e2ee04d1bb83c518864b083e4 (127.14.224.189:42591), 26e613cd24d540d6b0ac02bdfeb1fc54 (127.14.224.188:41525)
I20260805 22:51:35.059803 15915 leader_election.cc:302] T 00000000000000000000000000000000 P 7415b0d62ea0497890c3b7c0ea19d616 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26e613cd24d540d6b0ac02bdfeb1fc54, 7415b0d62ea0497890c3b7c0ea19d616; no voters:
I20260805 22:51:35.059935 16225 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7415b0d62ea0497890c3b7c0ea19d616 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:51:35.060076 16225 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7415b0d62ea0497890c3b7c0ea19d616 [term 1 LEADER]: Becoming Leader. State: Replica: 7415b0d62ea0497890c3b7c0ea19d616, State: Running, Role: LEADER
I20260805 22:51:35.060160 16225 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7415b0d62ea0497890c3b7c0ea19d616 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7415b0d62ea0497890c3b7c0ea19d616" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 41743 } } peers { permanent_uuid: "c43e1f1e2ee04d1bb83c518864b083e4" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 42591 } } peers { permanent_uuid: "26e613cd24d540d6b0ac02bdfeb1fc54" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 41525 } }
I20260805 22:51:35.060565 16225 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7415b0d62ea0497890c3b7c0ea19d616 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7415b0d62ea0497890c3b7c0ea19d616. Latest consensus state: current_term: 1 leader_uuid: "7415b0d62ea0497890c3b7c0ea19d616" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7415b0d62ea0497890c3b7c0ea19d616" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 41743 } } peers { permanent_uuid: "c43e1f1e2ee04d1bb83c518864b083e4" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 42591 } } peers { permanent_uuid: "26e613cd24d540d6b0ac02bdfeb1fc54" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 41525 } } }
I20260805 22:51:35.060647 16225 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7415b0d62ea0497890c3b7c0ea19d616 [sys.catalog]: This master's current role is: LEADER
I20260805 22:51:35.060940 16254 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:51:35.061295 16254 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:51:35.060853 15895 master_runner.cc:186] Error getting master registration for 127.14.224.189:42591: OK, instance_id { permanent_uuid: "c43e1f1e2ee04d1bb83c518864b083e4" instance_seqno: 1785970294861802 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260805 22:51:35.063627 15895 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260805 22:51:35.070060 15988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:35.060377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34090 (local address 127.14.224.190:41743)
0805 22:51:35.060416 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:35.060418 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:35.061281 (+ 863us) server_negotiation.cc:407] Connection header received
0805 22:51:35.061378 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:35.061379 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:35.061389 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:35.061418 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:35.062219 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:35.062904 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:35.063919 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:35.064185 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:35.064224 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:35.066401 (+ 2177us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:35.066403 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:35.066403 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:51:35.066411 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:35.068270 (+ 1859us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:35.068894 (+ 624us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:35.068895 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:35.068895 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:35.068957 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:35.069274 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:35.069275 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:35.069275 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:35.069415 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:35.069506 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:35.069862 (+ 356us) server_negotiation.cc:299] Negotiation successful
0805 22:51:35.069958 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260805 22:51:35.073868 16096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:35.060741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51254 (local address 127.14.224.189:42591)
0805 22:51:35.060783 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:35.060786 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:35.063337 (+ 2551us) server_negotiation.cc:407] Connection header received
0805 22:51:35.063432 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:35.063433 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:35.063444 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:35.063472 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:35.065544 (+ 2072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:35.066220 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:35.068982 (+ 2762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:35.069289 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:35.069336 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:35.070860 (+ 1524us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:35.070862 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:35.070862 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:51:35.070870 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:35.072558 (+ 1688us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:35.072980 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:35.072981 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:35.072982 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:35.073045 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:35.073257 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:35.073258 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:35.073259 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:35.073398 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:35.073473 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:35.073682 (+ 209us) server_negotiation.cc:299] Negotiation successful
0805 22:51:35.073768 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260805 22:51:35.076354 16158 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 26e613cd24d540d6b0ac02bdfeb1fc54 [term 1 FOLLOWER]: Refusing update from remote peer 7415b0d62ea0497890c3b7c0ea19d616: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:51:35.076773 16246 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7415b0d62ea0497890c3b7c0ea19d616 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26e613cd24d540d6b0ac02bdfeb1fc54" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 41525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:51:35.077093 16206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:35.063134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38374 (local address 127.14.224.188:41525)
0805 22:51:35.063179 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:35.063181 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:35.064760 (+ 1579us) server_negotiation.cc:407] Connection header received
0805 22:51:35.064852 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:35.064853 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:35.064864 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:35.064891 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:35.067212 (+ 2321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:35.067941 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:35.070836 (+ 2895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:35.071154 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:35.071223 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:35.073450 (+ 2227us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:35.073452 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:35.073453 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:51:35.073461 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:35.075460 (+ 1999us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:35.075857 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:35.075858 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:35.075859 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:35.076030 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:35.076309 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:35.076310 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:35.076311 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:35.076494 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:35.076593 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:35.076911 (+ 318us) server_negotiation.cc:299] Negotiation successful
0805 22:51:35.076997 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260805 22:51:35.078557 16208 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26e613cd24d540d6b0ac02bdfeb1fc54 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7415b0d62ea0497890c3b7c0ea19d616. Latest consensus state: current_term: 1 leader_uuid: "7415b0d62ea0497890c3b7c0ea19d616" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7415b0d62ea0497890c3b7c0ea19d616" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 41743 } } peers { permanent_uuid: "c43e1f1e2ee04d1bb83c518864b083e4" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 42591 } } peers { permanent_uuid: "26e613cd24d540d6b0ac02bdfeb1fc54" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 41525 } } }
I20260805 22:51:35.078660 16208 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26e613cd24d540d6b0ac02bdfeb1fc54 [sys.catalog]: This master's current role is: FOLLOWER
I20260805 22:51:35.084599 16225 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7415b0d62ea0497890c3b7c0ea19d616 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7415b0d62ea0497890c3b7c0ea19d616" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7415b0d62ea0497890c3b7c0ea19d616" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 41743 } } peers { permanent_uuid: "c43e1f1e2ee04d1bb83c518864b083e4" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 42591 } } peers { permanent_uuid: "26e613cd24d540d6b0ac02bdfeb1fc54" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 41525 } } }
I20260805 22:51:35.084738 16225 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7415b0d62ea0497890c3b7c0ea19d616 [sys.catalog]: This master's current role is: LEADER
I20260805 22:51:35.084818 16208 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26e613cd24d540d6b0ac02bdfeb1fc54 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7415b0d62ea0497890c3b7c0ea19d616" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7415b0d62ea0497890c3b7c0ea19d616" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 41743 } } peers { permanent_uuid: "c43e1f1e2ee04d1bb83c518864b083e4" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 42591 } } peers { permanent_uuid: "26e613cd24d540d6b0ac02bdfeb1fc54" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 41525 } } }
I20260805 22:51:35.084916 16208 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26e613cd24d540d6b0ac02bdfeb1fc54 [sys.catalog]: This master's current role is: FOLLOWER
I20260805 22:51:35.085168 16259 mvcc.cc:205] Tried to move back new op lower bound from 7315334328629854208 to 7315334328567132160. Current Snapshot: MvccSnapshot[applied={T|T < 7315334328629854208}]
I20260805 22:51:35.086179 16254 catalog_manager.cc:1347] Generated new cluster ID: c7b4f44c6dac4e77bda895ed3729975a
I20260805 22:51:35.086324 16254 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:51:35.098173 16088 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.224.188" port: 41525 } attempt: 3
I20260805 22:51:35.103482 16254 catalog_manager.cc:1370] Generated new certificate authority record
Aug 05 22:51:35 dist-test-slave-gjrz krb5kdc[15870](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970294, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.189@KRBTEST.COM for kudu/127.14.224.188@KRBTEST.COM
I20260805 22:51:35.104704 16254 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:51:35.107729 16092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:35.098558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.188:41525 (local address 127.0.0.1:38376)
0805 22:51:35.098673 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:35.098686 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0805 22:51:35.098729 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:51:35.099012 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:51:35.099013 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:51:35.099219 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:51:35.099302 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:35.099304 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:35.100227 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:35.100228 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:35.101042 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:35.101045 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:35.102033 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:35.102034 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:35.102104 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:35.102632 (+ 528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:51:35.102655 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:51:35.104286 (+ 1631us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:51:35.106388 (+ 2102us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:51:35.106390 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:51:35.106390 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:51:35.106635 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:51:35.106880 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:51:35.106882 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:51:35.106882 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:51:35.106966 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:51:35.107353 (+ 387us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:51:35.107354 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:51:35.107429 (+ 75us) client_negotiation.cc:769] Sending connection context
0805 22:51:35.107494 (+ 65us) client_negotiation.cc:240] Negotiation successful
0805 22:51:35.107620 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":91}
I20260805 22:51:35.108453 16206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:35.098816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38376 (local address 127.14.224.188:41525)
0805 22:51:35.098859 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:35.098860 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:35.098868 (+ 8us) server_negotiation.cc:407] Connection header received
0805 22:51:35.098892 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:35.098893 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:35.098903 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:35.098947 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:35.099408 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:35.100120 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:35.101132 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:35.101455 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:35.101525 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:35.104385 (+ 2860us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:35.104387 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:35.104388 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:51:35.104396 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:35.106290 (+ 1894us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:35.106736 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:35.106737 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:35.106738 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:35.106804 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:35.107060 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:35.107061 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:35.107062 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:35.107225 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:35.107310 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:35.108253 (+ 943us) server_negotiation.cc:299] Negotiation successful
0805 22:51:35.108344 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260805 22:51:35.110312 16088 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c43e1f1e2ee04d1bb83c518864b083e4: Bootstrap starting.
I20260805 22:51:35.111076 16088 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c43e1f1e2ee04d1bb83c518864b083e4: Neither blocks nor log segments found. Creating new log.
I20260805 22:51:35.111402 16088 log.cc:824] T 00000000000000000000000000000000 P c43e1f1e2ee04d1bb83c518864b083e4: Log is configured to *not* fsync() on all Append() calls
I20260805 22:51:35.120236 16254 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7415b0d62ea0497890c3b7c0ea19d616: Generated new TSK 0
I20260805 22:51:35.121093 16254 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:51:35.124058 16088 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c43e1f1e2ee04d1bb83c518864b083e4: No bootstrap required, opened a new log
I20260805 22:51:35.126166 16088 raft_consensus.cc:348] T 00000000000000000000000000000000 P c43e1f1e2ee04d1bb83c518864b083e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7415b0d62ea0497890c3b7c0ea19d616" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 41743 } } peers { permanent_uuid: "c43e1f1e2ee04d1bb83c518864b083e4" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 42591 } } peers { permanent_uuid: "26e613cd24d540d6b0ac02bdfeb1fc54" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 41525 } }
I20260805 22:51:35.126320 16088 raft_consensus.cc:729] T 00000000000000000000000000000000 P c43e1f1e2ee04d1bb83c518864b083e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c43e1f1e2ee04d1bb83c518864b083e4, State: Initialized, Role: FOLLOWER
I20260805 22:51:35.126397 16088 consensus_queue.cc:260] T 00000000000000000000000000000000 P c43e1f1e2ee04d1bb83c518864b083e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7415b0d62ea0497890c3b7c0ea19d616" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 41743 } } peers { permanent_uuid: "c43e1f1e2ee04d1bb83c518864b083e4" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 42591 } } peers { permanent_uuid: "26e613cd24d540d6b0ac02bdfeb1fc54" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 41525 } }
I20260805 22:51:35.126784 16088 sys_catalog.cc:564] T 00000000000000000000000000000000 P c43e1f1e2ee04d1bb83c518864b083e4 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:51:35.126734 16267 sys_catalog.cc:455] T 00000000000000000000000000000000 P c43e1f1e2ee04d1bb83c518864b083e4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7415b0d62ea0497890c3b7c0ea19d616" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 41743 } } peers { permanent_uuid: "c43e1f1e2ee04d1bb83c518864b083e4" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 42591 } } peers { permanent_uuid: "26e613cd24d540d6b0ac02bdfeb1fc54" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 41525 } } }
I20260805 22:51:35.126833 16267 sys_catalog.cc:458] T 00000000000000000000000000000000 P c43e1f1e2ee04d1bb83c518864b083e4 [sys.catalog]: This master's current role is: FOLLOWER
I20260805 22:51:35.127554 16052 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c43e1f1e2ee04d1bb83c518864b083e4 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:51:35.128510 16052 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c43e1f1e2ee04d1bb83c518864b083e4 [term 1 FOLLOWER]: Refusing update from remote peer 7415b0d62ea0497890c3b7c0ea19d616: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:51:35.128894 16262 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7415b0d62ea0497890c3b7c0ea19d616 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c43e1f1e2ee04d1bb83c518864b083e4" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 42591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:51:35.128913 16051 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7415b0d62ea0497890c3b7c0ea19d616" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "c43e1f1e2ee04d1bb83c518864b083e4"
I20260805 22:51:35.130646 16051 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c43e1f1e2ee04d1bb83c518864b083e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7415b0d62ea0497890c3b7c0ea19d616 in term 1.
I20260805 22:51:35.132092 16267 sys_catalog.cc:455] T 00000000000000000000000000000000 P c43e1f1e2ee04d1bb83c518864b083e4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7415b0d62ea0497890c3b7c0ea19d616. Latest consensus state: current_term: 1 leader_uuid: "7415b0d62ea0497890c3b7c0ea19d616" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7415b0d62ea0497890c3b7c0ea19d616" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 41743 } } peers { permanent_uuid: "c43e1f1e2ee04d1bb83c518864b083e4" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 42591 } } peers { permanent_uuid: "26e613cd24d540d6b0ac02bdfeb1fc54" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 41525 } } }
W20260805 22:51:35.132851 16283 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c43e1f1e2ee04d1bb83c518864b083e4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260805 22:51:35.140121 16283 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260805 22:51:35.135896 16273 mvcc.cc:205] Tried to move back new op lower bound from 7315334328806682624 to 7315334328567132160. Current Snapshot: MvccSnapshot[applied={T|T < 7315334328629854208}]
I20260805 22:51:35.139094 16267 sys_catalog.cc:458] T 00000000000000000000000000000000 P c43e1f1e2ee04d1bb83c518864b083e4 [sys.catalog]: This master's current role is: FOLLOWER
I20260805 22:51:35.142122 16267 sys_catalog.cc:455] T 00000000000000000000000000000000 P c43e1f1e2ee04d1bb83c518864b083e4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7415b0d62ea0497890c3b7c0ea19d616" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7415b0d62ea0497890c3b7c0ea19d616" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 41743 } } peers { permanent_uuid: "c43e1f1e2ee04d1bb83c518864b083e4" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 42591 } } peers { permanent_uuid: "26e613cd24d540d6b0ac02bdfeb1fc54" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 41525 } } }
I20260805 22:51:35.142277 16267 sys_catalog.cc:458] T 00000000000000000000000000000000 P c43e1f1e2ee04d1bb83c518864b083e4 [sys.catalog]: This master's current role is: FOLLOWER
W20260805 22:51:35.163877 15988 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:51:35.161616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34100 (local address 127.14.224.190:41743)
0805 22:51:35.161667 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:35.161670 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:35.162910 (+ 1240us) server_negotiation.cc:407] Connection header received
0805 22:51:35.163043 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:35.163045 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:35.163058 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:35.163090 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:35.163790 (+ 700us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34100: BlockingRecv error: recv got EOF from 127.0.0.1:34100 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
W20260805 22:51:35.165110 16096 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:51:35.162123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51270 (local address 127.14.224.189:42591)
0805 22:51:35.162168 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:35.162170 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:35.164351 (+ 2181us) server_negotiation.cc:407] Connection header received
0805 22:51:35.164582 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:35.164584 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:35.164597 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:35.164629 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:35.165033 (+ 404us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51270: BlockingRecv error: recv got EOF from 127.0.0.1:51270 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260805 22:51:35.166067 16206 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:51:35.162598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38382 (local address 127.14.224.188:41525)
0805 22:51:35.162643 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:35.162644 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:35.164522 (+ 1878us) server_negotiation.cc:407] Connection header received
0805 22:51:35.165531 (+ 1009us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:35.165534 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:35.165547 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:35.165579 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:35.165999 (+ 420us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38382: BlockingRecv error: recv got EOF from 127.0.0.1:38382 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260805 22:51:35.169373 16096 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:51:35.168404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51272 (local address 127.14.224.189:42591)
0805 22:51:35.168448 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:35.168450 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:35.168707 (+ 257us) server_negotiation.cc:407] Connection header received
0805 22:51:35.168834 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:35.168835 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:35.168858 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:35.168889 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:35.169315 (+ 426us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51272: BlockingRecv error: recv got EOF from 127.0.0.1:51272 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260805 22:51:35.172901 16096 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:51:35.171946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51278 (local address 127.14.224.189:42591)
0805 22:51:35.171987 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:35.172001 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:35.172297 (+ 296us) server_negotiation.cc:407] Connection header received
0805 22:51:35.172406 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:35.172407 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:35.172419 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:35.172448 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:35.172840 (+ 392us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51278: BlockingRecv error: recv got EOF from 127.0.0.1:51278 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260805 22:51:35.177378 16096 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:51:35.176376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51286 (local address 127.14.224.189:42591)
0805 22:51:35.176421 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:35.176423 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:35.176730 (+ 307us) server_negotiation.cc:407] Connection header received
0805 22:51:35.176838 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:35.176839 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:35.176852 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:35.176881 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:35.177314 (+ 433us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51286: BlockingRecv error: recv got EOF from 127.0.0.1:51286 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260805 22:51:35.183881 16096 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:51:35.182845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51294 (local address 127.14.224.189:42591)
0805 22:51:35.182892 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:35.182894 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:35.183201 (+ 307us) server_negotiation.cc:407] Connection header received
0805 22:51:35.183347 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:35.183348 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:35.183362 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:35.183391 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:35.183819 (+ 428us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51294: BlockingRecv error: recv got EOF from 127.0.0.1:51294 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260805 22:51:35.194761 16096 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:51:35.193641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51306 (local address 127.14.224.189:42591)
0805 22:51:35.193695 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:35.193697 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:35.194086 (+ 389us) server_negotiation.cc:407] Connection header received
0805 22:51:35.194211 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:35.194212 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:35.194226 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:35.194255 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:35.194681 (+ 426us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51306: BlockingRecv error: recv got EOF from 127.0.0.1:51306 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
W20260805 22:51:35.213428 16096 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:51:35.212418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51318 (local address 127.14.224.189:42591)
0805 22:51:35.212466 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:35.212469 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:35.212801 (+ 332us) server_negotiation.cc:407] Connection header received
0805 22:51:35.212906 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:35.212907 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:35.212920 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:35.212948 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:35.213363 (+ 415us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51318: BlockingRecv error: recv got EOF from 127.0.0.1:51318 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260805 22:51:35.247577 16096 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:51:35.246819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51328 (local address 127.14.224.189:42591)
0805 22:51:35.246890 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:35.246892 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:35.246984 (+ 92us) server_negotiation.cc:407] Connection header received
0805 22:51:35.247045 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:35.247045 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:35.247058 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:35.247109 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:35.247514 (+ 405us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51328: BlockingRecv error: recv got EOF from 127.0.0.1:51328 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260805 22:51:35.313453 16096 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:51:35.312704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51336 (local address 127.14.224.189:42591)
0805 22:51:35.312810 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:35.312812 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:35.312839 (+ 27us) server_negotiation.cc:407] Connection header received
0805 22:51:35.312910 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:35.312911 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:35.312922 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:35.312973 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:35.313394 (+ 421us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51336: BlockingRecv error: recv got EOF from 127.0.0.1:51336 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
W20260805 22:51:35.443353 16096 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:51:35.442625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51350 (local address 127.14.224.189:42591)
0805 22:51:35.442695 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:35.442698 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:35.442775 (+ 77us) server_negotiation.cc:407] Connection header received
0805 22:51:35.442847 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:35.442848 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:35.442860 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:35.442906 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:35.443290 (+ 384us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51350: BlockingRecv error: recv got EOF from 127.0.0.1:51350 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
I20260805 22:51:35.629969 16262 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7415b0d62ea0497890c3b7c0ea19d616 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7415b0d62ea0497890c3b7c0ea19d616" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7415b0d62ea0497890c3b7c0ea19d616" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 41743 } } peers { permanent_uuid: "c43e1f1e2ee04d1bb83c518864b083e4" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 42591 } } peers { permanent_uuid: "26e613cd24d540d6b0ac02bdfeb1fc54" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 41525 } } }
I20260805 22:51:35.630139 16262 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7415b0d62ea0497890c3b7c0ea19d616 [sys.catalog]: This master's current role is: LEADER
W20260805 22:51:35.701258 16096 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:51:35.700684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51358 (local address 127.14.224.189:42591)
0805 22:51:35.700756 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:35.700758 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:35.700769 (+ 11us) server_negotiation.cc:407] Connection header received
0805 22:51:35.700797 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:35.700798 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:35.700809 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:35.700856 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:35.701200 (+ 344us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51358: BlockingRecv error: recv got EOF from 127.0.0.1:51358 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
I20260805 22:51:36.049424 16222 catalog_manager.cc:1259] Loaded cluster ID: c7b4f44c6dac4e77bda895ed3729975a
I20260805 22:51:36.049510 16222 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 26e613cd24d540d6b0ac02bdfeb1fc54: loading cluster ID for follower catalog manager: success
I20260805 22:51:36.050320 16222 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 26e613cd24d540d6b0ac02bdfeb1fc54: acquiring CA information for follower catalog manager: success
I20260805 22:51:36.050630 16222 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 26e613cd24d540d6b0ac02bdfeb1fc54: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260805 22:51:36.140713 16283 catalog_manager.cc:1259] Loaded cluster ID: c7b4f44c6dac4e77bda895ed3729975a
I20260805 22:51:36.140810 16283 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c43e1f1e2ee04d1bb83c518864b083e4: loading cluster ID for follower catalog manager: success
I20260805 22:51:36.141912 16283 catalog_manager.cc:1574] T 00000000000000000000000000000000 P c43e1f1e2ee04d1bb83c518864b083e4: acquiring CA information for follower catalog manager: success
I20260805 22:51:36.142246 16283 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c43e1f1e2ee04d1bb83c518864b083e4: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260805 22:51:36.216981 16381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:36.214416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51368 (local address 127.14.224.189:42591)
0805 22:51:36.214535 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:36.214538 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:36.214570 (+ 32us) server_negotiation.cc:407] Connection header received
0805 22:51:36.214646 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:36.214647 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:36.214701 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:36.214778 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:51:36.214960 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:36.215494 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:36.216281 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:36.216496 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:36.216559 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:36.216686 (+ 127us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:51:36.216801 (+ 115us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:51:36.216859 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:36.216873 (+ 14us) server_negotiation.cc:299] Negotiation successful
0805 22:51:36.216893 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94,"thread_start_us":62,"threads_started":1}
I20260805 22:51:36.221280 16388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:36.218869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38398 (local address 127.14.224.188:41525)
0805 22:51:36.218970 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:36.218973 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:36.218984 (+ 11us) server_negotiation.cc:407] Connection header received
0805 22:51:36.219054 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:36.219055 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:36.219095 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:36.219163 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:51:36.219250 (+ 87us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:36.219782 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:36.220560 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:36.220757 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:36.220808 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:36.220918 (+ 110us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:51:36.221030 (+ 112us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:51:36.221085 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:36.221174 (+ 89us) server_negotiation.cc:299] Negotiation successful
0805 22:51:36.221193 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78,"thread_start_us":57,"threads_started":1}
I20260805 22:51:36.226025 16388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:36.223182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38408 (local address 127.14.224.188:41525)
0805 22:51:36.223231 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:36.223234 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:36.223412 (+ 178us) server_negotiation.cc:407] Connection header received
0805 22:51:36.223455 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:36.223455 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:36.223466 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:36.223509 (+ 43us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:51:36.223654 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:36.224177 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:36.225137 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:36.225439 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:36.225504 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:36.225634 (+ 130us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:51:36.225668 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:51:36.225717 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:36.225913 (+ 196us) server_negotiation.cc:299] Negotiation successful
0805 22:51:36.225941 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260805 22:51:36.226164 16381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:36.223167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51378 (local address 127.14.224.189:42591)
0805 22:51:36.223226 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:36.223228 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:36.223406 (+ 178us) server_negotiation.cc:407] Connection header received
0805 22:51:36.223516 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:36.223517 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:36.223531 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:36.223583 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:51:36.223722 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:36.224477 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:36.225424 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:36.225684 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:36.225744 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:36.225906 (+ 162us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:51:36.225942 (+ 36us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:51:36.225998 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:36.226059 (+ 61us) server_negotiation.cc:299] Negotiation successful
0805 22:51:36.226086 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260805 22:51:36.226506 16403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:36.223117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34106 (local address 127.14.224.190:41743)
0805 22:51:36.223314 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:36.223316 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:36.223389 (+ 73us) server_negotiation.cc:407] Connection header received
0805 22:51:36.223491 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:36.223492 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:36.223545 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:36.223620 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:51:36.223789 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:36.224538 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:36.225361 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:36.225667 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:36.225730 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:36.226054 (+ 324us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:51:36.226176 (+ 122us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:51:36.226233 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:36.226389 (+ 156us) server_negotiation.cc:299] Negotiation successful
0805 22:51:36.226415 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":63,"threads_started":1}
I20260805 22:51:36.228103 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 15895
I20260805 22:51:36.242322 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 15997
I20260805 22:51:36.254038 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 16098
2026-08-05T22:51:36Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (2947 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:51:36 dist-test-slave-gjrz krb5kdc[16407](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:51:36 dist-test-slave-gjrz krb5kdc[16407](info): set up 2 sockets
Aug 05 22:51:36 dist-test-slave-gjrz krb5kdc[16407](info): commencing operation
krb5kdc: starting...
W20260805 22:51:37.395017 15234 mini_kdc.cc:121] Time spent starting KDC: real 1.113s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/krb5kdc/test-user.keytab.
Aug 05 22:51:37 dist-test-slave-gjrz krb5kdc[16407](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970297, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:51:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:51:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.224.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab.
Entry for principal kudu/127.14.224.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab.
I20260805 22:51:37.530717 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:37617
--webserver_interface=127.14.224.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:45887
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.224.190:37617,127.14.224.189:37697,127.14.224.188:42869
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:51:37.617574 16426 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260805 22:51:37.617833 16426 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:51:37.617851 16426 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:51:37.617873 16426 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:51:37.619086 16426 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:51:37.619156 16426 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:51:37.619170 16426 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:51:37.619182 16426 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:51:37.619192 16426 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:51:37.620718 16426 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:45887
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.224.190:37617,127.14.224.189:37697,127.14.224.188:42869
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.190.keytab
--principal=kudu/127.14.224.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.190:37617
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.224.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16426
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:51:37.620936 16426 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:51:37.621140 16426 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260805 22:51:37.626106 16426 server_base.cc:1034] running on GCE node
W20260805 22:51:37.626085 16431 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:37.626062 16432 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:37.626085 16434 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:51:37.626621 16426 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:51:37.626971 16426 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:51:37.628139 16426 hybrid_clock.cc:648] HybridClock initialized: now 1785970297628087 us; error 52 us; skew 500 ppm
Aug 05 22:51:37 dist-test-slave-gjrz krb5kdc[16407](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970297, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:51:37.630784 16426 init.cc:377] Logged in from keytab as kudu/127.14.224.190@KRBTEST.COM (short username kudu)
I20260805 22:51:37.631294 16426 webserver.cc:460] Webserver started at http://127.14.224.190:40011/ using document root <none> and password file <none>
I20260805 22:51:37.631500 16426 fs_manager.cc:359] Metadata directory not provided
I20260805 22:51:37.631542 16426 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:51:37.631639 16426 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:51:37.632700 16426 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/minicluster-data/master-0/data/instance:
uuid: "0700bba63ec743da94ec3d4b78318f8b"
format_stamp: "Formatted at 2026-08-05 22:51:37 on dist-test-slave-gjrz"
server_key: "e1690503ba53fe29fc9602638d2b3cc8"
server_key_iv: "16b51da4a79803c86ae0c06b58e909b9"
server_key_version: "encryptionkey@0"
I20260805 22:51:37.633015 16426 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/minicluster-data/master-0/wal/instance:
uuid: "0700bba63ec743da94ec3d4b78318f8b"
format_stamp: "Formatted at 2026-08-05 22:51:37 on dist-test-slave-gjrz"
server_key: "e1690503ba53fe29fc9602638d2b3cc8"
server_key_iv: "16b51da4a79803c86ae0c06b58e909b9"
server_key_version: "encryptionkey@0"
I20260805 22:51:37.634302 16426 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260805 22:51:37.635092 16441 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:37.635308 16426 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:51:37.635399 16426 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/minicluster-data/master-0/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/minicluster-data/master-0/wal
uuid: "0700bba63ec743da94ec3d4b78318f8b"
format_stamp: "Formatted at 2026-08-05 22:51:37 on dist-test-slave-gjrz"
server_key: "e1690503ba53fe29fc9602638d2b3cc8"
server_key_iv: "16b51da4a79803c86ae0c06b58e909b9"
server_key_version: "encryptionkey@0"
I20260805 22:51:37.635479 16426 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:51:37.649473 16426 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:51:37.651623 16426 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:51:37.651757 16426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:51:37.655864 16426 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.190:37617
I20260805 22:51:37.655913 16518 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.190:37617 every 8 connection(s)
I20260805 22:51:37.656280 16426 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/minicluster-data/master-0/data/info.pb
I20260805 22:51:37.657217 16519 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:51:37.658761 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 16426
I20260805 22:51:37.658874 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/minicluster-data/master-0/wal/instance
I20260805 22:51:37.659112 15234 external_mini_cluster.cc:1428] Setting key cb432f299079d403d6bc2849a70116e2
I20260805 22:51:37.658951 16519 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.224.190" port: 37617 } has no permanent_uuid. Determining permanent_uuid...
Aug 05 22:51:37 dist-test-slave-gjrz krb5kdc[16407](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970297, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.190@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.14.224.189@KRBTEST.COM; defaulting to no policy
I20260805 22:51:37.669816 16522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:37.659831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:37617 (local address 127.0.0.1:51826)
0805 22:51:37.660051 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:37.660102 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0805 22:51:37.660738 (+ 636us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:51:37.661099 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:51:37.661102 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:51:37.661358 (+ 256us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:51:37.661531 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:37.661535 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:37.662789 (+ 1254us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:37.662790 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:37.663886 (+ 1096us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:37.663891 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:37.664370 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:37.664372 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:37.664458 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:37.664974 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:51:37.664984 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:51:37.666613 (+ 1629us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:51:37.668352 (+ 1739us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:51:37.668359 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:51:37.668361 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:51:37.668571 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:51:37.668786 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:51:37.668786 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:51:37.668787 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:51:37.668871 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:51:37.669240 (+ 369us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:51:37.669245 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:51:37.669310 (+ 65us) client_negotiation.cc:769] Sending connection context
0805 22:51:37.669395 (+ 85us) client_negotiation.cc:240] Negotiation successful
0805 22:51:37.669632 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"mutex_wait_us":81,"thread_start_us":116,"threads_started":1}
I20260805 22:51:37.669824 16523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:37.659910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51826 (local address 127.14.224.190:37617)
0805 22:51:37.660099 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:37.660109 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:37.660197 (+ 88us) server_negotiation.cc:407] Connection header received
0805 22:51:37.660919 (+ 722us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:37.660922 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:37.660979 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:37.661087 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:37.661627 (+ 540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:37.662683 (+ 1056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:37.663969 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:37.664283 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:37.664365 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:37.666700 (+ 2335us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:37.666706 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:37.666707 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:51:37.666713 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:37.668269 (+ 1556us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:37.668646 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:37.668649 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:37.668649 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:37.668727 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:37.668926 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:37.668927 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:37.668927 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:37.669178 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:37.669255 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:37.669437 (+ 182us) server_negotiation.cc:299] Negotiation successful
0805 22:51:37.669560 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":102,"threads_started":1}
I20260805 22:51:37.670691 16519 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.224.189" port: 37697 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.189@KRBTEST.COM" created.
I20260805 22:51:37.671054 16522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:37.670925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.189:37697 (local address 127.0.0.1:58596)
0805 22:51:37.670974 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:37.671024 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.189:37697: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260805 22:51:37.671204 16446 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.224.189:37697: connect: Connection refused (error 111)
I20260805 22:51:37.671674 16522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:37.671582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.189:37697 (local address 127.0.0.1:58612)
0805 22:51:37.671621 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:37.671650 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.189:37697: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260805 22:51:37.671808 16519 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.224.189:37697: Network error: Client connection negotiation failed: client connection to 127.14.224.189:37697: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.189.keytab.
Entry for principal kudu/127.14.224.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.189.keytab.
I20260805 22:51:37.686439 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.189:37697
--webserver_interface=127.14.224.189
--webserver_port=0
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.189.keytab
--principal=kudu/127.14.224.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:45887
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.224.190:37617,127.14.224.189:37697,127.14.224.188:42869
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 22:51:37.721071 16519 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.224.189" port: 37697 } attempt: 1
I20260805 22:51:37.721647 16522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:37.721509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.189:37697 (local address 127.0.0.1:58628)
0805 22:51:37.721575 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:37.721610 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.189:37697: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260805 22:51:37.722054 16522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:37.721958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.189:37697 (local address 127.0.0.1:58638)
0805 22:51:37.722006 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:37.722032 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.189:37697: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260805 22:51:37.722148 16519 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.224.189:37697: Network error: Client connection negotiation failed: client connection to 127.14.224.189:37697: connect: Connection refused (error 111)
W20260805 22:51:37.771456 16528 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260805 22:51:37.771708 16528 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:51:37.771734 16528 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:51:37.771761 16528 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:51:37.773046 16528 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:51:37.773106 16528 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:51:37.773124 16528 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:51:37.773141 16528 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:51:37.773155 16528 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:51:37.774823 16528 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:45887
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.14.224.190:37617,127.14.224.189:37697,127.14.224.188:42869
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.189.keytab
--principal=kudu/127.14.224.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.189:37697
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.14.224.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16528
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:51:37.775111 16528 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:51:37.775384 16528 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260805 22:51:37.780483 16528 server_base.cc:1034] running on GCE node
W20260805 22:51:37.780426 16533 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:37.780409 16535 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:37.780440 16540 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:51:37.780833 16528 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:51:37.781173 16528 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:51:37.782372 16528 hybrid_clock.cc:648] HybridClock initialized: now 1785970297782349 us; error 42 us; skew 500 ppm
Aug 05 22:51:37 dist-test-slave-gjrz krb5kdc[16407](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970297, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:51:37.785024 16528 init.cc:377] Logged in from keytab as kudu/127.14.224.189@KRBTEST.COM (short username kudu)
I20260805 22:51:37.785537 16528 webserver.cc:460] Webserver started at http://127.14.224.189:39561/ using document root <none> and password file <none>
I20260805 22:51:37.785748 16528 fs_manager.cc:359] Metadata directory not provided
I20260805 22:51:37.785799 16528 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:51:37.785936 16528 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:51:37.787075 16528 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/minicluster-data/master-1/data/instance:
uuid: "b66b54d527cd4999959d49649670c609"
format_stamp: "Formatted at 2026-08-05 22:51:37 on dist-test-slave-gjrz"
server_key: "7a9eb59baeb99ce70ad5c5686696218f"
server_key_iv: "b9eccd597606e5fb06d26ccda4bfde7f"
server_key_version: "encryptionkey@0"
I20260805 22:51:37.787477 16528 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/minicluster-data/master-1/wal/instance:
uuid: "b66b54d527cd4999959d49649670c609"
format_stamp: "Formatted at 2026-08-05 22:51:37 on dist-test-slave-gjrz"
server_key: "7a9eb59baeb99ce70ad5c5686696218f"
server_key_iv: "b9eccd597606e5fb06d26ccda4bfde7f"
server_key_version: "encryptionkey@0"
I20260805 22:51:37.788915 16528 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:51:37.789865 16549 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:37.790062 16528 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:51:37.790158 16528 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/minicluster-data/master-1/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/minicluster-data/master-1/wal
uuid: "b66b54d527cd4999959d49649670c609"
format_stamp: "Formatted at 2026-08-05 22:51:37 on dist-test-slave-gjrz"
server_key: "7a9eb59baeb99ce70ad5c5686696218f"
server_key_iv: "b9eccd597606e5fb06d26ccda4bfde7f"
server_key_version: "encryptionkey@0"
I20260805 22:51:37.790230 16528 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:51:37.790288 16519 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.224.189" port: 37697 } attempt: 2
I20260805 22:51:37.790745 16522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:37.790599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.189:37697 (local address 127.0.0.1:58650)
0805 22:51:37.790672 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:37.790713 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.189:37697: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260805 22:51:37.791139 16522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:37.791035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.189:37697 (local address 127.0.0.1:58662)
0805 22:51:37.791093 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:37.791119 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.189:37697: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260805 22:51:37.791232 16519 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.224.189:37697: Network error: Client connection negotiation failed: client connection to 127.14.224.189:37697: connect: Connection refused (error 111)
I20260805 22:51:37.809152 16528 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:51:37.811515 16528 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:51:37.811664 16528 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:51:37.815793 16528 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.189:37697
I20260805 22:51:37.815833 16618 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.189:37697 every 8 connection(s)
I20260805 22:51:37.816195 16528 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/minicluster-data/master-1/data/info.pb
I20260805 22:51:37.817097 16619 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:51:37.818665 16619 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.224.190" port: 37617 } has no permanent_uuid. Determining permanent_uuid...
I20260805 22:51:37.822708 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 16528
I20260805 22:51:37.822834 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/minicluster-data/master-1/wal/instance
I20260805 22:51:37.823058 15234 external_mini_cluster.cc:1428] Setting key 50b49fb18493b6cd20ffef424cbc0ba5
Aug 05 22:51:37 dist-test-slave-gjrz krb5kdc[16407](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970297, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.189@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
I20260805 22:51:37.829383 16523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:37.819404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51828 (local address 127.14.224.190:37617)
0805 22:51:37.819478 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:37.819481 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:37.819764 (+ 283us) server_negotiation.cc:407] Connection header received
0805 22:51:37.820288 (+ 524us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:37.820290 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:37.820306 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:37.820367 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:37.821229 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:37.821716 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:37.823052 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:37.823317 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:37.823381 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:37.826090 (+ 2709us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:37.826093 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:37.826093 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:51:37.826102 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:37.827601 (+ 1499us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:37.828173 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:37.828174 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:37.828175 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:37.828242 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:37.828602 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:37.828603 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:37.828603 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:37.828744 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:37.828812 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:37.829219 (+ 407us) server_negotiation.cc:299] Negotiation successful
0805 22:51:37.829310 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260805 22:51:37.829663 16621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:37.819407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:37617 (local address 127.0.0.1:51828)
0805 22:51:37.819635 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:37.819678 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0805 22:51:37.820175 (+ 497us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:51:37.820555 (+ 380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:51:37.820560 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:51:37.820865 (+ 305us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:51:37.821075 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:37.821080 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:37.821830 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:37.821831 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:37.822929 (+ 1098us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:37.822934 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:37.823404 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:37.823405 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:37.823555 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:37.824130 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:51:37.824151 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:51:37.825968 (+ 1817us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:51:37.827701 (+ 1733us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:51:37.827714 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:51:37.827717 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:51:37.828086 (+ 369us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:51:37.828310 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:51:37.828311 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:51:37.828312 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:51:37.828497 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:51:37.828821 (+ 324us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:51:37.828830 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:51:37.829040 (+ 210us) client_negotiation.cc:769] Sending connection context
0805 22:51:37.829176 (+ 136us) client_negotiation.cc:240] Negotiation successful
0805 22:51:37.829396 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":96,"threads_started":1}
I20260805 22:51:37.830361 16619 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.224.189" port: 37697 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.14.224.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.224.188@KRBTEST.COM" created.
Aug 05 22:51:37 dist-test-slave-gjrz krb5kdc[16407](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970297, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.189@KRBTEST.COM for kudu/127.14.224.189@KRBTEST.COM
I20260805 22:51:37.839502 16625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:37.830724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58678 (local address 127.14.224.189:37697)
0805 22:51:37.830912 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:37.830917 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:37.830946 (+ 29us) server_negotiation.cc:407] Connection header received
0805 22:51:37.830971 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:37.830973 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:37.830989 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:37.831075 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:37.831365 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:37.832486 (+ 1121us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:37.833164 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:37.833542 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:37.833602 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:37.836230 (+ 2628us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:37.836244 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:37.836244 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:51:37.836253 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:37.838013 (+ 1760us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:37.838421 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:37.838443 (+ 22us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:37.838443 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:37.838520 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:37.838728 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:37.838729 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:37.838729 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:37.838952 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:37.839085 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:37.839193 (+ 108us) server_negotiation.cc:299] Negotiation successful
0805 22:51:37.839365 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":99,"server-negotiator.queue_time_us":153,"thread_start_us":101,"threads_started":1}
I20260805 22:51:37.839478 16621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:37.830650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.189:37697 (local address 127.0.0.1:58678)
0805 22:51:37.830698 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:37.830709 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:51:37.830752 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:51:37.831084 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:51:37.831085 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:51:37.831214 (+ 129us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:51:37.831304 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:37.831306 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:37.832580 (+ 1274us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:37.832582 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:37.833091 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:37.833092 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:37.833608 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:37.833609 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:37.833668 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:37.834064 (+ 396us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:51:37.834069 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:51:37.836139 (+ 2070us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:51:37.838095 (+ 1956us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:51:37.838096 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:51:37.838097 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:51:37.838322 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:51:37.838592 (+ 270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:51:37.838593 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:51:37.838593 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:51:37.838663 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:51:37.839049 (+ 386us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:51:37.839050 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:51:37.839094 (+ 44us) client_negotiation.cc:769] Sending connection context
0805 22:51:37.839162 (+ 68us) client_negotiation.cc:240] Negotiation successful
0805 22:51:37.839306 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260805 22:51:37.840332 16619 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.224.188" port: 42869 } has no permanent_uuid. Determining permanent_uuid...
I20260805 22:51:37.840669 16621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:37.840556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.188:42869 (local address 127.0.0.1:55686)
0805 22:51:37.840599 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:37.840648 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.188:42869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260805 22:51:37.840795 16555 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.224.188:42869: connect: Connection refused (error 111)
I20260805 22:51:37.841202 16621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:37.841110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.188:42869 (local address 127.0.0.1:55698)
0805 22:51:37.841153 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:37.841177 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.188:42869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260805 22:51:37.841333 16619 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.224.188:42869: Network error: Client connection negotiation failed: client connection to 127.14.224.188:42869: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.224.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.188.keytab.
Entry for principal kudu/127.14.224.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.188.keytab.
I20260805 22:51:37.854362 15234 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9AL_ND/build/release/bin/kudu
/tmp/dist-test-task9AL_ND/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.188:42869
--webserver_interface=127.14.224.188
--webserver_port=0
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.188.keytab
--principal=kudu/127.14.224.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.224.148:45887
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.224.190:37617,127.14.224.189:37697,127.14.224.188:42869
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 22:51:37.882419 16519 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.224.189" port: 37697 } attempt: 3
Aug 05 22:51:37 dist-test-slave-gjrz krb5kdc[16407](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970297, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.190@KRBTEST.COM for kudu/127.14.224.189@KRBTEST.COM
I20260805 22:51:37.890264 16522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:37.882845 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.189:37697 (local address 127.0.0.1:58694)
0805 22:51:37.882929 (+ 84us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:37.882944 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0805 22:51:37.883037 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:51:37.883183 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:51:37.883184 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:51:37.883425 (+ 241us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:51:37.883518 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:37.883522 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:37.884244 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:37.884245 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:37.885081 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:37.885085 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:37.885487 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:37.885488 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:37.885565 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:37.886065 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:51:37.886070 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:51:37.887558 (+ 1488us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:51:37.889248 (+ 1690us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:51:37.889250 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:51:37.889250 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:51:37.889432 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:51:37.889635 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:51:37.889636 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:51:37.889636 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:51:37.889695 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:51:37.889927 (+ 232us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:51:37.889929 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:51:37.889982 (+ 53us) client_negotiation.cc:769] Sending connection context
0805 22:51:37.890040 (+ 58us) client_negotiation.cc:240] Negotiation successful
0805 22:51:37.890153 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260805 22:51:37.890264 16625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:37.882897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58694 (local address 127.14.224.189:37697)
0805 22:51:37.882956 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:37.882958 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:37.883012 (+ 54us) server_negotiation.cc:407] Connection header received
0805 22:51:37.883101 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:37.883101 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:37.883112 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:37.883161 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:37.883635 (+ 474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:37.884157 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:37.885177 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:37.885410 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:37.885472 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:37.887659 (+ 2187us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:37.887661 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:37.887662 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:51:37.887671 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:37.889156 (+ 1485us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:37.889504 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:37.889505 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:37.889505 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:37.889571 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:37.889748 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:37.889749 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:37.889749 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:37.889869 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:37.889925 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:37.890069 (+ 144us) server_negotiation.cc:299] Negotiation successful
0805 22:51:37.890153 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260805 22:51:37.890659 16619 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.224.188" port: 42869 } attempt: 1
I20260805 22:51:37.890741 16519 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.224.188" port: 42869 } has no permanent_uuid. Determining permanent_uuid...
I20260805 22:51:37.891022 16621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:37.890911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.188:42869 (local address 127.0.0.1:55704)
0805 22:51:37.890956 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:37.890992 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.188:42869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260805 22:51:37.891122 16522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:37.890987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.188:42869 (local address 127.0.0.1:55712)
0805 22:51:37.891051 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:37.891088 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.188:42869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260805 22:51:37.891325 16621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:37.891230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.188:42869 (local address 127.0.0.1:55718)
0805 22:51:37.891281 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:37.891303 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.188:42869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
W20260805 22:51:37.891419 16619 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.224.188:42869: Network error: Client connection negotiation failed: client connection to 127.14.224.188:42869: connect: Connection refused (error 111)
I20260805 22:51:37.891538 16522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:37.891386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.188:42869 (local address 127.0.0.1:55720)
0805 22:51:37.891493 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:37.891517 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.188:42869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95}
W20260805 22:51:37.891626 16519 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.224.188:42869: Network error: Client connection negotiation failed: client connection to 127.14.224.188:42869: connect: Connection refused (error 111)
I20260805 22:51:37.922797 16519 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.224.188" port: 42869 } attempt: 1
I20260805 22:51:37.923418 16522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:37.923242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.188:42869 (local address 127.0.0.1:55736)
0805 22:51:37.923330 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:37.923381 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.188:42869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260805 22:51:37.923836 16522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:37.923702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.188:42869 (local address 127.0.0.1:55738)
0805 22:51:37.923766 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:37.923800 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.188:42869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260805 22:51:37.923938 16519 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.224.188:42869: Network error: Client connection negotiation failed: client connection to 127.14.224.188:42869: connect: Connection refused (error 111)
W20260805 22:51:37.942525 16628 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260805 22:51:37.942766 16628 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:51:37.942792 16628 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:51:37.942821 16628 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:51:37.944140 16628 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:51:37.944196 16628 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:51:37.944216 16628 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:51:37.944231 16628 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:51:37.944247 16628 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:51:37.945922 16628 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.224.148:45887
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.14.224.190:37617,127.14.224.189:37697,127.14.224.188:42869
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/krb5kdc/kudu_127.14.224.188.keytab
--principal=kudu/127.14.224.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.224.188:42869
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.14.224.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16628
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:51:37.946211 16628 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:51:37.946444 16628 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:51:37.951634 16635 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:37.951650 16634 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:51:37.951653 16638 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:51:37.951869 16628 server_base.cc:1034] running on GCE node
I20260805 22:51:37.952221 16628 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:51:37.952554 16628 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:51:37.953722 16628 hybrid_clock.cc:648] HybridClock initialized: now 1785970297953708 us; error 35 us; skew 500 ppm
Aug 05 22:51:37 dist-test-slave-gjrz krb5kdc[16407](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970297, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:51:37.956545 16628 init.cc:377] Logged in from keytab as kudu/127.14.224.188@KRBTEST.COM (short username kudu)
I20260805 22:51:37.957087 16628 webserver.cc:460] Webserver started at http://127.14.224.188:39763/ using document root <none> and password file <none>
I20260805 22:51:37.957332 16628 fs_manager.cc:359] Metadata directory not provided
I20260805 22:51:37.957386 16628 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:51:37.957520 16628 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:51:37.958612 16628 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/minicluster-data/master-2/data/instance:
uuid: "a10ef0495f6b4db7bb6e06a521e38662"
format_stamp: "Formatted at 2026-08-05 22:51:37 on dist-test-slave-gjrz"
server_key: "1d87fa6ef9cf396ad5b6b5d9360cb4b8"
server_key_iv: "d5b21ec6b7dc62a7c58b21a222cc3cb7"
server_key_version: "encryptionkey@0"
I20260805 22:51:37.958953 16628 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/minicluster-data/master-2/wal/instance:
uuid: "a10ef0495f6b4db7bb6e06a521e38662"
format_stamp: "Formatted at 2026-08-05 22:51:37 on dist-test-slave-gjrz"
server_key: "1d87fa6ef9cf396ad5b6b5d9360cb4b8"
server_key_iv: "d5b21ec6b7dc62a7c58b21a222cc3cb7"
server_key_version: "encryptionkey@0"
I20260805 22:51:37.959591 16619 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.224.188" port: 42869 } attempt: 2
I20260805 22:51:37.960116 16621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:37.959917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.188:42869 (local address 127.0.0.1:55754)
0805 22:51:37.960039 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:37.960082 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.188:42869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
I20260805 22:51:37.960481 16621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:37.960361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.188:42869 (local address 127.0.0.1:55768)
0805 22:51:37.960416 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:37.960452 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.224.188:42869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260805 22:51:37.960601 16619 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.224.188:42869: Network error: Client connection negotiation failed: client connection to 127.14.224.188:42869: connect: Connection refused (error 111)
I20260805 22:51:37.960916 16628 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:51:37.961748 16652 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:51:37.961930 16628 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:51:37.962026 16628 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/minicluster-data/master-2/data,/tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/minicluster-data/master-2/wal
uuid: "a10ef0495f6b4db7bb6e06a521e38662"
format_stamp: "Formatted at 2026-08-05 22:51:37 on dist-test-slave-gjrz"
server_key: "1d87fa6ef9cf396ad5b6b5d9360cb4b8"
server_key_iv: "d5b21ec6b7dc62a7c58b21a222cc3cb7"
server_key_version: "encryptionkey@0"
I20260805 22:51:37.962093 16628 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:51:37.980736 16628 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:51:37.982867 16628 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:51:37.982991 16628 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:51:37.986892 16628 rpc_server.cc:307] RPC server started. Bound to: 127.14.224.188:42869
I20260805 22:51:37.986963 16729 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.224.188:42869 every 8 connection(s)
I20260805 22:51:37.987323 16628 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/minicluster-data/master-2/data/info.pb
I20260805 22:51:37.988293 16731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:51:37.989893 16731 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.224.190" port: 37617 } has no permanent_uuid. Determining permanent_uuid...
I20260805 22:51:37.990422 15234 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9AL_ND/build/release/bin/kudu as pid 16628
I20260805 22:51:37.990549 15234 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9AL_ND/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970021300824-15234-0/minicluster-data/master-2/wal/instance
I20260805 22:51:37.990759 15234 external_mini_cluster.cc:1428] Setting key 37add044d3e51340ff9c9ff31c269e92
Aug 05 22:51:37 dist-test-slave-gjrz krb5kdc[16407](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970297, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.188@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
Aug 05 22:51:37 dist-test-slave-gjrz krb5kdc[16407](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970297, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.224.188@KRBTEST.COM
I20260805 22:51:37.999061 16519 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.224.188" port: 42869 } attempt: 2
I20260805 22:51:37.999148 16523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:37.990638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51836 (local address 127.14.224.190:37617)
0805 22:51:37.990716 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:37.990718 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:37.990949 (+ 231us) server_negotiation.cc:407] Connection header received
0805 22:51:37.991562 (+ 613us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:37.991563 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:37.991576 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:37.991626 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:37.992189 (+ 563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:37.992709 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:37.993662 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:37.993863 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:37.993918 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:37.996328 (+ 2410us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:37.996329 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:37.996329 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:51:37.996338 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:37.997738 (+ 1400us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:37.998200 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:37.998201 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:37.998201 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:37.998260 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:37.998472 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:37.998472 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:37.998473 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:37.998598 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:37.998654 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:37.998917 (+ 263us) server_negotiation.cc:299] Negotiation successful
0805 22:51:37.999001 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260805 22:51:37.999601 16734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:37.990631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.190:37617 (local address 127.0.0.1:51836)
0805 22:51:37.990813 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:37.990857 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0805 22:51:37.991454 (+ 597us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:51:37.991645 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:51:37.991648 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:51:37.991921 (+ 273us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:51:37.992095 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:37.992099 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:37.992787 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:37.992788 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:37.993563 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:37.993567 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:37.993932 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:37.993933 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:37.994072 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:37.994614 (+ 542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:51:37.994622 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:51:37.996235 (+ 1613us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:51:37.997815 (+ 1580us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:51:37.997823 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:51:37.997825 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:51:37.998132 (+ 307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:51:37.998314 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:51:37.998314 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:51:37.998315 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:51:37.998415 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:51:37.998655 (+ 240us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:51:37.998662 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:51:37.998797 (+ 135us) client_negotiation.cc:769] Sending connection context
0805 22:51:37.998888 (+ 91us) client_negotiation.cc:240] Negotiation successful
0805 22:51:37.999048 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":87,"threads_started":1}
I20260805 22:51:37.999728 16736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:37.991187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55772 (local address 127.14.224.188:42869)
0805 22:51:37.991370 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:37.991375 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:37.991417 (+ 42us) server_negotiation.cc:407] Connection header received
0805 22:51:37.991502 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:37.991508 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:37.991527 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:37.991604 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:37.992216 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:37.993101 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:37.993883 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:37.994233 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:37.994296 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:37.996685 (+ 2389us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:37.996693 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:37.996694 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:51:37.996701 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:37.998147 (+ 1446us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:37.998459 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:37.998462 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:37.998463 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:37.998522 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:37.998688 (+ 166us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:37.998689 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:37.998689 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:37.998829 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:37.998972 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:37.999040 (+ 68us) server_negotiation.cc:299] Negotiation successful
0805 22:51:37.999122 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":105,"threads_started":1}
I20260805 22:51:38.000174 16731 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.224.189" port: 37697 } has no permanent_uuid. Determining permanent_uuid...
Aug 05 22:51:38 dist-test-slave-gjrz krb5kdc[16407](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970297, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.190@KRBTEST.COM for kudu/127.14.224.188@KRBTEST.COM
Aug 05 22:51:38 dist-test-slave-gjrz krb5kdc[16407](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970297, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.224.190@KRBTEST.COM
Aug 05 22:51:38 dist-test-slave-gjrz krb5kdc[16407](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970297, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.188@KRBTEST.COM for kudu/127.14.224.189@KRBTEST.COM
I20260805 22:51:38.008196 16523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:38.000561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51840 (local address 127.14.224.190:37617)
0805 22:51:38.000619 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:38.000621 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:38.000628 (+ 7us) server_negotiation.cc:407] Connection header received
0805 22:51:38.000646 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:38.000646 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:38.000654 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:38.000705 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:38.001188 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:38.001622 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:38.002326 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:38.002592 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:38.002649 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:38.005059 (+ 2410us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:38.005060 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:38.005061 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:51:38.005068 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:38.007035 (+ 1967us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:38.007473 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:38.007474 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:38.007475 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:38.007529 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:38.007741 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:38.007742 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:38.007742 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:38.007845 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:38.007984 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:38.008056 (+ 72us) server_negotiation.cc:299] Negotiation successful
0805 22:51:38.008126 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260805 22:51:38.008937 16522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:37.999424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.188:42869 (local address 127.0.0.1:55780)
0805 22:51:37.999514 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:37.999524 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0805 22:51:37.999561 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:51:37.999806 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:51:37.999808 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:51:37.999952 (+ 144us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:51:38.000000 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:38.000002 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:38.000853 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:38.000854 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:38.001647 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:38.001650 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:38.002151 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:38.002152 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:38.002213 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:38.002593 (+ 380us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:51:38.002599 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:51:38.004352 (+ 1753us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:51:38.006808 (+ 2456us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:51:38.006810 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:51:38.006810 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:51:38.007120 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:51:38.008329 (+ 1209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:51:38.008330 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:51:38.008330 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:51:38.008397 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:51:38.008635 (+ 238us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:51:38.008636 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:51:38.008675 (+ 39us) client_negotiation.cc:769] Sending connection context
0805 22:51:38.008744 (+ 69us) client_negotiation.cc:240] Negotiation successful
0805 22:51:38.008850 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":68}
I20260805 22:51:38.009233 16739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:37.999465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55780 (local address 127.14.224.188:42869)
0805 22:51:37.999656 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:37.999658 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:37.999666 (+ 8us) server_negotiation.cc:407] Connection header received
0805 22:51:37.999686 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:37.999686 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:37.999697 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:38.000070 (+ 373us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:38.000111 (+ 41us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:38.000780 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:38.001734 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:38.002073 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:38.002143 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:38.004443 (+ 2300us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:38.004445 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:38.004446 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:51:38.004453 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:38.006727 (+ 2274us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:38.007220 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:38.007222 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:38.007222 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:38.008246 (+ 1024us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:38.008462 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:38.008464 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:38.008464 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:38.008583 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:38.008643 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:38.008773 (+ 130us) server_negotiation.cc:299] Negotiation successful
0805 22:51:38.008864 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":168,"thread_start_us":122,"threads_started":1}
I20260805 22:51:38.009501 16734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:38.000400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.189:37697 (local address 127.0.0.1:58710)
0805 22:51:38.000438 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:38.000447 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0805 22:51:38.000478 (+ 31us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:51:38.000656 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:51:38.000657 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:51:38.000799 (+ 142us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:51:38.000849 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:38.000850 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:38.001734 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:38.001734 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:38.002485 (+ 751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:38.002487 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:38.003008 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:38.003009 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:38.003084 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:38.003446 (+ 362us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:51:38.003451 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:51:38.005727 (+ 2276us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:51:38.007934 (+ 2207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:51:38.007935 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:51:38.007936 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:51:38.008170 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:51:38.008823 (+ 653us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:51:38.008823 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:51:38.008824 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:51:38.008878 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:51:38.009187 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:51:38.009188 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:51:38.009228 (+ 40us) client_negotiation.cc:769] Sending connection context
0805 22:51:38.009321 (+ 93us) client_negotiation.cc:240] Negotiation successful
0805 22:51:38.009422 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24,"mutex_wait_us":21}
I20260805 22:51:38.009531 16625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:38.000473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58710 (local address 127.14.224.189:37697)
0805 22:51:38.000522 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:38.000524 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:38.000531 (+ 7us) server_negotiation.cc:407] Connection header received
0805 22:51:38.000554 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:38.000555 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:38.000564 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:38.000607 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:38.000937 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:38.001642 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:38.002611 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:38.002908 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:38.002992 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:38.005819 (+ 2827us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:38.005821 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:38.005821 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:51:38.005831 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:38.007847 (+ 2016us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:38.008690 (+ 843us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:38.008692 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:38.008692 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:38.008752 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:38.008948 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:38.008949 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:38.008949 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:38.009103 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:38.009143 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:38.009355 (+ 212us) server_negotiation.cc:299] Negotiation successful
0805 22:51:38.009433 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260805 22:51:38.010174 16731 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.224.188" port: 42869 } has no permanent_uuid. Determining permanent_uuid...
I20260805 22:51:38.011431 16519 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0700bba63ec743da94ec3d4b78318f8b: Bootstrap starting.
I20260805 22:51:38.012236 16519 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0700bba63ec743da94ec3d4b78318f8b: Neither blocks nor log segments found. Creating new log.
I20260805 22:51:38.012550 16519 log.cc:824] T 00000000000000000000000000000000 P 0700bba63ec743da94ec3d4b78318f8b: Log is configured to *not* fsync() on all Append() calls
I20260805 22:51:38.013489 16519 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0700bba63ec743da94ec3d4b78318f8b: No bootstrap required, opened a new log
Aug 05 22:51:38 dist-test-slave-gjrz krb5kdc[16407](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970297, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.224.189@KRBTEST.COM
Aug 05 22:51:38 dist-test-slave-gjrz krb5kdc[16407](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970297, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.188@KRBTEST.COM for kudu/127.14.224.188@KRBTEST.COM
I20260805 22:51:38.015228 16519 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0700bba63ec743da94ec3d4b78318f8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0700bba63ec743da94ec3d4b78318f8b" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 37617 } } peers { permanent_uuid: "b66b54d527cd4999959d49649670c609" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 37697 } } peers { permanent_uuid: "a10ef0495f6b4db7bb6e06a521e38662" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 42869 } }
I20260805 22:51:38.015407 16519 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0700bba63ec743da94ec3d4b78318f8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0700bba63ec743da94ec3d4b78318f8b, State: Initialized, Role: FOLLOWER
I20260805 22:51:38.015478 16519 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0700bba63ec743da94ec3d4b78318f8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0700bba63ec743da94ec3d4b78318f8b" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 37617 } } peers { permanent_uuid: "b66b54d527cd4999959d49649670c609" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 37697 } } peers { permanent_uuid: "a10ef0495f6b4db7bb6e06a521e38662" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 42869 } }
I20260805 22:51:38.015724 16742 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0700bba63ec743da94ec3d4b78318f8b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0700bba63ec743da94ec3d4b78318f8b" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 37617 } } peers { permanent_uuid: "b66b54d527cd4999959d49649670c609" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 37697 } } peers { permanent_uuid: "a10ef0495f6b4db7bb6e06a521e38662" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 42869 } } }
I20260805 22:51:38.015801 16519 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0700bba63ec743da94ec3d4b78318f8b [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:51:38.015817 16742 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0700bba63ec743da94ec3d4b78318f8b [sys.catalog]: This master's current role is: FOLLOWER
I20260805 22:51:38.017874 16734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:38.010431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.188:42869 (local address 127.0.0.1:55788)
0805 22:51:38.010632 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:38.010641 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0805 22:51:38.010676 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:51:38.010792 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:51:38.010793 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:51:38.010922 (+ 129us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:51:38.010950 (+ 28us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:38.010951 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:38.011688 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:38.011690 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:38.012375 (+ 685us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:38.012378 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:38.012952 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:38.012953 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:38.013019 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:38.013400 (+ 381us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:51:38.013405 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:51:38.014565 (+ 1160us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:51:38.016875 (+ 2310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:51:38.016876 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:51:38.016876 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:51:38.017070 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:51:38.017250 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:51:38.017250 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:51:38.017250 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:51:38.017301 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:51:38.017608 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:51:38.017609 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:51:38.017647 (+ 38us) client_negotiation.cc:769] Sending connection context
0805 22:51:38.017689 (+ 42us) client_negotiation.cc:240] Negotiation successful
0805 22:51:38.017777 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":189}
I20260805 22:51:38.018239 16739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:38.010492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55788 (local address 127.14.224.188:42869)
0805 22:51:38.010534 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:38.010536 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:38.010680 (+ 144us) server_negotiation.cc:407] Connection header received
0805 22:51:38.010727 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:38.010727 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:38.010739 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:38.010788 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:38.011016 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:38.011609 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:38.012468 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:38.012862 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:38.012940 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:38.014656 (+ 1716us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:38.014657 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:38.014658 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:51:38.014665 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:38.016811 (+ 2146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:38.017141 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:38.017142 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:38.017142 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:38.017190 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:38.017356 (+ 166us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:38.017357 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:38.017357 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:38.017539 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:38.018052 (+ 513us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:38.018089 (+ 37us) server_negotiation.cc:299] Negotiation successful
0805 22:51:38.018165 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
W20260805 22:51:38.018226 16761 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0700bba63ec743da94ec3d4b78318f8b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260805 22:51:38.018256 16740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:38.008921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58718 (local address 127.14.224.189:37697)
0805 22:51:38.009155 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:38.009157 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:38.009164 (+ 7us) server_negotiation.cc:407] Connection header received
0805 22:51:38.009185 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:38.009186 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:38.009196 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:38.009257 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:38.009841 (+ 584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:38.010548 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:38.011471 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:38.011778 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:38.011835 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:38.014735 (+ 2900us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:38.014737 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:38.014737 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:51:38.014744 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:38.016416 (+ 1672us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:38.016846 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:38.016847 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:38.016848 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:38.016918 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:38.017129 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:38.017131 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:38.017131 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:38.017283 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:38.017458 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:38.017730 (+ 272us) server_negotiation.cc:299] Negotiation successful
0805 22:51:38.017812 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":213,"thread_start_us":116,"threads_started":1}
W20260805 22:51:38.018277 16761 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260805 22:51:38.019697 16731 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a10ef0495f6b4db7bb6e06a521e38662: Bootstrap starting.
I20260805 22:51:38.019783 15234 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:51:38.020345 16731 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a10ef0495f6b4db7bb6e06a521e38662: Neither blocks nor log segments found. Creating new log.
I20260805 22:51:38.020620 16731 log.cc:824] T 00000000000000000000000000000000 P a10ef0495f6b4db7bb6e06a521e38662: Log is configured to *not* fsync() on all Append() calls
I20260805 22:51:38.020706 16473 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "0700bba63ec743da94ec3d4b78318f8b"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51840
I20260805 22:51:38.020849 16473 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0700bba63ec743da94ec3d4b78318f8b [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260805 22:51:38.020905 16473 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0700bba63ec743da94ec3d4b78318f8b [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:51:38.018445 16426 master_runner.cc:186] Error getting master registration for 127.14.224.189:37697: OK, instance_id { permanent_uuid: "b66b54d527cd4999959d49649670c609" instance_seqno: 1785970297814578 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260805 22:51:38.021391 16731 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a10ef0495f6b4db7bb6e06a521e38662: No bootstrap required, opened a new log
I20260805 22:51:38.021399 16426 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260805 22:51:38.021798 16473 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0700bba63ec743da94ec3d4b78318f8b [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0700bba63ec743da94ec3d4b78318f8b" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 37617 } } peers { permanent_uuid: "b66b54d527cd4999959d49649670c609" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 37697 } } peers { permanent_uuid: "a10ef0495f6b4db7bb6e06a521e38662" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 42869 } }
I20260805 22:51:38.022060 16473 leader_election.cc:288] T 00000000000000000000000000000000 P 0700bba63ec743da94ec3d4b78318f8b [CANDIDATE]: Term 1 election: Requested vote from peers b66b54d527cd4999959d49649670c609 (127.14.224.189:37697), a10ef0495f6b4db7bb6e06a521e38662 (127.14.224.188:42869)
I20260805 22:51:38.023320 16731 raft_consensus.cc:348] T 00000000000000000000000000000000 P a10ef0495f6b4db7bb6e06a521e38662 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0700bba63ec743da94ec3d4b78318f8b" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 37617 } } peers { permanent_uuid: "b66b54d527cd4999959d49649670c609" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 37697 } } peers { permanent_uuid: "a10ef0495f6b4db7bb6e06a521e38662" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 42869 } }
I20260805 22:51:38.023649 16731 raft_consensus.cc:729] T 00000000000000000000000000000000 P a10ef0495f6b4db7bb6e06a521e38662 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a10ef0495f6b4db7bb6e06a521e38662, State: Initialized, Role: FOLLOWER
I20260805 22:51:38.023752 16731 consensus_queue.cc:260] T 00000000000000000000000000000000 P a10ef0495f6b4db7bb6e06a521e38662 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0700bba63ec743da94ec3d4b78318f8b" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 37617 } } peers { permanent_uuid: "b66b54d527cd4999959d49649670c609" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 37697 } } peers { permanent_uuid: "a10ef0495f6b4db7bb6e06a521e38662" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 42869 } }
I20260805 22:51:38.024073 16731 sys_catalog.cc:564] T 00000000000000000000000000000000 P a10ef0495f6b4db7bb6e06a521e38662 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:51:38.024132 16691 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0700bba63ec743da94ec3d4b78318f8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "a10ef0495f6b4db7bb6e06a521e38662"
I20260805 22:51:38.024274 16691 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a10ef0495f6b4db7bb6e06a521e38662 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:51:38.025231 16691 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a10ef0495f6b4db7bb6e06a521e38662 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0700bba63ec743da94ec3d4b78318f8b in term 1.
I20260805 22:51:38.025588 16445 leader_election.cc:302] T 00000000000000000000000000000000 P 0700bba63ec743da94ec3d4b78318f8b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0700bba63ec743da94ec3d4b78318f8b, a10ef0495f6b4db7bb6e06a521e38662; no voters:
I20260805 22:51:38.025738 16742 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0700bba63ec743da94ec3d4b78318f8b [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:51:38.025910 16742 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0700bba63ec743da94ec3d4b78318f8b [term 1 LEADER]: Becoming Leader. State: Replica: 0700bba63ec743da94ec3d4b78318f8b, State: Running, Role: LEADER
I20260805 22:51:38.026015 16742 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0700bba63ec743da94ec3d4b78318f8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0700bba63ec743da94ec3d4b78318f8b" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 37617 } } peers { permanent_uuid: "b66b54d527cd4999959d49649670c609" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 37697 } } peers { permanent_uuid: "a10ef0495f6b4db7bb6e06a521e38662" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 42869 } }
W20260805 22:51:38.026413 16788 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a10ef0495f6b4db7bb6e06a521e38662: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260805 22:51:38.026464 16788 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260805 22:51:38.028110 16790 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0700bba63ec743da94ec3d4b78318f8b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0700bba63ec743da94ec3d4b78318f8b. Latest consensus state: current_term: 1 leader_uuid: "0700bba63ec743da94ec3d4b78318f8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0700bba63ec743da94ec3d4b78318f8b" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 37617 } } peers { permanent_uuid: "b66b54d527cd4999959d49649670c609" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 37697 } } peers { permanent_uuid: "a10ef0495f6b4db7bb6e06a521e38662" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 42869 } } }
I20260805 22:51:38.028236 16790 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0700bba63ec743da94ec3d4b78318f8b [sys.catalog]: This master's current role is: LEADER
I20260805 22:51:38.028843 16793 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:51:38.029218 16793 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:51:38.028221 16628 master_runner.cc:186] Error getting master registration for 127.14.224.189:37697: OK, instance_id { permanent_uuid: "b66b54d527cd4999959d49649670c609" instance_seqno: 1785970297814578 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260805 22:51:38.030506 16628 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260805 22:51:38.032183 16691 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a10ef0495f6b4db7bb6e06a521e38662 [term 1 FOLLOWER]: Refusing update from remote peer 0700bba63ec743da94ec3d4b78318f8b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:51:38.032534 16790 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 0700bba63ec743da94ec3d4b78318f8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a10ef0495f6b4db7bb6e06a521e38662" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 42869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:51:38.033948 16796 sys_catalog.cc:455] T 00000000000000000000000000000000 P a10ef0495f6b4db7bb6e06a521e38662 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0700bba63ec743da94ec3d4b78318f8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0700bba63ec743da94ec3d4b78318f8b" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 37617 } } peers { permanent_uuid: "b66b54d527cd4999959d49649670c609" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 37697 } } peers { permanent_uuid: "a10ef0495f6b4db7bb6e06a521e38662" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 42869 } } }
I20260805 22:51:38.034061 16796 sys_catalog.cc:458] T 00000000000000000000000000000000 P a10ef0495f6b4db7bb6e06a521e38662 [sys.catalog]: This master's current role is: FOLLOWER
I20260805 22:51:38.034117 16796 sys_catalog.cc:455] T 00000000000000000000000000000000 P a10ef0495f6b4db7bb6e06a521e38662 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0700bba63ec743da94ec3d4b78318f8b. Latest consensus state: current_term: 1 leader_uuid: "0700bba63ec743da94ec3d4b78318f8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0700bba63ec743da94ec3d4b78318f8b" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 37617 } } peers { permanent_uuid: "b66b54d527cd4999959d49649670c609" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 37697 } } peers { permanent_uuid: "a10ef0495f6b4db7bb6e06a521e38662" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 42869 } } }
I20260805 22:51:38.034157 16796 sys_catalog.cc:458] T 00000000000000000000000000000000 P a10ef0495f6b4db7bb6e06a521e38662 [sys.catalog]: This master's current role is: FOLLOWER
I20260805 22:51:38.035154 16790 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0700bba63ec743da94ec3d4b78318f8b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0700bba63ec743da94ec3d4b78318f8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0700bba63ec743da94ec3d4b78318f8b" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 37617 } } peers { permanent_uuid: "b66b54d527cd4999959d49649670c609" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 37697 } } peers { permanent_uuid: "a10ef0495f6b4db7bb6e06a521e38662" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 42869 } } }
I20260805 22:51:38.035250 16790 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0700bba63ec743da94ec3d4b78318f8b [sys.catalog]: This master's current role is: LEADER
I20260805 22:51:38.035494 16794 mvcc.cc:205] Tried to move back new op lower bound from 7315334340736937984 to 7315334340715360256. Current Snapshot: MvccSnapshot[applied={T|T < 7315334340736937984}]
I20260805 22:51:38.035615 16796 sys_catalog.cc:455] T 00000000000000000000000000000000 P a10ef0495f6b4db7bb6e06a521e38662 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0700bba63ec743da94ec3d4b78318f8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0700bba63ec743da94ec3d4b78318f8b" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 37617 } } peers { permanent_uuid: "b66b54d527cd4999959d49649670c609" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 37697 } } peers { permanent_uuid: "a10ef0495f6b4db7bb6e06a521e38662" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 42869 } } }
I20260805 22:51:38.035784 16796 sys_catalog.cc:458] T 00000000000000000000000000000000 P a10ef0495f6b4db7bb6e06a521e38662 [sys.catalog]: This master's current role is: FOLLOWER
I20260805 22:51:38.036125 16797 mvcc.cc:205] Tried to move back new op lower bound from 7315334340736937984 to 7315334340715360256. Current Snapshot: MvccSnapshot[applied={T|T < 7315334340736937984}]
I20260805 22:51:38.036686 16793 catalog_manager.cc:1347] Generated new cluster ID: 09f7c0b1a174427a9a76db07cb95e365
I20260805 22:51:38.036731 16793 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:51:38.037199 16523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:38.023460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51844 (local address 127.14.224.190:37617)
0805 22:51:38.023502 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:38.023504 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:38.023957 (+ 453us) server_negotiation.cc:407] Connection header received
0805 22:51:38.027198 (+ 3241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:38.027199 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:38.027209 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:38.027246 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:38.029320 (+ 2074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:38.030062 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:38.031135 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:38.031463 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:38.031535 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:38.033233 (+ 1698us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:38.033234 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:38.033234 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:51:38.033242 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:38.034892 (+ 1650us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:38.035338 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:38.035340 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:38.035340 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:38.035511 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:38.035850 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:38.035852 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:38.035852 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:38.035997 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:38.036103 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:38.036220 (+ 117us) server_negotiation.cc:299] Negotiation successful
0805 22:51:38.036311 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260805 22:51:38.044011 16739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:38.031552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55802 (local address 127.14.224.188:42869)
0805 22:51:38.031595 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:38.031597 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:38.036471 (+ 4874us) server_negotiation.cc:407] Connection header received
0805 22:51:38.036506 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:38.036506 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:38.036518 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:38.036561 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:38.037167 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:38.037890 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:38.039326 (+ 1436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:38.039686 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:38.039753 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:38.041111 (+ 1358us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:38.041113 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:38.041113 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:51:38.041121 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:38.042573 (+ 1452us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:38.042970 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:38.042971 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:38.042972 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:38.043028 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:38.043218 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:38.043219 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:38.043220 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:38.043391 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:38.043486 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:38.043837 (+ 351us) server_negotiation.cc:299] Negotiation successful
0805 22:51:38.043922 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260805 22:51:38.044100 16740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:38.023738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58728 (local address 127.14.224.189:37697)
0805 22:51:38.023799 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:38.023801 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:38.035413 (+ 11612us) server_negotiation.cc:407] Connection header received
0805 22:51:38.035526 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:38.035527 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:38.035544 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:38.035575 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:38.036249 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:38.036945 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:38.037971 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:38.038291 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:38.038352 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:38.041000 (+ 2648us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:38.041002 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:38.041002 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:51:38.041010 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:38.042842 (+ 1832us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:38.043215 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:38.043216 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:38.043216 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:38.043302 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:38.043515 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:38.043516 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:38.043516 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:38.043643 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:38.043725 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:38.043920 (+ 195us) server_negotiation.cc:299] Negotiation successful
0805 22:51:38.044008 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260805 22:51:38.051700 16619 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.224.188" port: 42869 } attempt: 3
Aug 05 22:51:38 dist-test-slave-gjrz krb5kdc[16407](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970297, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.224.189@KRBTEST.COM for kudu/127.14.224.188@KRBTEST.COM
I20260805 22:51:38.059190 16793 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:51:38.060022 16793 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:51:38.062103 16621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:38.052042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.224.188:42869 (local address 127.0.0.1:55810)
0805 22:51:38.052099 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0805 22:51:38.052110 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:51:38.052150 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:51:38.052285 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:51:38.052286 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:51:38.052476 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:51:38.052536 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:38.052539 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:38.053409 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:38.053410 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:38.054268 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:51:38.054271 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:51:38.055081 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:51:38.055083 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:51:38.055169 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:38.055701 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:51:38.055707 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:51:38.057307 (+ 1600us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:51:38.060657 (+ 3350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:51:38.060659 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:51:38.060659 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:51:38.060885 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:51:38.061243 (+ 358us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:51:38.061244 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:51:38.061244 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:51:38.061318 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:51:38.061768 (+ 450us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:51:38.061769 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:51:38.061818 (+ 49us) client_negotiation.cc:769] Sending connection context
0805 22:51:38.061864 (+ 46us) client_negotiation.cc:240] Negotiation successful
0805 22:51:38.061998 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260805 22:51:38.063210 16739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:38.052099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55810 (local address 127.14.224.188:42869)
0805 22:51:38.052140 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:38.052142 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:38.052151 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:51:38.052203 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:38.052204 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:38.052213 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:38.052271 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:38.052604 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:38.053332 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:38.054392 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:38.054933 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:38.055427 (+ 494us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:38.057419 (+ 1992us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:51:38.057421 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:51:38.057422 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:51:38.057431 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:51:38.060509 (+ 3078us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:38.061028 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:38.061029 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:38.061029 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:38.061122 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:51:38.061397 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:51:38.061398 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:51:38.061398 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:51:38.061652 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:51:38.062801 (+ 1149us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:38.062878 (+ 77us) server_negotiation.cc:299] Negotiation successful
0805 22:51:38.063058 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260805 22:51:38.065326 16619 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b66b54d527cd4999959d49649670c609: Bootstrap starting.
I20260805 22:51:38.066113 16619 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b66b54d527cd4999959d49649670c609: Neither blocks nor log segments found. Creating new log.
I20260805 22:51:38.066414 16619 log.cc:824] T 00000000000000000000000000000000 P b66b54d527cd4999959d49649670c609: Log is configured to *not* fsync() on all Append() calls
I20260805 22:51:38.067698 16619 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b66b54d527cd4999959d49649670c609: No bootstrap required, opened a new log
I20260805 22:51:38.069768 16619 raft_consensus.cc:348] T 00000000000000000000000000000000 P b66b54d527cd4999959d49649670c609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0700bba63ec743da94ec3d4b78318f8b" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 37617 } } peers { permanent_uuid: "b66b54d527cd4999959d49649670c609" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 37697 } } peers { permanent_uuid: "a10ef0495f6b4db7bb6e06a521e38662" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 42869 } }
I20260805 22:51:38.069947 16619 raft_consensus.cc:729] T 00000000000000000000000000000000 P b66b54d527cd4999959d49649670c609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b66b54d527cd4999959d49649670c609, State: Initialized, Role: FOLLOWER
I20260805 22:51:38.070041 16619 consensus_queue.cc:260] T 00000000000000000000000000000000 P b66b54d527cd4999959d49649670c609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0700bba63ec743da94ec3d4b78318f8b" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 37617 } } peers { permanent_uuid: "b66b54d527cd4999959d49649670c609" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 37697 } } peers { permanent_uuid: "a10ef0495f6b4db7bb6e06a521e38662" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 42869 } }
I20260805 22:51:38.070398 16619 sys_catalog.cc:564] T 00000000000000000000000000000000 P b66b54d527cd4999959d49649670c609 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:51:38.071694 16586 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b66b54d527cd4999959d49649670c609 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:51:38.072789 16586 raft_consensus.cc:1261] T 00000000000000000000000000000000 P b66b54d527cd4999959d49649670c609 [term 1 FOLLOWER]: Refusing update from remote peer 0700bba63ec743da94ec3d4b78318f8b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:51:38.073056 16587 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0700bba63ec743da94ec3d4b78318f8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b66b54d527cd4999959d49649670c609"
I20260805 22:51:38.073948 16587 raft_consensus.cc:2454] T 00000000000000000000000000000000 P b66b54d527cd4999959d49649670c609 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0700bba63ec743da94ec3d4b78318f8b in term 1.
I20260805 22:51:38.074853 16790 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 0700bba63ec743da94ec3d4b78318f8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b66b54d527cd4999959d49649670c609" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 37697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:51:38.078037 16793 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0700bba63ec743da94ec3d4b78318f8b: Generated new TSK 0
I20260805 22:51:38.078256 16793 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:51:38.079387 16828 sys_catalog.cc:455] T 00000000000000000000000000000000 P b66b54d527cd4999959d49649670c609 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0700bba63ec743da94ec3d4b78318f8b. Latest consensus state: current_term: 1 leader_uuid: "0700bba63ec743da94ec3d4b78318f8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0700bba63ec743da94ec3d4b78318f8b" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 37617 } } peers { permanent_uuid: "b66b54d527cd4999959d49649670c609" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 37697 } } peers { permanent_uuid: "a10ef0495f6b4db7bb6e06a521e38662" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 42869 } } }
I20260805 22:51:38.079519 16828 sys_catalog.cc:458] T 00000000000000000000000000000000 P b66b54d527cd4999959d49649670c609 [sys.catalog]: This master's current role is: FOLLOWER
I20260805 22:51:38.079572 16828 sys_catalog.cc:455] T 00000000000000000000000000000000 P b66b54d527cd4999959d49649670c609 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0700bba63ec743da94ec3d4b78318f8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0700bba63ec743da94ec3d4b78318f8b" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 37617 } } peers { permanent_uuid: "b66b54d527cd4999959d49649670c609" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 37697 } } peers { permanent_uuid: "a10ef0495f6b4db7bb6e06a521e38662" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 42869 } } }
I20260805 22:51:38.079613 16828 sys_catalog.cc:458] T 00000000000000000000000000000000 P b66b54d527cd4999959d49649670c609 [sys.catalog]: This master's current role is: FOLLOWER
W20260805 22:51:38.079845 16826 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b66b54d527cd4999959d49649670c609: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260805 22:51:38.079903 16826 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260805 22:51:38.080137 16829 mvcc.cc:205] Tried to move back new op lower bound from 7315334340843196416 to 7315334340715360256. Current Snapshot: MvccSnapshot[applied={T|T < 7315334340736937984}]
I20260805 22:51:38.080204 16804 sys_catalog.cc:455] T 00000000000000000000000000000000 P b66b54d527cd4999959d49649670c609 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0700bba63ec743da94ec3d4b78318f8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0700bba63ec743da94ec3d4b78318f8b" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 37617 } } peers { permanent_uuid: "b66b54d527cd4999959d49649670c609" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 37697 } } peers { permanent_uuid: "a10ef0495f6b4db7bb6e06a521e38662" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 42869 } } }
I20260805 22:51:38.080278 16804 sys_catalog.cc:458] T 00000000000000000000000000000000 P b66b54d527cd4999959d49649670c609 [sys.catalog]: This master's current role is: FOLLOWER
I20260805 22:51:38.081051 16790 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0700bba63ec743da94ec3d4b78318f8b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0700bba63ec743da94ec3d4b78318f8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0700bba63ec743da94ec3d4b78318f8b" member_type: VOTER last_known_addr { host: "127.14.224.190" port: 37617 } } peers { permanent_uuid: "b66b54d527cd4999959d49649670c609" member_type: VOTER last_known_addr { host: "127.14.224.189" port: 37697 } } peers { permanent_uuid: "a10ef0495f6b4db7bb6e06a521e38662" member_type: VOTER last_known_addr { host: "127.14.224.188" port: 42869 } } }
I20260805 22:51:38.081158 16790 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0700bba63ec743da94ec3d4b78318f8b [sys.catalog]: This master's current role is: LEADER
W20260805 22:51:38.116441 16739 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:51:38.111834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55812 (local address 127.14.224.188:42869)
0805 22:51:38.111914 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:38.111916 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:38.115585 (+ 3669us) server_negotiation.cc:407] Connection header received
0805 22:51:38.115713 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:38.115715 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:38.115728 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:38.115759 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:38.116333 (+ 574us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55812: BlockingRecv error: recv got EOF from 127.0.0.1:55812 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
W20260805 22:51:38.117379 16523 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:51:38.111671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51846 (local address 127.14.224.190:37617)
0805 22:51:38.111729 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:38.111732 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:38.116753 (+ 5021us) server_negotiation.cc:407] Connection header received
0805 22:51:38.116903 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:38.116905 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:38.116917 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:38.116947 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:38.117309 (+ 362us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51846: BlockingRecv error: recv got EOF from 127.0.0.1:51846 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
W20260805 22:51:38.118156 16740 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:51:38.112156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58734 (local address 127.14.224.189:37697)
0805 22:51:38.112202 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:38.112204 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:38.117595 (+ 5391us) server_negotiation.cc:407] Connection header received
0805 22:51:38.117728 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:38.117729 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:38.117743 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:38.117772 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:38.118095 (+ 323us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58734: BlockingRecv error: recv got EOF from 127.0.0.1:58734 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260805 22:51:38.120808 16740 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:51:38.119995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58750 (local address 127.14.224.189:37697)
0805 22:51:38.120048 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:38.120050 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:38.120270 (+ 220us) server_negotiation.cc:407] Connection header received
0805 22:51:38.120380 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:38.120381 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:38.120402 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:38.120430 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:38.120754 (+ 324us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58750: BlockingRecv error: recv got EOF from 127.0.0.1:58750 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
W20260805 22:51:38.124094 16740 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:51:38.123174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58756 (local address 127.14.224.189:37697)
0805 22:51:38.123213 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:38.123215 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:38.123554 (+ 339us) server_negotiation.cc:407] Connection header received
0805 22:51:38.123651 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:38.123652 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:38.123664 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:38.123691 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:38.124036 (+ 345us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58756: BlockingRecv error: recv got EOF from 127.0.0.1:58756 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260805 22:51:38.128393 16740 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:51:38.127416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58762 (local address 127.14.224.189:37697)
0805 22:51:38.127460 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:38.127462 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:38.127790 (+ 328us) server_negotiation.cc:407] Connection header received
0805 22:51:38.127895 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:38.127896 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:38.127908 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:38.127939 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:38.128332 (+ 393us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58762: BlockingRecv error: recv got EOF from 127.0.0.1:58762 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260805 22:51:38.135347 16740 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:51:38.133930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58770 (local address 127.14.224.189:37697)
0805 22:51:38.133982 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:38.133985 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:38.134505 (+ 520us) server_negotiation.cc:407] Connection header received
0805 22:51:38.134714 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:38.134716 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:38.134732 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:38.134768 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:38.135235 (+ 467us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58770: BlockingRecv error: recv got EOF from 127.0.0.1:58770 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
W20260805 22:51:38.145939 16740 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:51:38.144866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58782 (local address 127.14.224.189:37697)
0805 22:51:38.144917 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:38.144919 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:38.145256 (+ 337us) server_negotiation.cc:407] Connection header received
0805 22:51:38.145374 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:38.145375 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:38.145390 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:38.145421 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:38.145874 (+ 453us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58782: BlockingRecv error: recv got EOF from 127.0.0.1:58782 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
W20260805 22:51:38.164700 16740 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:51:38.163506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58788 (local address 127.14.224.189:37697)
0805 22:51:38.163557 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:38.163559 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:38.163918 (+ 359us) server_negotiation.cc:407] Connection header received
0805 22:51:38.164059 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:38.164061 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:38.164075 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:38.164106 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:38.164615 (+ 509us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58788: BlockingRecv error: recv got EOF from 127.0.0.1:58788 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260805 22:51:38.199234 16740 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:51:38.198212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58792 (local address 127.14.224.189:37697)
0805 22:51:38.198260 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:38.198262 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:38.198555 (+ 293us) server_negotiation.cc:407] Connection header received
0805 22:51:38.198657 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:38.198658 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:38.198671 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:38.198699 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:38.199163 (+ 464us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58792: BlockingRecv error: recv got EOF from 127.0.0.1:58792 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260805 22:51:38.265446 16740 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:51:38.264704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58804 (local address 127.14.224.189:37697)
0805 22:51:38.264770 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:38.264772 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:38.264863 (+ 91us) server_negotiation.cc:407] Connection header received
0805 22:51:38.264918 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:38.264919 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:38.264932 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:38.264996 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:38.265375 (+ 379us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58804: BlockingRecv error: recv got EOF from 127.0.0.1:58804 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
W20260805 22:51:38.395289 16740 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:51:38.394570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58806 (local address 127.14.224.189:37697)
0805 22:51:38.394663 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:38.394665 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:38.394734 (+ 69us) server_negotiation.cc:407] Connection header received
0805 22:51:38.394790 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:38.394791 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:38.394802 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:38.394853 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:38.395202 (+ 349us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58806: BlockingRecv error: recv got EOF from 127.0.0.1:58806 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
W20260805 22:51:38.653159 16740 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:51:38.652510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58820 (local address 127.14.224.189:37697)
0805 22:51:38.652569 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:38.652571 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:38.652636 (+ 65us) server_negotiation.cc:407] Connection header received
0805 22:51:38.652691 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:38.652692 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:38.652701 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:38.652764 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:51:38.653087 (+ 323us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58820: BlockingRecv error: recv got EOF from 127.0.0.1:58820 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
I20260805 22:51:39.026980 16788 catalog_manager.cc:1259] Loaded cluster ID: 09f7c0b1a174427a9a76db07cb95e365
I20260805 22:51:39.027070 16788 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a10ef0495f6b4db7bb6e06a521e38662: loading cluster ID for follower catalog manager: success
I20260805 22:51:39.027969 16788 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a10ef0495f6b4db7bb6e06a521e38662: acquiring CA information for follower catalog manager: success
I20260805 22:51:39.028275 16788 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a10ef0495f6b4db7bb6e06a521e38662: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260805 22:51:39.080386 16826 catalog_manager.cc:1259] Loaded cluster ID: 09f7c0b1a174427a9a76db07cb95e365
I20260805 22:51:39.080492 16826 catalog_manager.cc:1552] T 00000000000000000000000000000000 P b66b54d527cd4999959d49649670c609: loading cluster ID for follower catalog manager: success
I20260805 22:51:39.081321 16826 catalog_manager.cc:1574] T 00000000000000000000000000000000 P b66b54d527cd4999959d49649670c609: acquiring CA information for follower catalog manager: success
I20260805 22:51:39.081648 16826 catalog_manager.cc:1602] T 00000000000000000000000000000000 P b66b54d527cd4999959d49649670c609: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260805 22:51:39.168989 16935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:39.166376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58834 (local address 127.14.224.189:37697)
0805 22:51:39.166489 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:39.166491 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:39.166521 (+ 30us) server_negotiation.cc:407] Connection header received
0805 22:51:39.166579 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:39.166580 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:39.166633 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:39.166716 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:51:39.166844 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:39.167399 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:39.168180 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:39.168387 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:39.168449 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:39.168616 (+ 167us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:51:39.168736 (+ 120us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:51:39.168796 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:39.168891 (+ 95us) server_negotiation.cc:299] Negotiation successful
0805 22:51:39.168912 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95,"thread_start_us":67,"threads_started":1}
I20260805 22:51:39.173272 16942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:39.170811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55826 (local address 127.14.224.188:42869)
0805 22:51:39.170940 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:39.170942 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:39.170951 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:51:39.170993 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:39.170994 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:39.171033 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:39.171136 (+ 103us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:51:39.171235 (+ 99us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:39.171740 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:39.172510 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:39.172724 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:39.172780 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:39.172926 (+ 146us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:51:39.173044 (+ 118us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:51:39.173114 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:39.173160 (+ 46us) server_negotiation.cc:299] Negotiation successful
0805 22:51:39.173180 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90,"thread_start_us":58,"threads_started":1}
I20260805 22:51:39.178093 16942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:39.174893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55828 (local address 127.14.224.188:42869)
0805 22:51:39.175035 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:39.175036 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:39.175285 (+ 249us) server_negotiation.cc:407] Connection header received
0805 22:51:39.175336 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:39.175337 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:39.175349 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:39.175392 (+ 43us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:51:39.175554 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:39.176013 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:39.177057 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:39.177345 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:39.177407 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:39.177749 (+ 342us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:51:39.177787 (+ 38us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:51:39.177830 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:39.177976 (+ 146us) server_negotiation.cc:299] Negotiation successful
0805 22:51:39.178005 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124}
I20260805 22:51:39.178241 16947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:39.174829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51848 (local address 127.14.224.190:37617)
0805 22:51:39.175015 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:39.175017 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:39.175177 (+ 160us) server_negotiation.cc:407] Connection header received
0805 22:51:39.175230 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:39.175231 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:39.175314 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:39.175396 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:51:39.175525 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:39.176269 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:39.177013 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:39.177337 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:39.177407 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:39.177693 (+ 286us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:51:39.177980 (+ 287us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:51:39.178037 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:39.178134 (+ 97us) server_negotiation.cc:299] Negotiation successful
0805 22:51:39.178162 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":57,"threads_started":1}
I20260805 22:51:39.178290 16935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:51:39.174824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58850 (local address 127.14.224.189:37697)
0805 22:51:39.174993 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0805 22:51:39.174996 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:51:39.175099 (+ 103us) server_negotiation.cc:407] Connection header received
0805 22:51:39.175145 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:51:39.175146 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:51:39.175159 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:51:39.175207 (+ 48us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:51:39.175371 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:39.176137 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:39.177097 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:51:39.177360 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:51:39.177445 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:51:39.177645 (+ 200us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:51:39.177685 (+ 40us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:51:39.177906 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0805 22:51:39.178183 (+ 277us) server_negotiation.cc:299] Negotiation successful
0805 22:51:39.178211 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121}
I20260805 22:51:39.180452 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 16426
I20260805 22:51:39.188484 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 16528
I20260805 22:51:39.202466 15234 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9AL_ND/build/release/bin/kudu with pid 16628
2026-08-05T22:51:39Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (2945 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (5893 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (277914 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST